00000001:02000400:3.0F:1788540793.395283:0:3296:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg256-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1788540817.832545:0:3519:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg256-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1788540819.792713:0:3562:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 656 MB/s 00000001:01000000:0.0F:1788540820.049023:0:3562:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 712 MB/s 00000001:01000000:1.0:1788540820.306773:0:3562:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 2680 MB/s 00000020:02000000:2.0F:1788540821.241484:0:3610:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_2_g4093f3c 00000400:02000000:2.0:1788540822.162565:0:3625:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.202.156@tcp [8/256/0/180] 00008000:02000000:2.0:1788540826.099504:0:3775:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1788540886.577484:0:5744:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg256-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788540899.611040:0:6494:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788540899.611046:0:6494:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788540899.611048:0:6494:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788540899.611178:0:6494:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000001929a2a5 00000080:02000400:2.0:1788540899.611190:0:6494:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1788540899.627607:0:6494:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1788540899.627621:0:6494:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788540899.627653:0:6494:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000000714a59b) 00000020:00000080:2.0:1788540899.627671:0:6494:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788540899.721523:0:6494:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1788540899.721621:0:6494:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:2.0:1788540899.742602:0:6494:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788540899.742828:0:6494:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788540899.742837:0:6494:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788540899.742848:0:6494:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2aac941e5f4a71a8 00000020:01000004:2.0:1788540899.742855:0:6494:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1788540899.742859:0:6494:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788540899.742863:0:6494:0:(tgt_mount.c:101:server_register_mount()) register mount 000000001929a2a5 from MGS 00000020:01000004:2.0:1788540899.743027:0:6494:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788540899.743038:0:6494:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000008d21e4ef) 00000020:00000080:2.0:1788540899.743051:0:6494:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788540899.743111:0:6494:0:(tgt_mount.c:153:server_get_mount()) get mount 000000001929a2a5 from MGS, refs=2 00080000:01000000:2.0:1788540899.743116:0:6494:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788540899.743120:0:6494:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2aac941e5f4a71b6 00000100:00100000:2.0:1788540899.743209:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788540899.743349:0:6494:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788540899.743357:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788540899.744284:0:6494:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788540899.744293:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788540899.745101:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788540899.745265:0:6494:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788540899.745270:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788540899.746066:0:6494:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788540899.746078:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788540899.746410:0:6494:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788540899.746416:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788540899.747227:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788540899.747230:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788540899.747232:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788540899.747901:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788540899.747904:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788540899.747906:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540899.748743:0:6494:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788540899.754461:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788540899.999431:0:6494:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3541 MB/s 00000001:01000000:0.0:1788540900.249197:0:6494:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 1963 MB/s 00000001:01000000:2.0:1788540900.504391:0:6494:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 439 MB/s 00000001:01000000:0.0:1788540900.754616:0:6494:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 779 MB/s 00080000:10000000:0.0:1788540900.759010:0:6494:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:0.0:1788540900.766710:0:6494:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1788540900.767494:0:6508:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788540900.767551:0:6494:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788540900.767596:0:6494:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1788540900.767763:0:6494:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788540900.767785:0:6494:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788540900.768393:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788540900.768551:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788540900.768557:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788540900.774794:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788540900.774810:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788540900.775200:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788540900.775216:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788540900.775860:0:6494:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788540900.775907:0:6494:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.156@tcp' 00000020:01000004:0.0:1788540900.775909:0:6494:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788540900.775949:0:6494:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.156@tcp (typ=mgc) 00000020:00000080:0.0:1788540900.775968:0:6494:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.156@tcp (000000002ea34c24) 00000020:00000080:0.0:1788540900.775983:0:6494:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788540900.776173:0:6494:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000f74ec1c9@MGC192.168.202.156@tcp: add connection 192.168.202.156@tcp at head 00010000:00010000:0.0:1788540900.776392:0:6494:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.156@tcp-0 is initialized 00000040:01000000:0.0:1788540900.776399:0:6494:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.156@tcp ctxt 1 is initialized 00000100:00080000:1.0:1788540900.776764:0:6513:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1788540900.783894:0:6514:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788540900.785606:0:6494:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.156@tcp (uuid 425687b6-1d99-41d2-88d8-2fb230997596) 00000020:00000080:0.0:1788540900.785634:0:6494:0:(genops.c:1385:class_connect()) connect: client 425687b6-1d99-41d2-88d8-2fb230997596, cookie 0x2aac941e5f4a71c4 00000100:00080000:0.0:1788540900.785646:0:6494:0:(import.c:545:import_select_connection()) MGC192.168.202.156@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788540900.785652:0:6494:0:(import.c:665:import_select_connection()) MGC192.168.202.156@tcp: import 00000000f74ec1c9 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:0.0:1788540900.785702:0:6494:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000eb1e7107 x1875420980969600/t0(0) o250->MGC192.168.202.156@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788540900.785743:0:6494:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 425687b6-1d99-41d2-88d8-2fb230997596->MGS 00000020:01000004:0.0:1788540900.785761:0:6494:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788540900.785766:0:6494:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788540900.785780:0:6494:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000005286c403) 00000020:00000080:0.0:1788540900.785793:0:6494:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788540900.788542:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eb1e7107 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:425687b6-1d99-41d2-88d8-2fb230997596:3640:1875420980969600:0@lo:250: 00000100:00100000:3.0:1788540900.788620:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540900.789225:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980969600 00000100:00100000:1.0:1788540900.789238:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980969600 00000100:00100000:1.0:1788540900.789394:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788540900.789402:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000055d402bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3640:x1875420980969600:12345-0@lo:250: 00010000:00080000:1.0:1788540900.789431:0:6509:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 425687b6-1d99-41d2-88d8-2fb230997596@0@lo t0 exp 0000000000000000 cur 181 last 0 00000020:00000080:1.0:1788540900.789480:0:6509:0:(genops.c:1385:class_connect()) connect: client 425687b6-1d99-41d2-88d8-2fb230997596, cookie 0x2aac941e5f4a71d2 00000100:00080000:1.0:1788540900.789604:0:6509:0:(import.c:65:import_set_state_nolock()) 0000000076f422d8 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788540900.789672:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000055d402bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+5:3640:x1875420980969600:12345-0@lo:250: Request processed in 270us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540900.789680:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788540900.790190:0:3640:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.156@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788540900.790200:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.202.156@tcp: connect to target with instance 0 00000100:00080000:3.0:1788540900.790206:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.202.156@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788540900.790210:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788540900.790213:0:3640:0:(import.c:65:import_set_state_nolock()) 00000000f74ec1c9 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788540900.790216:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788540900.790227:0:3640:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788540900.790232:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eb1e7107 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:425687b6-1d99-41d2-88d8-2fb230997596:3640:1875420980969600:0@lo:250: 00000100:00100000:0.0:1788540900.796356:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788540900.798309:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788540900.798319:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788540900.808429:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788540900.808441:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00010000:00010000:1.0:1788540900.810146:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788540900.810158:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788540900.810167:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788540900.811435:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788540900.811654:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788540900.811662:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788540900.814570:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788540900.814583:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788540900.844467:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788540900.844706:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788540900.844713:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788540900.845835:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788540900.845843:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788540900.846691:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788540900.846856:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788540900.846862:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788540900.847690:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788540900.847698:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788540900.848544:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788540900.848714:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788540900.848720:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788540900.849396:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788540900.849404:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788540900.849981:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788540900.850229:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788540900.850235:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788540900.850862:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788540900.850899:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788540900.864468:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788540900.864671:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788540900.864676:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788540900.865855:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788540900.865865:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788540900.866776:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788540900.866785:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788540900.867837:0:6494:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788540900.867979:0:6494:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1788540900.867987:0:6494:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.156@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788540900.868161:0:6494:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.156@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788540900.868196:0:6494:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.156@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1788540900.868201:0:6494:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788540900.868203:0:6494:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788540900.868204:0:6494:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788540900.868205:0:6494:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788540900.868206:0:6494:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788540900.868208:0:6494:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788540900.868209:0:6494:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788540900.868210:0:6494:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788540900.868211:0:6494:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788540900.868213:0:6494:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788540900.868218:0:6494:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788540900.868219:0:6494:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788540900.868222:0:6494:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1788540900.868223:0:6494:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788540900.868225:0:6494:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788540900.868226:0:6494:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788540900.868226:0:6494:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788540900.868227:0:6494:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788540900.868228:0:6494:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788540900.868229:0:6494:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788540900.868230:0:6494:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788540900.868231:0:6494:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788540900.868232:0:6494:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788540900.868233:0:6494:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788540900.868234:0:6494:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788540900.868324:0:6494:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788540900.868342:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d286816b pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:6494:1875420980969728:0@lo:253: 00000100:00100000:2.0:1788540900.868422:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540900.868539:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set 0000000093b902d4 going to sleep for 11 seconds 00000100:00100000:0.0:1788540900.868590:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980969728 00000100:00100000:0.0:1788540900.868597:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980969728 00000100:00100000:0.0:1788540900.868698:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788540900.868705:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd6bf902 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+5:6494:x1875420980969728:12345-0@lo:253: 20000000:01000000:0.0:1788540900.868740:0:6512:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788540900.868742:0:6512:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1788540900.869132:0:6533:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788540900.869169:0:6512:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1788540900.869720:0:6512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788540900.870763:0:6534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1788540900.871031:0:6512:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788540900.871035:0:6512:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1788540900.871040:0:6512:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1788540900.871043:0:6512:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1788540900.871054:0:6512:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1788540900.871335:0:6512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788540900.871487:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1788540900.871501:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788540900.871518:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1788540900.871533:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1788540900.871548:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1788540900.871597:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1788540900.871605:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1788540900.871616:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1788540900.871621:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1788540900.871633:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1788540900.871638:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1788540900.871650:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1788540900.871665:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1788540900.871690:0:6512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788540900.871694:0:6512:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1788540900.871701:0:6512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788540900.871794:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1788540900.871803:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788540900.871816:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1788540900.871830:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1788540900.871856:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1788540900.871865:0:6512:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1788540900.872250:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1788540900.872260:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788540900.872337:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1788540900.872355:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1788540900.872368:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1788540900.872378:0:6512:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1788540900.872402:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1788540900.872410:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1788540900.872423:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1788540900.872439:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1788540900.872500:0:6512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1788540900.872518:0:6512:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1788540900.872525:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1788540900.873014:0:6535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1788540900.873255:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1788540900.873345:0:6512:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.156@tcp for mdt 20000000:01000000:0.0:1788540900.873347:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.156@tcp (null) (null) (null) 00000040:00080000:0.0:1788540900.873365:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1788540900.873372:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788540900.873383:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1788540900.873388:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.156@tcp (null) (null) 00000040:00080000:0.0:1788540900.873401:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1788540900.873408:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1788540900.873421:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1788540900.873436:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1788540900.873472:0:6512:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788540900.873476:0:6512:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788540900.873479:0:6512:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788540900.873517:0:6512:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788540900.873520:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788540900.873973:0:6536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1788540900.874216:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1788540900.874240:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1788540900.874255:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1788540900.874264:0:6512:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788540900.874335:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788540900.874635:0:6537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1788540900.874789:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1788540900.874809:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1788540900.874842:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:1.0:1788540900.874855:0:6512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788540900.874863:0:6512:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1788540900.874998:0:6512:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788540900.875001:0:6512:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788540900.875005:0:6512:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1788540900.875011:0:6512:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788540900.875393:0:6538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1788540900.875523:0:6512:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1788540900.883244:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1788540900.883294:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1788540900.883312:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1788540900.883331:0:6512:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788540900.883353:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000079364d83/0x2aac941e5f4a71d9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540900.883370:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000079364d83/0x2aac941e5f4a71d9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540900.883379:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000079364d83/0x2aac941e5f4a71d9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540900.883385:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000079364d83/0x2aac941e5f4a71d9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540900.883390:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000079364d83/0x2aac941e5f4a71d9 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540900.883396:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000079364d83/0x2aac941e5f4a71d9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540900.883401:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000079364d83 already unused, calling callback (00000000b72a7d0e) 00010000:00010000:1.0:1788540900.883404:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000079364d83/0x2aac941e5f4a71d9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540900.883424:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000079364d83/0x2aac941e5f4a71d9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540900.883435:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000079364d83/0x2aac941e5f4a71d9 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540900.883452:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000079364d83/0x2aac941e5f4a71d9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540900.883458:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000079364d83/0x2aac941e5f4a71d9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788540900.883476:0:6512:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788540900.894658:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd6bf902 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+5:6494:x1875420980969728:12345-0@lo:253: Request processed in 25945us (26227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540900.894673:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788540900.894756:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d286816b pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:6494:1875420980969728:0@lo:253: 10000000:01000000:2.0:1788540900.894770:0:6494:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788540900.894773:0:6494:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788540900.894775:0:6494:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788540900.894777:0:6494:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788540900.894778:0:6494:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1788540900.894779:0:6494:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788540900.894781:0:6494:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788540900.894782:0:6494:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788540900.894783:0:6494:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788540900.894785:0:6494:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788540900.894786:0:6494:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788540900.894798:0:6494:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788540900.894818:0:6494:0:(tgt_mount.c:101:server_register_mount()) register mount 000000001929a2a5 from lustre-MDT0000 10000000:01000000:2.0:1788540900.894847:0:6494:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788540900.894850:0:6494:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788540900.894854:0:6494:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9a682e74b380 10000000:01000000:2.0:1788540900.894859:0:6494:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788540900.894867:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9a682e74b380 from 1 10000000:01000000:2.0:1788540900.895020:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788540900.895059:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: 00000000c82a60fc/0x2aac941e5f4a71e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540900.895137:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: 00000000c82a60fc/0x2aac941e5f4a71e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540900.895148:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: 00000000c82a60fc/0x2aac941e5f4a71e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540900.895166:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d286816b pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:6494:1875420980969856:0@lo:101: 00000100:00100000:2.0:1788540900.895218:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540900.895301:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set 000000007d307212 going to sleep for 11 seconds 00000100:00100000:1.0:1788540900.895388:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980969856 00000100:00100000:1.0:1788540900.895395:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980969856 00000100:00100000:1.0:1788540900.895479:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788540900.895488:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005cb3092f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+5:6494:x1875420980969856:12345-0@lo:101: 00010000:00010000:1.0:1788540900.895501:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788540900.895514:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000881bde30/0x2aac941e5f4a71e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a71e0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540900.895549:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000881bde30/0x2aac941e5f4a71e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a71e0 expref: 6 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540900.895560:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000881bde30/0x2aac941e5f4a71e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a71e0 expref: 6 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540900.895581:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000881bde30, rc 0) 00000100:00100000:1.0:1788540900.895656:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005cb3092f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+6:6494:x1875420980969856:12345-0@lo:101: Request processed in 170us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540900.895663:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788540900.895734:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d286816b pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:6494:1875420980969856:0@lo:101: 00010000:00010000:2.0:1788540900.895747:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: 00000000c82a60fc/0x2aac941e5f4a71e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a71e7 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540900.895755:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: 00000000c82a60fc/0x2aac941e5f4a71e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a71e7 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540900.895812:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d286816b pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:6494:1875420980969984:0@lo:501: 00000100:00100000:2.0:1788540900.895837:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540900.895935:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set 000000007d307212 going to sleep for 11 seconds 00000100:00100000:1.0:1788540900.896007:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980969984 00000100:00100000:1.0:1788540900.896011:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980969984 00000100:00100000:1.0:1788540900.896042:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788540900.896048:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c0d8e0c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+6:6494:x1875420980969984:12345-0@lo:501: 00000100:00100000:1.0:1788540900.896243:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c0d8e0c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+6:6494:x1875420980969984:12345-0@lo:501: Request processed in 195us (406us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788540900.896250:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788540900.896370:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d286816b pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:6494:1875420980969984:0@lo:501: 10000000:01000000:2.0:1788540900.896397:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788540900.896450:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: 00000000c82a60fc/0x2aac941e5f4a71e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a71e7 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540900.896458:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: 00000000c82a60fc/0x2aac941e5f4a71e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a71e7 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788540900.896467:0:6494:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a68112dc000 10000000:01000000:2.0:1788540900.896471:0:6494:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788540900.896474:0:6494:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9a68112dc000 10000000:01000000:2.0:1788540900.896477:0:6494:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788540900.896479:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9a68112dc000 from 1 10000000:01000000:2.0:1788540900.896481:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788540900.896498:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: 000000003d188245/0x2aac941e5f4a71ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540900.896505:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: 000000003d188245/0x2aac941e5f4a71ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540900.896512:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: 000000003d188245/0x2aac941e5f4a71ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540900.896523:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d286816b pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:6494:1875420980970112:0@lo:101: 00000100:00100000:2.0:1788540900.896550:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540900.896572:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set 000000007d307212 going to sleep for 11 seconds 00000100:00100000:0.0:1788540900.896615:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980970112 00000100:00100000:0.0:1788540900.896620:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980970112 00000100:00100000:0.0:1788540900.896652:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788540900.896658:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee80b125 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+6:6494:x1875420980970112:12345-0@lo:101: 00010000:00010000:0.0:1788540900.896666:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788540900.896676:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000058d171a6/0x2aac941e5f4a71f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a71ee expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540900.896691:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000058d171a6/0x2aac941e5f4a71f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a71ee expref: 7 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540900.896699:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000058d171a6/0x2aac941e5f4a71f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a71ee expref: 7 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540900.896706:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000058d171a6, rc 0) 00000100:00100000:0.0:1788540900.896763:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee80b125 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+7:6494:x1875420980970112:12345-0@lo:101: Request processed in 105us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540900.896769:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788540900.896845:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d286816b pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:6494:1875420980970112:0@lo:101: 00010000:00010000:3.0:1788540900.896855:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: 000000003d188245/0x2aac941e5f4a71ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a71f5 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540900.896862:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: 000000003d188245/0x2aac941e5f4a71ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a71f5 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788540900.896912:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788540900.901182:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: 000000003d188245/0x2aac941e5f4a71ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a71f5 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540900.901202:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: 000000003d188245/0x2aac941e5f4a71ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a71f5 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788540900.901211:0:6494:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788540900.901220:0:6494:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788540900.901241:0:6494:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9a68112dc000 10000000:01000000:3.0:1788540900.901244:0:6494:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788540900.901249:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788540900.901252:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788540900.901318:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: 00000000f889216a/0x2aac941e5f4a71fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540900.901326:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: 00000000f889216a/0x2aac941e5f4a71fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540900.901336:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: 00000000f889216a/0x2aac941e5f4a71fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540900.901358:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a2c8aab3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:6494:1875420980970240:0@lo:101: 00000100:00100000:3.0:1788540900.901428:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540900.901477:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set 00000000530b5ca5 going to sleep for 11 seconds 00000100:00100000:0.0:1788540900.901770:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980970240 00000100:00100000:0.0:1788540900.901779:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980970240 00000100:00100000:0.0:1788540900.901863:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788540900.901895:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007cbd601f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+7:6494:x1875420980970240:12345-0@lo:101: 00010000:00010000:0.0:1788540900.901907:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788540900.901919:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000994bcdd1/0x2aac941e5f4a7203 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a71fc expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540900.901940:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000994bcdd1/0x2aac941e5f4a7203 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a71fc expref: 8 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540900.901963:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000994bcdd1/0x2aac941e5f4a7203 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a71fc expref: 8 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540900.901971:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000994bcdd1, rc 0) 00000100:00100000:0.0:1788540900.902012:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007cbd601f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+8:6494:x1875420980970240:12345-0@lo:101: Request processed in 142us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540900.902018:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788540900.902234:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a2c8aab3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:6494:1875420980970240:0@lo:101: 00010000:00010000:3.0:1788540900.902249:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: 00000000f889216a/0x2aac941e5f4a71fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7203 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540900.902257:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: 00000000f889216a/0x2aac941e5f4a71fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a7203 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540900.902339:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a2c8aab3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:6494:1875420980970368:0@lo:501: 00000100:00100000:3.0:1788540900.902365:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540900.902518:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set 00000000530b5ca5 going to sleep for 11 seconds 00000100:00100000:1.0:1788540900.902595:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980970368 00000100:00100000:1.0:1788540900.902600:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980970368 00000100:00100000:1.0:1788540900.902620:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788540900.902626:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ba1561db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+8:6494:x1875420980970368:12345-0@lo:501: 00000100:00100000:1.0:1788540900.902747:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ba1561db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+9:6494:x1875420980970368:12345-0@lo:501: Request processed in 121us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540900.902753:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788540900.902830:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a2c8aab3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:6494:1875420980970368:0@lo:501: 00000100:00100000:3.0:1788540900.902855:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a2c8aab3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:6494:1875420980970496:0@lo:503: 00000100:00100000:3.0:1788540900.902917:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540900.902940:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set 00000000530b5ca5 going to sleep for 11 seconds 00000100:00100000:1.0:1788540900.902996:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980970496 00000100:00100000:1.0:1788540900.903000:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980970496 00000100:00100000:1.0:1788540900.903018:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788540900.903023:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cded9c2c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+9:6494:x1875420980970496:12345-0@lo:503: 00000100:00100000:1.0:1788540900.903111:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cded9c2c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+9:6494:x1875420980970496:12345-0@lo:503: Request processed in 87us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540900.903117:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788540900.903252:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a2c8aab3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:6494:1875420980970496:0@lo:503: 00000100:00100000:1.0:1788540900.903667:0:6539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000c857579 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:6539:1875420980970624:0@lo:502: 00000100:00100000:1.0:1788540900.903708:0:6539:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540900.903728:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980970624 00000100:00100000:1.0:1788540900.903731:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980970624 00000100:00100000:1.0:1788540900.903748:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788540900.903753:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000060fbb4af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+9:6539:x1875420980970624:12345-0@lo:502: 00000100:00100000:1.0:1788540900.903819:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000060fbb4af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+9:6539:x1875420980970624:12345-0@lo:502: Request processed in 66us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540900.903826:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788540900.903861:0:6539:0:(client.c:2716:ptlrpc_set_wait()) set 0000000028dbb16c going to sleep for 11 seconds 00000100:00100000:1.0:1788540900.903902:0:6539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000c857579 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:6539:1875420980970624:0@lo:502: 00000020:01000000:1.0:1788540900.903925:0:6539:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788540900.903935:0:6539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788540900.903938:0:6539:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788540900.903942:0:6539:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788540900.903944:0:6539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788540900.903963:0:6539:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000c6e5b4e8) 00000020:00000080:1.0:1788540900.903979:0:6539:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788540900.903985:0:6539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788540900.904097:0:6539:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788540900.904105:0:6539:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2aac941e5f4a7211 00000020:00000080:1.0:1788540900.904475:0:6539:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788540900.904480:0:6539:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788540900.904484:0:6539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788540900.904485:0:6539:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788540900.904488:0:6539:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788540900.904491:0:6539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788540900.904492:0:6539:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788540900.904495:0:6539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788540900.904501:0:6539:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000d5fe3779) 00000020:00000080:1.0:1788540900.904511:0:6539:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788540900.904523:0:6539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788540900.904525:0:6539:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788540900.904527:0:6539:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788540900.904533:0:6539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788540900.904588:0:6539:0:(tgt_mount.c:153:server_get_mount()) get mount 000000001929a2a5 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788540900.904599:0:6539:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000d9794f52) 00000020:00000080:1.0:1788540900.904608:0:6539:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788540900.904685:0:6539:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788540900.904691:0:6539:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2aac941e5f4a7226 00000020:00000080:1.0:1788540900.904778:0:6539:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788540900.904783:0:6539:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788540900.904787:0:6539:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x2aac941e5f4a722d 00080000:01000000:1.0:1788540900.904791:0:6539:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788540900.904794:0:6539:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2aac941e5f4a7234 00080000:10000000:1.0:1788540900.905367:0:6539:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1788540900.905518:0:6539:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1788540900.909830:0:6539:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1788540900.997517:0:6539:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788540900.997857:0:6539:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788540901.004857:0:6539:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788540901.005660:0:6539:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788540901.008137:0:6539:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000004a30dfef) 00000020:00000080:0.0:1788540901.008159:0:6539:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788540901.008221:0:6539:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788540901.008226:0:6539:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2aac941e5f4a7242 00000020:00000080:0.0:1788540901.010387:0:6539:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1788540901.011481:0:6539:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:0.0:1788540901.014862:0:6539:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:0.0:1788540901.019913:0:6539:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:0.0:1788540901.022553:0:6539:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:0.0:1788540901.025031:0:6539:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:0.0:1788540901.030578:0:6539:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:0.0:1788540901.039741:0:6539:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x2aac941e5f4a7249 00000020:00000080:0.0:1788540901.043819:0:6539:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788540901.043835:0:6539:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788540901.043845:0:6539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788540901.043847:0:6539:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788540901.043851:0:6539:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788540901.043854:0:6539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788540901.043855:0:6539:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788540901.043858:0:6539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788540901.043860:0:6539:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788540901.043862:0:6539:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788540901.043906:0:6539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788540901.043907:0:6539:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788540901.043910:0:6539:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788540901.043915:0:6539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788540901.043916:0:6539:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788540901.043920:0:6539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788540901.043972:0:6539:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1788540901.044028:0:6539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d4b35252 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:6539:1875420980970752:0@lo:502: 00000100:00100000:0.0:1788540901.044115:0:6539:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540901.044525:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980970752 00000100:00100000:1.0:1788540901.044533:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980970752 00000100:00100000:1.0:1788540901.044584:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788540901.044591:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2312b16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+9:6539:x1875420980970752:12345-0@lo:502: 00000100:00100000:1.0:1788540901.044699:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2312b16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+9:6539:x1875420980970752:12345-0@lo:502: Request processed in 108us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540901.044706:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788540901.047285:0:6539:0:(client.c:2716:ptlrpc_set_wait()) set 000000009d747e21 going to sleep for 11 seconds 00000100:00100000:0.0:1788540901.047335:0:6539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d4b35252 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:6539:1875420980970752:0@lo:502: 00000020:01000000:0.0:1788540901.047382:0:6539:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788540901.047390:0:6539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788540901.047393:0:6539:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1788540901.047397:0:6539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1788540901.047583:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1788540901.047606:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788540901.047623:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: 00000000f889216a/0x2aac941e5f4a71fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7203 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540901.047632:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: 00000000f889216a/0x2aac941e5f4a71fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7203 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788540901.047640:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a68112dc000 from 1 10000000:01000000:3.0:1788540901.047643:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788540901.047682:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: 00000000e18abe71/0x2aac941e5f4a7250 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540901.047690:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: 00000000e18abe71/0x2aac941e5f4a7250 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540901.047698:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: 00000000e18abe71/0x2aac941e5f4a7250 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540901.047718:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a2c8aab3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:6494:1875420980970880:0@lo:101: 00000100:00100000:3.0:1788540901.047796:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540901.047835:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set 000000009414f090 going to sleep for 11 seconds 00000100:00100000:2.0:1788540901.048273:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980970880 00000100:00100000:2.0:1788540901.048280:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980970880 00000100:00100000:2.0:1788540901.048317:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788540901.048323:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a3da534e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+9:6494:x1875420980970880:12345-0@lo:101: 00010000:00010000:2.0:1788540901.048342:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788540901.048360:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e8dce746/0x2aac941e5f4a7257 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a7250 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540901.048384:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e8dce746/0x2aac941e5f4a7257 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a7250 expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540901.048394:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e8dce746/0x2aac941e5f4a7257 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a7250 expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540901.048402:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e8dce746, rc 0) 00000100:00100000:2.0:1788540901.048451:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a3da534e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+10:6494:x1875420980970880:12345-0@lo:101: Request processed in 119us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540901.048458:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788540901.048486:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a2c8aab3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:6494:1875420980970880:0@lo:101: 00010000:00010000:3.0:1788540901.048501:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: 00000000e18abe71/0x2aac941e5f4a7250 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7257 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540901.048508:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: 00000000e18abe71/0x2aac941e5f4a7250 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a7257 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540901.049292:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a2c8aab3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:6494:1875420980971008:0@lo:256: 00000100:00100000:3.0:1788540901.051692:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540901.051747:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set 000000009414f090 going to sleep for 11 seconds 00000100:00100000:0.0:1788540901.052010:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980971008 00000100:00100000:0.0:1788540901.052019:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980971008 00000100:00100000:0.0:1788540901.052070:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788540901.052078:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b0f5597 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+10:6494:x1875420980971008:12345-0@lo:256: 20000000:01000000:0.0:1788540901.052102:0:6512:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788540901.052108:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788540901.052186:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b0f5597 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+10:6494:x1875420980971008:12345-0@lo:256: Request processed in 109us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540901.052194:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788540901.052243:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a2c8aab3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:6494:1875420980971008:0@lo:256: 10000000:01000000:0.0:1788540901.052836:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788540901.052851:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: 00000000e18abe71/0x2aac941e5f4a7250 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7257 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540901.053022:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: 00000000e18abe71/0x2aac941e5f4a7250 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7257 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788540901.053032:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a68112dc000 from 1 10000000:01000000:0.0:1788540901.053034:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788540901.053067:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: 0000000017ac3779/0x2aac941e5f4a725e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540901.053074:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: 0000000017ac3779/0x2aac941e5f4a725e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540901.053083:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: 0000000017ac3779/0x2aac941e5f4a725e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540901.053099:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d4b35252 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:6494:1875420980971136:0@lo:101: 00000100:00100000:0.0:1788540901.053136:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540901.053264:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set 0000000006327561 going to sleep for 11 seconds 00000100:00100000:1.0:1788540901.054137:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980971136 00000100:00100000:1.0:1788540901.054146:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980971136 00000100:00100000:1.0:1788540901.054207:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788540901.054215:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000beb5f6ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+10:6494:x1875420980971136:12345-0@lo:101: 00010000:00010000:1.0:1788540901.054227:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788540901.054243:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000079364d83/0x2aac941e5f4a7265 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a725e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540901.054279:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000079364d83/0x2aac941e5f4a7265 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a725e expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540901.054290:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000079364d83/0x2aac941e5f4a7265 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a725e expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540901.054298:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000079364d83, rc 0) 00000100:00100000:1.0:1788540901.054566:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000beb5f6ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+11:6494:x1875420980971136:12345-0@lo:101: Request processed in 351us (1428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540901.054573:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788540901.054665:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d4b35252 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:6494:1875420980971136:0@lo:101: 00010000:00010000:0.0:1788540901.054681:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: 0000000017ac3779/0x2aac941e5f4a725e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7265 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540901.054690:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: 0000000017ac3779/0x2aac941e5f4a725e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a7265 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540901.054762:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d4b35252 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:6494:1875420980971264:0@lo:501: 00000100:00100000:0.0:1788540901.054793:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540901.054834:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set 0000000006327561 going to sleep for 11 seconds 00000100:00100000:1.0:1788540901.056078:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980971264 00000100:00100000:1.0:1788540901.056089:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980971264 00000100:00100000:1.0:1788540901.056140:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788540901.056148:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000424898e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+11:6494:x1875420980971264:12345-0@lo:501: 00000100:00100000:1.0:1788540901.056401:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000424898e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+11:6494:x1875420980971264:12345-0@lo:501: Request processed in 188us (1542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540901.056410:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788540901.056528:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d4b35252 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:6494:1875420980971264:0@lo:501: 00000100:00100000:0.0:1788540901.056571:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d4b35252 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:6494:1875420980971392:0@lo:503: 00000100:00100000:0.0:1788540901.056620:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540901.056653:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set 0000000006327561 going to sleep for 11 seconds 00000100:00100000:1.0:1788540901.057462:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980971392 00000100:00100000:1.0:1788540901.057470:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980971392 00000100:00100000:1.0:1788540901.057503:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788540901.057510:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cce9cc05 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+11:6494:x1875420980971392:12345-0@lo:503: 00000040:00080000:1.0:1788540901.057555:0:6512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788540901.057623:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cce9cc05 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+11:6494:x1875420980971392:12345-0@lo:503: Request processed in 113us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540901.057630:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788540901.057712:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d4b35252 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:6494:1875420980971392:0@lo:503: 00000040:00080000:2.0:1788540901.059579:0:6543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1788540901.063008:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1788540901.063046:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788540901.063125:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: 0000000017ac3779/0x2aac941e5f4a725e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7265 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540901.063140:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: 0000000017ac3779/0x2aac941e5f4a725e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7265 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788540901.063987:0:6494:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788540901.063993:0:6494:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a68112dc000 10000000:01000000:0.0:1788540901.063996:0:6494:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a68112dc000 10000000:01000000:0.0:1788540901.064000:0:6494:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788540901.064006:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a68112dc000 from 1 10000000:01000000:0.0:1788540901.064010:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788540901.064045:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: 00000000e86a0444/0x2aac941e5f4a726c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540901.064055:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: 00000000e86a0444/0x2aac941e5f4a726c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540901.064066:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: 00000000e86a0444/0x2aac941e5f4a726c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540901.064096:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d4b35252 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:6494:1875420980971520:0@lo:101: 00000100:00100000:0.0:1788540901.064991:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540901.065103:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e2123c72 going to sleep for 11 seconds 00000100:00100000:2.0:1788540901.066925:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980971520 00000100:00100000:2.0:1788540901.066937:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980971520 00000100:00100000:2.0:1788540901.067003:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788540901.067011:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001e5e76c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+11:6494:x1875420980971520:12345-0@lo:101: 00010000:00010000:2.0:1788540901.067027:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788540901.067044:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d490e8eb/0x2aac941e5f4a7273 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a726c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540901.067070:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d490e8eb/0x2aac941e5f4a7273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a726c expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540901.067114:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d490e8eb/0x2aac941e5f4a7273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a726c expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540901.067124:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d490e8eb, rc 0) 00000100:00100000:2.0:1788540901.067385:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001e5e76c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+12:6494:x1875420980971520:12345-0@lo:101: Request processed in 374us (2398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540901.067392:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788540901.070966:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d4b35252 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:6494:1875420980971520:0@lo:101: 00010000:00010000:0.0:1788540901.070994:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: 00000000e86a0444/0x2aac941e5f4a726c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7273 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540901.071004:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: 00000000e86a0444/0x2aac941e5f4a726c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a7273 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540901.071110:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d4b35252 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:6494:1875420980971648:0@lo:501: 00000100:00100000:0.0:1788540901.071710:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540901.071778:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980971648 00000100:00100000:1.0:1788540901.071785:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980971648 00000100:00100000:0.0:1788540901.071838:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e2123c72 going to sleep for 11 seconds 00000100:00100000:1.0:1788540901.071853:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788540901.071861:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c2d9759 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+12:6494:x1875420980971648:12345-0@lo:501: 00000100:00100000:1.0:1788540901.072785:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c2d9759 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+12:6494:x1875420980971648:12345-0@lo:501: Request processed in 923us (1074us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540901.072795:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788540901.072857:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d4b35252 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:6494:1875420980971648:0@lo:501: 00000100:00100000:0.0:1788540901.072925:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d4b35252 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:6494:1875420980971776:0@lo:503: 00000100:00100000:0.0:1788540901.072973:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540901.072999:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e2123c72 going to sleep for 11 seconds 00000100:00100000:2.0:1788540901.073057:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980971776 00000100:00100000:2.0:1788540901.073062:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980971776 00000100:00100000:2.0:1788540901.073096:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788540901.073103:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b99ca02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+12:6494:x1875420980971776:12345-0@lo:503: 00000100:00100000:2.0:1788540901.073195:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b99ca02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+12:6494:x1875420980971776:12345-0@lo:503: Request processed in 92us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540901.073202:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788540901.073371:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d4b35252 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:6494:1875420980971776:0@lo:503: 00000100:00100000:2.0:1788540901.075511:0:6544:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000075954f7e pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:6544:1875420980971904:0@lo:502: 00000100:00100000:2.0:1788540901.075591:0:6544:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540901.075629:0:6544:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bc2ddc25 going to sleep for 11 seconds 00000100:00100000:1.0:1788540901.075826:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980971904 00000100:00100000:1.0:1788540901.075837:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980971904 00000100:00100000:1.0:1788540901.076046:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788540901.076056:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b5ad0ad5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+12:6544:x1875420980971904:12345-0@lo:502: 00000100:00100000:1.0:1788540901.076195:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b5ad0ad5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+12:6544:x1875420980971904:12345-0@lo:502: Request processed in 140us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540901.076204:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788540901.076288:0:6544:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000075954f7e pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:6544:1875420980971904:0@lo:502: 00000020:01000004:3.0:1788540901.076371:0:6544:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788540901.076398:0:6544:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000002c7b197f) 00000020:00000080:3.0:1788540901.076418:0:6544:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1788540901.076529:0:6544:0:(tgt_mount.c:153:server_get_mount()) get mount 000000001929a2a5 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788540901.076533:0:6544:0:(tgt_mount.c:187:server_put_mount()) put mount 000000001929a2a5 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788540901.076536:0:6544:0:(obd_mount.c:710:lustre_put_lsi()) put 000000001929a2a5 4 00010000:00080000:3.0:1788540901.076563:0:6544:0:(ldlm_lib.c:102:import_set_conn()) imp 000000003b98627c@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.156@tcp at head 00010000:00010000:3.0:1788540901.078179:0:6544:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1788540901.078389:0:6544:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788540901.078425:0:6544:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788540901.078436:0:6544:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x2aac941e5f4a7281 00000100:00080000:3.0:1788540901.078455:0:6544:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788540901.078460:0:6544:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000003b98627c using connection 192.168.202.156@tcp/0@lo 00000100:00100000:3.0:1788540901.078490:0:6544:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d8d58496 x1875420980972032/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788540901.078524:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d8d58496 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875420980972032:0@lo:38: 00000100:00100000:3.0:1788540901.078592:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540901.078659:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980972032 00000100:00100000:3.0:1788540901.078666:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980972032 00000100:00100000:3.0:1788540901.078692:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788540901.078698:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000048c9578f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875420980972032:12345-0@lo:38: 00000100:00100000:3.0:1788540901.078742:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000048c9578f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875420980972032:12345-0@lo:38: Request processed in 43us (150us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788540901.078749:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788540901.078781:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788540901.078789:0:3640:0:(import.c:65:import_set_state_nolock()) 000000003b98627c lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788540901.078814:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788540901.078817:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d8d58496 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875420980972032:0@lo:38: 00000100:00080000:3.0:1788540901.078833:0:6544:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788540901.083228:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788540901.083238:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788540901.083240:0:38:0:(import.c:65:import_set_state_nolock()) 000000003b98627c lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788540901.083254:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000003b98627c using connection 192.168.202.156@tcp/0@lo 00000100:00100000:2.0:1788540901.083280:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000004793a62b x1875420980972288/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788540901.083451:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004793a62b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875420980972288:0@lo:38: 00000100:00100000:2.0:1788540901.083523:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540901.083604:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c26e6f97 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420980972160:0@lo:400: 00000100:00100000:0.0:1788540901.083640:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540901.083983:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980972160 00000100:00100000:2.0:1788540901.083992:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980972160 00000100:00100000:2.0:1788540901.084041:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788540901.084054:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007d5ffeaf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+12:3642:x1875420980972160:12345-0@lo:400: 00000100:00100000:3.0:1788540901.084190:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980972288 00000100:00100000:3.0:1788540901.084195:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980972288 00000100:00100000:3.0:1788540901.084218:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788540901.084222:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000ea89eb8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875420980972288:12345-0@lo:38: 00000100:00100000:2.0:1788540901.084459:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007d5ffeaf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+12:3642:x1875420980972160:12345-0@lo:400: Request processed in 410us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540901.084857:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c26e6f97 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420980972160:0@lo:400: 00000100:00100000:3.0:1788540901.085267:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000ea89eb8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875420980972288:12345-0@lo:38: Request processed in 1043us (1743us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788540901.085276:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788540901.085375:0:3640:0:(import.c:65:import_set_state_nolock()) 000000003b98627c lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788540901.085380:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788540901.085383:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004793a62b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875420980972288:0@lo:38: 00000100:00100000:3.0:1788540901.085405:0:6544:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d8d58496 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:6544:1875420980972416:0@lo:502: 00000100:00100000:3.0:1788540901.085459:0:6544:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540901.085491:0:6544:0:(client.c:2716:ptlrpc_set_wait()) set 000000009414f090 going to sleep for 11 seconds 00000100:00100000:0.0:1788540901.086346:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980972416 00000100:00100000:0.0:1788540901.086355:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980972416 00000100:00100000:0.0:1788540901.086402:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788540901.086409:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae56cc0f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+13:6544:x1875420980972416:12345-0@lo:502: 00000100:00100000:0.0:1788540901.086572:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae56cc0f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+13:6544:x1875420980972416:12345-0@lo:502: Request processed in 163us (1113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540901.086579:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788540901.086592:0:6544:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d8d58496 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:6544:1875420980972416:0@lo:502: 00000040:00080000:3.0:1788540901.086621:0:6544:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1788540901.086948:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1788540901.086969:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788540901.086984:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: 00000000e86a0444/0x2aac941e5f4a726c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7273 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540901.086994:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: 00000000e86a0444/0x2aac941e5f4a726c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7273 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788540901.087048:0:6494:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788540901.087050:0:6494:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788540901.087051:0:6494:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788540901.087052:0:6494:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788540901.087054:0:6494:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788540901.087055:0:6494:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788540901.087056:0:6494:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788540901.087057:0:6494:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788540901.087058:0:6494:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788540901.087060:0:6494:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788540901.087061:0:6494:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788540901.087062:0:6494:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788540901.087066:0:6494:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1788540901.087068:0:6494:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788540901.087069:0:6494:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788540901.087070:0:6494:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788540901.087071:0:6494:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788540901.087072:0:6494:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788540901.087073:0:6494:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788540901.087074:0:6494:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788540901.087074:0:6494:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788540901.087075:0:6494:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788540901.087079:0:6494:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788540901.087080:0:6494:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788540901.087081:0:6494:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788540901.087097:0:6494:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788540901.087107:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d4b35252 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:6494:1875420980972544:0@lo:253: 00000100:00100000:2.0:1788540901.087617:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788540901.088252:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540901.088621:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set 0000000006327561 going to sleep for 11 seconds 00000100:00100000:2.0:1788540901.089499:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980972544 00000100:00100000:2.0:1788540901.089508:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980972544 00000100:00100000:2.0:1788540901.089555:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788540901.089564:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009177a497 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+12:6494:x1875420980972544:12345-0@lo:253: 20000000:01000000:2.0:1788540901.089593:0:6512:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788540901.089607:0:6512:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788540901.097772:0:6512:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788540901.097790:0:6512:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788540901.098188:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009177a497 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+12:6494:x1875420980972544:12345-0@lo:253: Request processed in 8621us (11028us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540901.098202:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788540901.098489:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d4b35252 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:6494:1875420980972544:0@lo:253: 10000000:01000000:1.0:1788540901.098503:0:6494:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788540901.098505:0:6494:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788540901.098508:0:6494:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788540901.098509:0:6494:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788540901.098511:0:6494:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788540901.098512:0:6494:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788540901.098514:0:6494:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788540901.098515:0:6494:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788540901.098517:0:6494:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788540901.098518:0:6494:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788540901.098520:0:6494:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788540901.098521:0:6494:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788540901.098522:0:6494:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788540901.098540:0:6494:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1788540901.101101:0:6533:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788540901.101110:0:6533:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788540901.101147:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000eefe640f/0x2aac941e5f4a7288 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540901.101166:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e8dce746/0x2aac941e5f4a7257 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a7250 expref: 11 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540901.101174:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000eefe640f/0x2aac941e5f4a7288 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540901.101212:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e8dce746/0x2aac941e5f4a7257 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a7250 expref: 11 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540901.101228:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e8dce746/0x2aac941e5f4a7257 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a7250 expref: 11 pid: 6511 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540901.101241:0:6533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d8d58496 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1875420980972672:0@lo:104: 00000100:00100000:3.0:1788540901.101526:0:6533:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540901.101581:0:6533:0:(client.c:2716:ptlrpc_set_wait()) set 0000000088742089 going to sleep for 11 seconds 00000100:00100000:0.0:1788540901.103539:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980972672 00000100:00100000:0.0:1788540901.103551:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980972672 00000100:00100000:0.0:1788540901.103607:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788540901.103616:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008c2a0446 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:425687b6-1d99-41d2-88d8-2fb230997596+3:6533:x1875420980972672:12345-0@lo:104: 00010000:00010000:0.0:1788540901.103633:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: 00000000e18abe71/0x2aac941e5f4a7250 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a7257 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540901.103721:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788540901.103726:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008c2a0446 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:425687b6-1d99-41d2-88d8-2fb230997596+3:6533:x1875420980972672:12345-0@lo:104: Request processed in 112us (2202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540901.103734:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788540901.103754:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788540901.103758:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: 00000000e18abe71/0x2aac941e5f4a7250 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a7257 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540901.103766:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e18abe71 already unused, calling callback (00000000e5ff5456) 10000000:00010000:0.0:1788540901.103770:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: 00000000e18abe71/0x2aac941e5f4a7250 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a7257 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540901.103777:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: 00000000e18abe71/0x2aac941e5f4a7250 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a7257 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788540901.103784:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: 00000000e18abe71/0x2aac941e5f4a7250 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a7257 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788540901.103802:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788540901.103835:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: 00000000e18abe71/0x2aac941e5f4a7250 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7257 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540901.103842:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788540901.103865:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: 00000000e18abe71/0x2aac941e5f4a7250 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7257 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540901.103887:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: 00000000e18abe71/0x2aac941e5f4a7250 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7257 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540901.103904:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788540901.103906:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788540901.103908:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788540901.103940:0:6533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d8d58496 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1875420980972672:0@lo:104: 00010000:00010000:0.0:1788540901.103960:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000eefe640f/0x2aac941e5f4a7288 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540901.104984:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ae1700f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420980972800:0@lo:103: 00000100:00100000:0.0:1788540901.105032:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540901.106202:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980972800 00000100:00100000:3.0:1788540901.106212:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980972800 00010000:00010000:3.0:1788540901.106244:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e8dce746/0x2aac941e5f4a7257 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a7250 expref: 12 pid: 6511 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540901.106288:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788540901.106297:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005465a723 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+12:3643:x1875420980972800:12345-0@lo:103: 00010000:00010000:3.0:1788540901.106318:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788540901.106323:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e8dce746/0x2aac941e5f4a7257 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a7250 expref: 12 pid: 6511 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540901.106334:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e8dce746/0x2aac941e5f4a7257 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a7250 expref: 12 pid: 6511 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540901.106504:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e8dce746/0x2aac941e5f4a7257 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a7250 expref: 12 pid: 6511 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540901.106522:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000eefe640f/0x2aac941e5f4a7288 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540901.106529:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000eefe640f/0x2aac941e5f4a7288 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788540901.106544:0:6502:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005435104s 00010000:00010000:3.0:1788540901.106548:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000eefe640f/0x2aac941e5f4a7288 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540901.106555:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000eefe640f/0x2aac941e5f4a7288 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540901.106561:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000eefe640f/0x2aac941e5f4a7288 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540901.106567:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000eefe640f/0x2aac941e5f4a7288 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540901.106573:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000eefe640f already unused, calling callback (00000000b72a7d0e) 00010000:00010000:3.0:1788540901.106576:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000eefe640f/0x2aac941e5f4a7288 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540901.106584:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000eefe640f/0x2aac941e5f4a7288 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540901.106605:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000eefe640f/0x2aac941e5f4a7288 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540901.106632:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788540901.106691:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005465a723 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+11:3643:x1875420980972800:12345-0@lo:103: Request processed in 396us (1659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540901.106699:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788540901.106839:0:6533:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000eefe640f/0x2aac941e5f4a7288 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540901.106848:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000eefe640f/0x2aac941e5f4a7288 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540901.106853:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000eefe640f/0x2aac941e5f4a7288 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540901.107187:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ae1700f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420980972800:0@lo:103: 00080000:10000000:1.0:1788540901.114588:0:6494:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:1.0:1788540901.114788:0:6494:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1788540901.116555:0:6494:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:1.0:1788540901.116744:0:6494:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1788540901.117413:0:6494:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:1.0:1788540901.117600:0:6494:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1788540901.118781:0:6494:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:0.0:1788540901.118981:0:6494:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1788540901.119170:0:6494:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:0.0:1788540901.119644:0:6494:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1788540901.119903:0:6494:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:0.0:1788540901.120720:0:6494:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:0.0:1788540901.130249:0:6494:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1788540901.151713:0:6494:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788540901.151725:0:6549:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1788540901.151729:0:6549:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1788540901.153800:0:6550:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788540901.155332:0:6494:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788540901.155455:0:6494:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788540901.155976:0:6494:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788540901.155984:0:6494:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788540901.156084:0:6494:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788540901.157050:0:6494:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788540901.162695:0:6494:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788540901.162803:0:6494:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788540901.165061:0:6494:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788540901.165531:0:6494:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:0.0:1788540901.166246:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788540901.166490:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788540901.166641:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00000040:00080000:2.0:1788540901.166847:0:6550:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:0.0:1788540901.168692:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1788540901.171846:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788540901.172020:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788540901.172212:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788540901.172586:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1788540901.172702:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1788540901.172809:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1788540901.173038:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1788540901.173274:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00000040:00080000:2.0:1788540901.173467:0:6550:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788540901.173539:0:6550:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788540901.173544:0:6550:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:0.0:1788540901.173693:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1788540901.173827:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788540901.174038:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788540901.174484:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1788540901.174684:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1788540901.174780:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1788540901.174861:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788540901.175005:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788540901.175114:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788540901.175239:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1788540901.175422:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1788540901.175695:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1788540901.175786:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1788540901.175944:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1788540901.176043:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1788540901.176183:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1788540901.176345:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1788540901.176499:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1788540901.176582:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1788540901.176663:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1788540901.176798:0:6494:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:0.0:1788540901.178781:0:6494:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788540901.178812:0:6494:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb5cdc1c63988 00100000:10000000:0.0:1788540901.178823:0:6494:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788540901.179397:0:6494:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788540901.179412:0:6494:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.156@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788540901.179431:0:6494:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788540901.179452:0:6494:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1788540901.180341:0:6494:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788540901.180510:0:6494:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1788540901.835056:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788540902.859340:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788540903.883113:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788540904.906320:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788540905.930611:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788540906.444128:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788540906.444138:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788540906.444141:0:36:0:(import.c:65:import_set_state_nolock()) 000000003b98627c lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788540906.444154:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000003b98627c using connection 192.168.202.156@tcp/0@lo 00000100:00100000:1.0:1788540906.444175:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000004740012b x1875420980973056/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788540906.444212:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000c857579 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:425687b6-1d99-41d2-88d8-2fb230997596:3644:1875420980972928:0@lo:400: 00000100:00100000:1.0:1788540906.444284:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540906.445958:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004740012b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875420980973056:0@lo:38: 00000100:00100000:2.0:1788540906.446025:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540906.446162:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980972928 00000100:00100000:1.0:1788540906.446170:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980972928 00000100:00100000:1.0:1788540906.446218:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788540906.446227:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000610dd484 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+11:3644:x1875420980972928:12345-0@lo:400: 00000100:00100000:1.0:1788540906.446280:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000610dd484 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+11:3644:x1875420980972928:12345-0@lo:400: Request processed in 54us (1996us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540906.446286:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788540906.446468:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000c857579 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:425687b6-1d99-41d2-88d8-2fb230997596:3644:1875420980972928:0@lo:400: 00000100:00100000:3.0:1788540906.446811:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980973056 00000100:00100000:3.0:1788540906.446817:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980973056 00000100:00100000:3.0:1788540906.446851:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788540906.446856:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ea9aa481 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875420980973056:12345-0@lo:38: 00010000:00080000:3.0:1788540906.446899:0:6518:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 187 last 0 00000020:00000080:3.0:1788540906.446933:0:6518:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x2aac941e5f4a728f 00000004:00100000:3.0:1788540906.446979:0:6518:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788540906.447094:0:6518:0:(import.c:65:import_set_state_nolock()) 00000000e3996e75 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788540906.447141:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ea9aa481 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875420980973056:12345-0@lo:38: Request processed in 284us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540906.447148:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788540906.447501:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000004740012b x1875420980973056/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788540916 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788540906.447514:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788540906.447520:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788540906.447524:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788540906.447526:0:3640:0:(import.c:65:import_set_state_nolock()) 000000003b98627c lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788540906.447530:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004740012b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875420980973056:0@lo:38: 00000001:02000400:3.0:1788540906.881438:0:6795:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg256-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788540906.964811:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788540907.934321:0:6847:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788540907.934535:0:6847:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1788540907.980169:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788540907.980178:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a68112dc000 from 3 10000000:01000000:1.0:1788540907.980184:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788540907.980243:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: 00000000ed98f274/0x2aac941e5f4a7296 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540907.980273:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: 00000000ed98f274/0x2aac941e5f4a7296 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540907.980284:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: 00000000ed98f274/0x2aac941e5f4a7296 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540907.980309:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000c857579 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980973184:0@lo:101: 00000100:00100000:1.0:1788540907.980392:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540907.980449:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e3b19771 going to sleep for 11 seconds 00000100:00100000:0.0:1788540907.980559:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980973184 00000100:00100000:0.0:1788540907.980567:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980973184 00000100:00100000:0.0:1788540907.980624:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788540907.980633:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad258eb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+11:6514:x1875420980973184:12345-0@lo:101: 00010000:00010000:0.0:1788540907.980645:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788540907.980658:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000044589fb0/0x2aac941e5f4a729d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a7296 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540907.980692:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000044589fb0/0x2aac941e5f4a729d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a7296 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540907.980703:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000044589fb0/0x2aac941e5f4a729d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a7296 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540907.980711:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000044589fb0, rc 0) 00000100:00100000:0.0:1788540907.980762:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad258eb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+12:6514:x1875420980973184:12345-0@lo:101: Request processed in 131us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540907.980768:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788540907.980851:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000c857579 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980973184:0@lo:101: 00010000:00010000:3.0:1788540907.980865:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: 00000000ed98f274/0x2aac941e5f4a7296 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a729d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540907.980918:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: 00000000ed98f274/0x2aac941e5f4a7296 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a729d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540907.980965:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004dc04bdc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980973312:0@lo:256: 00000100:00100000:3.0:1788540907.980997:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540907.981022:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set 000000007c827901 going to sleep for 11 seconds 00000100:00100000:0.0:1788540907.981135:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980973312 00000100:00100000:0.0:1788540907.981139:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980973312 00000100:00100000:0.0:1788540907.981175:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788540907.981182:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000743cb3b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+12:6514:x1875420980973312:12345-0@lo:256: 20000000:01000000:0.0:1788540907.981213:0:6511:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788540907.981228:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788540907.981231:0:6511:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1788540907.981301:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000743cb3b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+12:6514:x1875420980973312:12345-0@lo:256: Request processed in 120us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540907.981308:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788540907.981430:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004dc04bdc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980973312:0@lo:256: 10000000:01000000:3.0:1788540907.981471:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788540907.981477:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: 00000000ed98f274/0x2aac941e5f4a7296 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a729d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540907.981484:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: 00000000ed98f274/0x2aac941e5f4a7296 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a729d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540907.987086:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788540909.005403:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788540910.026164:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788540910.907746:0:6949:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788540910.907956:0:6949:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788540911.052334:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788540911.562441:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000040162b7d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420980973440:0@lo:400: 00000100:00100000:1.0:1788540911.562533:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540911.562708:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000080d113ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875420980973568:0@lo:400: 00000100:00100000:0.0:1788540911.562741:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540911.563086:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980973568 00000100:00100000:0.0:1788540911.563094:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980973568 00000100:00100000:0.0:1788540911.563140:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788540911.563148:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e24df310 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875420980973568:12345-0@lo:400: 00000100:00100000:2.0:1788540911.563213:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980973440 00000100:00100000:2.0:1788540911.563217:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980973440 00000100:00100000:2.0:1788540911.563252:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788540911.563258:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005f47e2c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+12:3641:x1875420980973440:12345-0@lo:400: 00000100:00100000:0.0:1788540911.567213:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e24df310 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875420980973568:12345-0@lo:400: Request processed in 4058us (4464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540911.567228:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788540911.567437:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000080d113ae x1875420980973568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540911.567452:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000080d113ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875420980973568:0@lo:400: 00000100:00100000:0.0:1788540911.575544:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005f47e2c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+12:3641:x1875420980973440:12345-0@lo:400: Request processed in 12276us (13001us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540911.575562:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788540911.582379:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000040162b7d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420980973440:0@lo:400: 00010000:00010000:2.0:1788540912.076198:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788540913.107394:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788540914.123623:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788540915.149111:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788540916.173619:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788540916.684691:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000030307e8f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875420980973824:0@lo:400: 00000100:00100000:0.0:1788540916.684769:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540916.684840:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788540916.684855:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007b6d98b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:425687b6-1d99-41d2-88d8-2fb230997596:3644:1875420980973696:0@lo:400: 00000100:00100000:0.0:1788540916.684908:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540916.684956:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980973696 00000100:00100000:0.0:1788540916.684964:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980973696 00000100:00100000:0.0:1788540916.685012:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788540916.685020:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000675ffd7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+12:3644:x1875420980973696:12345-0@lo:400: 00000100:00100000:0.0:1788540916.685066:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000675ffd7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+12:3644:x1875420980973696:12345-0@lo:400: Request processed in 47us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540916.685073:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788540916.685115:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007b6d98b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:425687b6-1d99-41d2-88d8-2fb230997596:3644:1875420980973696:0@lo:400: 00000100:00100000:2.0:1788540916.685348:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980973824 00000100:00100000:2.0:1788540916.685353:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980973824 00000100:00100000:2.0:1788540916.685388:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788540916.685395:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c87d3745 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875420980973824:12345-0@lo:400: 00000100:00100000:2.0:1788540916.685438:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c87d3745 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875420980973824:12345-0@lo:400: Request processed in 43us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540916.685444:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788540916.685472:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000030307e8f x1875420980973824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788540916.685484:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000030307e8f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875420980973824:0@lo:400: 00010000:00010000:1.0:1788540917.199072:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788540918.220117:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540919.242547:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788540920.269417:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788540921.295911:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788540921.464767:0:7447:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788540921.464772:0:7447:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788540921.464773:0:7447:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788540921.464940:0:7447:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000006363c53d 00000020:01000004:2.0:1788540921.465015:0:7447:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:2.0:1788540921.465027:0:7447:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788540921.465040:0:7447:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000a4c0eef3) 00000020:00000080:2.0:1788540921.465053:0:7447:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788540921.523381:0:7447:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:2.0:1788540921.523465:0:7447:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:3.0:1788540921.541423:0:7447:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788540921.541642:0:7447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1788540921.541653:0:7447:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788540921.541666:0:7447:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2aac941e5f4a72ab 00000020:01000004:3.0:1788540921.541672:0:7447:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788540921.541691:0:7447:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.156@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788540921.541695:0:7447:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.156@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788540921.541700:0:7447:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1788540921.541731:0:7447:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1788540921.541735:0:7447:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.156@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1788540921.562224:0:7447:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.156@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788540921.562299:0:7447:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.156@tcp, index=0001, flags=0x20061 00000020:01000004:3.0:1788540921.562303:0:7447:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788540921.562304:0:7447:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788540921.562305:0:7447:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788540921.562306:0:7447:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788540921.562308:0:7447:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788540921.562309:0:7447:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788540921.562310:0:7447:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788540921.562311:0:7447:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788540921.562312:0:7447:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788540921.562313:0:7447:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788540921.562314:0:7447:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788540921.562318:0:7447:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:3.0:1788540921.562320:0:7447:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788540921.562321:0:7447:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788540921.562322:0:7447:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788540921.562323:0:7447:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788540921.562324:0:7447:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788540921.562325:0:7447:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788540921.562326:0:7447:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788540921.562327:0:7447:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788540921.562328:0:7447:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788540921.562329:0:7447:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788540921.562330:0:7447:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788540921.562358:0:7447:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788540921.562376:0:7447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004dc04bdc pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:7447:1875420980973952:0@lo:253: 00000100:00100000:3.0:1788540921.562455:0:7447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540921.562545:0:7447:0:(client.c:2716:ptlrpc_set_wait()) set 0000000071e71ccb going to sleep for 11 seconds 00000100:00100000:0.0:1788540921.562592:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980973952 00000100:00100000:0.0:1788540921.562600:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980973952 00000100:00100000:0.0:1788540921.562703:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788540921.562712:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003d402e4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+12:7447:x1875420980973952:12345-0@lo:253: 20000000:01000000:0.0:1788540921.562743:0:6511:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788540921.562748:0:6511:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:0.0:1788540921.562753:0:6511:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:0.0:1788540921.562756:0:6511:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:0.0:1788540921.562788:0:6511:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:0.0:1788540921.563270:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788540921.563396:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1788540921.563408:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788540921.563426:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1788540921.563443:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1788540921.563458:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1788540921.563510:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:0.0:1788540921.563518:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:0.0:1788540921.563532:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:0.0:1788540921.563537:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:0.0:1788540921.563549:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:0.0:1788540921.563553:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:0.0:1788540921.563575:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1788540921.563589:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1788540921.563687:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:0.0:1788540921.563697:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.156@tcp (null) (null) (null) 00000040:00080000:0.0:1788540921.563707:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:0.0:1788540921.563712:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788540921.563723:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:0.0:1788540921.563727:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.202.156@tcp (null) (null) 00000040:00080000:0.0:1788540921.563738:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:0.0:1788540921.563743:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1788540921.563754:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1788540921.563767:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1788540921.563776:0:6511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1788540921.563859:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:0.0:1788540921.563868:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:0.0:1788540921.564448:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1788540921.564470:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1788540921.564486:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:0.0:1788540921.564493:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:0.0:1788540921.564506:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1788540921.564529:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1788540921.564535:0:6511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:0.0:1788540921.564559:0:6511:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1788540921.564566:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:3.0:1788540921.565241:0:7453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1788540921.565469:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1788540921.565490:0:6511:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.156@tcp for mdt 20000000:01000000:0.0:1788540921.565492:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.156@tcp (null) (null) (null) 00000040:00080000:0.0:1788540921.565507:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1788540921.565513:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788540921.565524:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1788540921.565541:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.202.156@tcp (null) (null) 00000040:00080000:0.0:1788540921.565559:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1788540921.565566:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:0.0:1788540921.565577:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:0.0:1788540921.565590:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:0.0:1788540921.565631:0:6511:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:0.0:1788540921.565639:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:1.0:1788540921.566214:0:7454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:0.0:1788540921.566396:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1788540921.566408:0:6511:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.202.156@tcp for mdt 20000000:01000000:0.0:1788540921.566409:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.156@tcp (null) (null) (null) 00000040:00080000:0.0:1788540921.566417:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1788540921.566420:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788540921.566426:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1788540921.566429:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.202.156@tcp (null) (null) 00000040:00080000:0.0:1788540921.566436:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1788540921.566440:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:0.0:1788540921.566450:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1788540921.566464:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:0.0:1788540921.566481:0:6511:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788540921.566484:0:6511:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788540921.566488:0:6511:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788540921.566528:0:6511:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788540921.566529:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788540921.566712:0:7455:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1788540921.566724:0:7455:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1788540921.566732:0:7455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1788540921.566815:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:2.0:1788540921.566845:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:2.0:1788540921.566859:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:2.0:1788540921.567108:0:6511:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788540921.567110:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788540921.567511:0:7456:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1788540921.567526:0:7456:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1788540921.567533:0:7456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:0.0:1788540921.567614:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1788540921.567632:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1788540921.567647:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:0.0:1788540921.567655:0:6511:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788540921.567657:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788540921.568036:0:7457:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1788540921.568052:0:7457:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1788540921.568066:0:7457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1788540921.568251:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1788540921.568283:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1788540921.568305:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1788540921.568318:0:6511:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788540921.568321:0:6511:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788540921.568325:0:6511:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1788540921.568331:0:6511:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1788540921.568572:0:7458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:1.0:1788540921.568674:0:6511:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788540921.577318:0:6511:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788540921.577444:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000af111ead/0x2aac941e5f4a72b2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540921.577467:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000881bde30/0x2aac941e5f4a71e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a71e0 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540921.577473:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000994bcdd1/0x2aac941e5f4a7203 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a71fc expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540921.577479:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d490e8eb/0x2aac941e5f4a7273 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a726c expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540921.577486:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000af111ead/0x2aac941e5f4a72b2 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540921.577532:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d490e8eb/0x2aac941e5f4a7273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a726c expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540921.577548:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d490e8eb/0x2aac941e5f4a7273 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a726c expref: 12 pid: 6509 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540921.577562:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f3610d16 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6511:1875420980974080:0@lo:104: 00000100:00100000:0.0:1788540921.577642:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788540921.577742:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000994bcdd1/0x2aac941e5f4a7203 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a71fc expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540921.577751:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000994bcdd1/0x2aac941e5f4a7203 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a71fc expref: 12 pid: 6512 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540921.577760:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006dd6ad65 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6511:1875420980974208:0@lo:104: 00000100:00100000:0.0:1788540921.577782:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788540921.578344:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000881bde30/0x2aac941e5f4a71e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a71e0 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540921.578354:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000881bde30/0x2aac941e5f4a71e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a71e0 expref: 12 pid: 6511 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540921.578362:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002a47c1ec pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6511:1875420980974336:0@lo:104: 00000100:00100000:0.0:1788540921.578386:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540921.578477:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980974080 00000100:00100000:3.0:1788540921.578491:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980974080 00000100:00100000:3.0:1788540921.578527:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980974208 00000100:00100000:3.0:1788540921.578530:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980974208 00000100:00100000:3.0:1788540921.578544:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788540921.578551:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006927903a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+4:6511:x1875420980974080:12345-0@lo:104: 00010000:00010000:3.0:1788540921.578562:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: 00000000e86a0444/0x2aac941e5f4a726c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a7273 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540921.578618:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788540921.578623:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006927903a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+4:6511:x1875420980974080:12345-0@lo:104: Request processed in 73us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540921.578630:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788540921.578648:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788540921.578653:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000079e2caf2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+3:6511:x1875420980974208:12345-0@lo:104: 00010000:00010000:3.0:1788540921.578659:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: 00000000f889216a/0x2aac941e5f4a71fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a7203 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540921.578690:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788540921.578694:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000079e2caf2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+3:6511:x1875420980974208:12345-0@lo:104: Request processed in 42us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540921.578700:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788540921.578714:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788540921.578719:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: 00000000e86a0444/0x2aac941e5f4a726c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a7273 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540921.578726:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e86a0444 already unused, calling callback (00000000e5ff5456) 10000000:00010000:3.0:1788540921.578729:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: 00000000e86a0444/0x2aac941e5f4a726c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a7273 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540921.578746:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: 00000000e86a0444/0x2aac941e5f4a726c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a7273 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788540921.578752:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: 00000000e86a0444/0x2aac941e5f4a726c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a7273 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788540921.578757:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788540921.578787:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: 00000000e86a0444/0x2aac941e5f4a726c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7273 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540921.578794:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788540921.578820:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: 00000000e86a0444/0x2aac941e5f4a726c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7273 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540921.578827:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: 00000000e86a0444/0x2aac941e5f4a726c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7273 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540921.578839:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788540921.578841:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: 00000000f889216a/0x2aac941e5f4a71fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a7203 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540921.578846:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f889216a already unused, calling callback (00000000e5ff5456) 10000000:00010000:3.0:1788540921.578848:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: 00000000f889216a/0x2aac941e5f4a71fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a7203 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540921.578853:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: 00000000f889216a/0x2aac941e5f4a71fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a7203 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788540921.578859:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: 00000000f889216a/0x2aac941e5f4a71fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a7203 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788540921.578887:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788540921.578901:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: 00000000f889216a/0x2aac941e5f4a71fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7203 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540921.578907:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788540921.578911:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: 00000000f889216a/0x2aac941e5f4a71fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7203 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540921.578916:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: 00000000f889216a/0x2aac941e5f4a71fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7203 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540921.578924:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540921.578925:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788540921.578926:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788540921.578927:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788540921.579245:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ab6c2cb7 going to sleep for 11 seconds 00000100:00100000:0.0:1788540921.579279:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f3610d16 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6511:1875420980974080:0@lo:104: 00000100:00100000:0.0:1788540921.579288:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006dd6ad65 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6511:1875420980974208:0@lo:104: 00000100:00100000:1.0:1788540921.579337:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980974336 00000100:00100000:1.0:1788540921.579342:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980974336 00000100:00100000:1.0:1788540921.579369:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788540921.579375:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000123661bc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:425687b6-1d99-41d2-88d8-2fb230997596+3:6511:x1875420980974336:12345-0@lo:104: 00010000:00010000:1.0:1788540921.579383:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: 00000000c82a60fc/0x2aac941e5f4a71e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a71e7 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.579445:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788540921.579450:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000123661bc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:425687b6-1d99-41d2-88d8-2fb230997596+3:6511:x1875420980974336:12345-0@lo:104: Request processed in 76us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540921.579457:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788540921.579467:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788540921.579471:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: 00000000c82a60fc/0x2aac941e5f4a71e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a71e7 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540921.579477:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c82a60fc already unused, calling callback (00000000e5ff5456) 00000100:00100000:1.0:1788540921.579479:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ca167a1d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420980974464:0@lo:103: 10000000:00010000:2.0:1788540921.579480:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: 00000000c82a60fc/0x2aac941e5f4a71e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a71e7 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540921.579486:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: 00000000c82a60fc/0x2aac941e5f4a71e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a71e7 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788540921.579491:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: 00000000c82a60fc/0x2aac941e5f4a71e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a71e7 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788540921.579496:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1788540921.579507:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788540921.579514:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: 00000000c82a60fc/0x2aac941e5f4a71e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a71e7 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540921.579520:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788540921.579527:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1788540921.579532:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: 00000000c82a60fc/0x2aac941e5f4a71e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a71e7 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540921.579532:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f48e01b6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420980974592:0@lo:103: 00010000:00010000:2.0:1788540921.579538:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: 00000000c82a60fc/0x2aac941e5f4a71e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a71e7 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540921.579550:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788540921.579561:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540921.579562:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540921.579564:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788540921.579569:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788540921.579577:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000030307e8f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:425687b6-1d99-41d2-88d8-2fb230997596:3644:1875420980974720:0@lo:103: 00000100:00100000:1.0:1788540921.579579:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980974464 00000100:00100000:1.0:1788540921.579582:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980974464 00010000:00010000:1.0:1788540921.579596:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d490e8eb/0x2aac941e5f4a7273 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a726c expref: 13 pid: 6509 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540921.579602:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540921.579699:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980974592 00000100:00100000:1.0:1788540921.579703:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980974592 00010000:00010000:1.0:1788540921.579715:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000994bcdd1/0x2aac941e5f4a7203 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a71fc expref: 14 pid: 6512 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540921.579726:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980974720 00000100:00100000:1.0:1788540921.579728:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980974720 00010000:00010000:1.0:1788540921.579736:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000881bde30/0x2aac941e5f4a71e7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a71e0 expref: 15 pid: 6511 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540921.579746:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788540921.579751:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000019095b8d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:425687b6-1d99-41d2-88d8-2fb230997596+15:3641:x1875420980974464:12345-0@lo:103: 00010000:00010000:1.0:1788540921.579760:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788540921.579764:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d490e8eb/0x2aac941e5f4a7273 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a726c expref: 15 pid: 6509 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.579780:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d490e8eb/0x2aac941e5f4a7273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a726c expref: 15 pid: 6509 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.579792:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d490e8eb/0x2aac941e5f4a7273 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a726c expref: 15 pid: 6509 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.579816:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788540921.579856:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000019095b8d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:425687b6-1d99-41d2-88d8-2fb230997596+14:3641:x1875420980974464:12345-0@lo:103: Request processed in 104us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540921.579862:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788540921.579917:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ca167a1d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420980974464:0@lo:103: 00000100:00100000:1.0:1788540921.580180:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788540921.580188:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b367e4c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:425687b6-1d99-41d2-88d8-2fb230997596+13:3641:x1875420980974592:12345-0@lo:103: 00010000:00010000:1.0:1788540921.580196:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788540921.580200:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000994bcdd1/0x2aac941e5f4a7203 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a71fc expref: 13 pid: 6512 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.580208:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000994bcdd1/0x2aac941e5f4a7203 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a71fc expref: 13 pid: 6512 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.580217:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000994bcdd1/0x2aac941e5f4a7203 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a71fc expref: 13 pid: 6512 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.580227:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788540921.580303:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b367e4c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:425687b6-1d99-41d2-88d8-2fb230997596+12:3641:x1875420980974592:12345-0@lo:103: Request processed in 116us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540921.580309:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788540921.580321:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788540921.580326:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e07d237 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:425687b6-1d99-41d2-88d8-2fb230997596+11:3644:x1875420980974720:12345-0@lo:103: 00010000:00010000:1.0:1788540921.580339:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788540921.580342:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000881bde30/0x2aac941e5f4a71e7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a71e0 expref: 11 pid: 6511 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.580350:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000881bde30/0x2aac941e5f4a71e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a71e0 expref: 11 pid: 6511 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.580360:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000af111ead/0x2aac941e5f4a72b2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.580367:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000af111ead/0x2aac941e5f4a72b2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.580378:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000af111ead/0x2aac941e5f4a72b2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.580385:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000af111ead/0x2aac941e5f4a72b2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.580390:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000af111ead/0x2aac941e5f4a72b2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.580395:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000af111ead/0x2aac941e5f4a72b2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.580400:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000af111ead already unused, calling callback (00000000b72a7d0e) 00010000:00010000:1.0:1788540921.580403:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000af111ead/0x2aac941e5f4a72b2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.580410:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000af111ead/0x2aac941e5f4a72b2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.580429:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000af111ead/0x2aac941e5f4a72b2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.580439:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788540921.580471:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e07d237 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:425687b6-1d99-41d2-88d8-2fb230997596+11:3644:x1875420980974720:12345-0@lo:103: Request processed in 146us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540921.580478:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788540921.580533:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000030307e8f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:425687b6-1d99-41d2-88d8-2fb230997596:3644:1875420980974720:0@lo:103: 00000100:00100000:3.0:1788540921.580554:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f48e01b6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420980974592:0@lo:103: 00010000:00010000:0.0:1788540921.580642:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000881bde30/0x2aac941e5f4a71e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a71e0 expref: 10 pid: 6511 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540921.580652:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002a47c1ec pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6511:1875420980974336:0@lo:104: 00010000:00010000:0.0:1788540921.580671:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000af111ead/0x2aac941e5f4a72b2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540921.580679:0:6511:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000af111ead/0x2aac941e5f4a72b2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540921.580695:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000af111ead/0x2aac941e5f4a72b2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540921.580700:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000af111ead/0x2aac941e5f4a72b2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788540921.580714:0:6511:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788540921.582741:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003d402e4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+9:7447:x1875420980973952:12345-0@lo:253: Request processed in 20023us (20279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540921.582753:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788540921.583304:0:7447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004dc04bdc pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:7447:1875420980973952:0@lo:253: 10000000:01000000:3.0:1788540921.583320:0:7447:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788540921.583323:0:7447:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788540921.583325:0:7447:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788540921.583326:0:7447:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788540921.583327:0:7447:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:3.0:1788540921.583328:0:7447:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788540921.583329:0:7447:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788540921.583331:0:7447:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788540921.583332:0:7447:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788540921.583333:0:7447:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788540921.583335:0:7447:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788540921.583355:0:7447:0:(tgt_mount.c:101:server_register_mount()) register mount 000000006363c53d from lustre-MDT0001 10000000:01000000:3.0:1788540921.583383:0:7447:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1788540921.583386:0:7447:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788540921.583393:0:7447:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a682e74b380 local copy 10000000:01000000:3.0:1788540921.583405:0:7447:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788540921.583439:0:7447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: 00000000eefe640f/0x2aac941e5f4a72b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540921.583449:0:7447:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.156@tcp lock: 00000000eefe640f/0x2aac941e5f4a72b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540921.583457:0:7447:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: 00000000eefe640f/0x2aac941e5f4a72b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540921.583474:0:7447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004dc04bdc pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:7447:1875420980974848:0@lo:101: 00000100:00100000:3.0:1788540921.583513:0:7447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540921.583596:0:7447:0:(client.c:2716:ptlrpc_set_wait()) set 000000008e998bec going to sleep for 11 seconds 00000100:00100000:0.0:1788540921.583632:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980974848 00000100:00100000:0.0:1788540921.583639:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980974848 00000100:00100000:0.0:1788540921.583712:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788540921.583720:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b314da8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+9:7447:x1875420980974848:12345-0@lo:101: 00010000:00010000:0.0:1788540921.583733:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788540921.583745:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000041d1e526/0x2aac941e5f4a72c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a72b9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540921.583768:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000041d1e526/0x2aac941e5f4a72c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a72b9 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540921.583777:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000041d1e526/0x2aac941e5f4a72c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a72b9 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540921.583786:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000041d1e526, rc 0) 00000100:00100000:0.0:1788540921.583833:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b314da8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+10:7447:x1875420980974848:12345-0@lo:101: Request processed in 115us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540921.583839:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788540921.583941:0:7447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004dc04bdc pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:7447:1875420980974848:0@lo:101: 00010000:00010000:3.0:1788540921.583961:0:7447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: 00000000eefe640f/0x2aac941e5f4a72b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x2aac941e5f4a72c0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540921.583970:0:7447:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: 00000000eefe640f/0x2aac941e5f4a72b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2aac941e5f4a72c0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540921.584057:0:7447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004dc04bdc pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:7447:1875420980974976:0@lo:501: 00000100:00100000:3.0:1788540921.584094:0:7447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540921.584625:0:7447:0:(client.c:2716:ptlrpc_set_wait()) set 000000008e998bec going to sleep for 11 seconds 00000100:00100000:1.0:1788540921.584669:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980974976 00000100:00100000:1.0:1788540921.584674:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980974976 00000100:00100000:1.0:1788540921.584705:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788540921.584712:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005fe4aa25 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+10:7447:x1875420980974976:12345-0@lo:501: 00000100:00100000:1.0:1788540921.584787:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005fe4aa25 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+10:7447:x1875420980974976:12345-0@lo:501: Request processed in 76us (693us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788540921.584794:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788540921.585021:0:7447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004dc04bdc pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:7447:1875420980974976:0@lo:501: 10000000:01000000:3.0:1788540921.585036:0:7447:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.156@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788540921.585055:0:7447:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.156@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788540921.585060:0:7447:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: 00000000eefe640f/0x2aac941e5f4a72b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2aac941e5f4a72c0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540921.585079:0:7447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: 00000000eefe640f/0x2aac941e5f4a72b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2aac941e5f4a72c0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540921.585144:0:7447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.156@tcp lock: 00000000eefe640f/0x2aac941e5f4a72b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2aac941e5f4a72c0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540921.585169:0:7447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788540921.585188:0:7447:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a6839117000 10000000:01000000:3.0:1788540921.585193:0:7447:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788540921.585197:0:7447:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9a682e74b380 10000000:01000000:3.0:1788540921.585200:0:7447:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788540921.585203:0:7447:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9a682e74b380 from 1 10000000:01000000:3.0:1788540921.585205:0:7447:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788540921.585222:0:7447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: 00000000c0e8a525/0x2aac941e5f4a72c7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540921.585228:0:7447:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: 00000000c0e8a525/0x2aac941e5f4a72c7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540921.585235:0:7447:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: 00000000c0e8a525/0x2aac941e5f4a72c7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540921.585247:0:7447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004dc04bdc pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:7447:1875420980975104:0@lo:101: 00000100:00100000:3.0:1788540921.585285:0:7447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540921.585306:0:7447:0:(client.c:2716:ptlrpc_set_wait()) set 0000000005dc099c going to sleep for 11 seconds 00010000:00010000:1.0:1788540921.585344:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788540921.585349:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: 00000000eefe640f/0x2aac941e5f4a72b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x2aac941e5f4a72c0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.585356:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000eefe640f already unused, calling callback (00000000e5ff5456) 10000000:00010000:1.0:1788540921.585359:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: 00000000eefe640f/0x2aac941e5f4a72b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x2aac941e5f4a72c0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.585366:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: 00000000eefe640f/0x2aac941e5f4a72b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x2aac941e5f4a72c0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788540921.585371:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: 00000000eefe640f/0x2aac941e5f4a72b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x2aac941e5f4a72c0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788540921.585376:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788540921.585398:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: 00000000eefe640f/0x2aac941e5f4a72b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x2aac941e5f4a72c0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.585404:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788540921.585428:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: 00000000eefe640f/0x2aac941e5f4a72b9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x2aac941e5f4a72c0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.585435:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: 00000000eefe640f/0x2aac941e5f4a72b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x2aac941e5f4a72c0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.585449:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788540921.585450:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788540921.585452:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788540921.585459:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788540921.585469:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c620b2cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420980975232:0@lo:103: 00000100:00100000:2.0:1788540921.585472:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980975104 00000100:00100000:2.0:1788540921.585476:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980975104 00000100:00100000:1.0:1788540921.585495:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540921.585501:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788540921.585506:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad9ff8ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+10:7447:x1875420980975104:12345-0@lo:101: 00010000:00010000:2.0:1788540921.585514:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788540921.585523:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c82a60fc/0x2aac941e5f4a72ce lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a72c7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540921.585526:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980975232 00000100:00100000:1.0:1788540921.585529:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980975232 00010000:00010000:2.0:1788540921.585537:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c82a60fc/0x2aac941e5f4a72ce lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a72c7 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540921.585546:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c82a60fc/0x2aac941e5f4a72ce lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a72c7 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540921.585551:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788540921.585553:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c82a60fc, rc 0) 00000100:00100000:1.0:1788540921.585556:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000641dbeea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:425687b6-1d99-41d2-88d8-2fb230997596+12:3643:x1875420980975232:12345-0@lo:103: 00010000:00010000:1.0:1788540921.585564:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788540921.585573:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000041d1e526/0x2aac941e5f4a72c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2aac941e5f4a72b9 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540921.585578:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad9ff8ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+12:7447:x1875420980975104:12345-0@lo:101: Request processed in 73us (294us total) trans 0 rc 0/0 00010000:00010000:1.0:1788540921.585583:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788540921.585584:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788540921.585605:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000641dbeea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:425687b6-1d99-41d2-88d8-2fb230997596+10:3643:x1875420980975232:12345-0@lo:103: Request processed in 49us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540921.585611:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788540921.585635:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c620b2cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420980975232:0@lo:103: 00000100:00100000:3.0:1788540921.585691:0:7447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004dc04bdc pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:7447:1875420980975104:0@lo:101: 00010000:00010000:3.0:1788540921.585702:0:7447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: 00000000c0e8a525/0x2aac941e5f4a72c7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a72ce expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540921.585719:0:7447:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: 00000000c0e8a525/0x2aac941e5f4a72c7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a72ce expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788540921.585732:0:7447:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788540921.585747:0:7447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: 00000000c0e8a525/0x2aac941e5f4a72c7 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a72ce expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540921.585755:0:7447:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: 00000000c0e8a525/0x2aac941e5f4a72c7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a72ce expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788540921.585761:0:7447:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9a6839117000 10000000:01000000:3.0:1788540921.585765:0:7447:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788540921.585767:0:7447:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9a6839117000 from 1 10000000:01000000:3.0:1788540921.585769:0:7447:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788540921.585781:0:7447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: 00000000e18abe71/0x2aac941e5f4a72d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540921.585788:0:7447:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: 00000000e18abe71/0x2aac941e5f4a72d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540921.585793:0:7447:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: 00000000e18abe71/0x2aac941e5f4a72d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540921.586008:0:7447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004dc04bdc pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:7447:1875420980975360:0@lo:101: 00000100:00100000:3.0:1788540921.586035:0:7447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540921.586096:0:7447:0:(client.c:2716:ptlrpc_set_wait()) set 0000000005dc099c going to sleep for 11 seconds 00000100:00100000:0.0:1788540921.586197:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980975360 00000100:00100000:0.0:1788540921.586202:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980975360 00000100:00100000:1.0:1788540921.586245:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788540921.586270:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000000bf662 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+10:7447:x1875420980975360:12345-0@lo:101: 00010000:00010000:1.0:1788540921.586278:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788540921.586286:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000096cddde1/0x2aac941e5f4a72dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a72d5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.586301:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000096cddde1/0x2aac941e5f4a72dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a72d5 expref: 11 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.586309:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000096cddde1/0x2aac941e5f4a72dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a72d5 expref: 11 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.586316:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000096cddde1, rc 0) 00000100:00100000:1.0:1788540921.586353:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000000bf662 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+11:7447:x1875420980975360:12345-0@lo:101: Request processed in 86us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540921.586359:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788540921.586422:0:7447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004dc04bdc pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:7447:1875420980975360:0@lo:101: 00010000:00010000:3.0:1788540921.586433:0:7447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: 00000000e18abe71/0x2aac941e5f4a72d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a72dc expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540921.586449:0:7447:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: 00000000e18abe71/0x2aac941e5f4a72d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a72dc expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788540921.586460:0:7447:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788540921.586472:0:7447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: 00000000e18abe71/0x2aac941e5f4a72d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a72dc expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540921.586478:0:7447:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: 00000000e18abe71/0x2aac941e5f4a72d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a72dc expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788540921.586484:0:7447:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788540921.586488:0:7447:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788540921.586492:0:7447:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9a6839117000 10000000:01000000:3.0:1788540921.586495:0:7447:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788540921.586498:0:7447:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1788540921.586499:0:7447:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788540921.586514:0:7447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: 000000009654f4a6/0x2aac941e5f4a72e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540921.586520:0:7447:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: 000000009654f4a6/0x2aac941e5f4a72e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540921.586527:0:7447:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: 000000009654f4a6/0x2aac941e5f4a72e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540921.586538:0:7447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004dc04bdc pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:7447:1875420980975488:0@lo:101: 00000100:00100000:3.0:1788540921.586562:0:7447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540921.586584:0:7447:0:(client.c:2716:ptlrpc_set_wait()) set 0000000005dc099c going to sleep for 11 seconds 00000100:00100000:0.0:1788540921.586690:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980975488 00000100:00100000:0.0:1788540921.586695:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980975488 00000100:00100000:1.0:1788540921.586729:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788540921.586736:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000922bd7a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+11:7447:x1875420980975488:12345-0@lo:101: 00010000:00010000:1.0:1788540921.586743:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788540921.586751:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fbfbe5a9/0x2aac941e5f4a72ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a72e3 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.586764:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fbfbe5a9/0x2aac941e5f4a72ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a72e3 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.586771:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fbfbe5a9/0x2aac941e5f4a72ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a72e3 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.586777:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fbfbe5a9, rc 0) 00000100:00100000:1.0:1788540921.586933:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000922bd7a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+12:7447:x1875420980975488:12345-0@lo:101: Request processed in 198us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540921.586944:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788540921.587187:0:7447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004dc04bdc pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:7447:1875420980975488:0@lo:101: 00010000:00010000:3.0:1788540921.587198:0:7447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: 000000009654f4a6/0x2aac941e5f4a72e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a72ea expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540921.587205:0:7447:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: 000000009654f4a6/0x2aac941e5f4a72e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a72ea expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540921.587292:0:7447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004dc04bdc pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:7447:1875420980975616:0@lo:501: 00000100:00100000:3.0:1788540921.587316:0:7447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540921.587371:0:7447:0:(client.c:2716:ptlrpc_set_wait()) set 0000000005dc099c going to sleep for 11 seconds 00000100:00100000:1.0:1788540921.587404:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980975616 00000100:00100000:1.0:1788540921.587408:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980975616 00000100:00100000:1.0:1788540921.587466:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788540921.587473:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004df3137d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+12:7447:x1875420980975616:12345-0@lo:501: 00000100:00100000:1.0:1788540921.587569:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004df3137d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+12:7447:x1875420980975616:12345-0@lo:501: Request processed in 98us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540921.587576:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788540921.587624:0:7447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004dc04bdc pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:7447:1875420980975616:0@lo:501: 00000100:00100000:3.0:1788540921.587647:0:7447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004dc04bdc pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:7447:1875420980975744:0@lo:503: 00000100:00100000:3.0:1788540921.587682:0:7447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540921.587757:0:7447:0:(client.c:2716:ptlrpc_set_wait()) set 0000000005dc099c going to sleep for 11 seconds 00000100:00100000:0.0:1788540921.587787:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980975744 00000100:00100000:0.0:1788540921.587791:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980975744 00000100:00100000:0.0:1788540921.588073:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788540921.588138:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001b498da8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+12:7447:x1875420980975744:12345-0@lo:503: 00000100:00100000:0.0:1788540921.588225:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001b498da8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+12:7447:x1875420980975744:12345-0@lo:503: Request processed in 91us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540921.588231:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788540921.588298:0:7447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004dc04bdc pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:7447:1875420980975744:0@lo:503: 00000040:00080000:2.0:1788540921.588526:0:7447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788540921.588575:0:7447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000030307e8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:7447:1875420980975872:0@lo:502: 00000100:00100000:2.0:1788540921.588602:0:7447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540921.588626:0:7447:0:(client.c:2716:ptlrpc_set_wait()) set 0000000059bb7e99 going to sleep for 11 seconds 00000100:00100000:0.0:1788540921.588636:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980975872 00000100:00100000:0.0:1788540921.588640:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980975872 00000100:00100000:0.0:1788540921.588695:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788540921.588702:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000082b2216 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+12:7447:x1875420980975872:12345-0@lo:502: 00000100:00100000:0.0:1788540921.588777:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000082b2216 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+12:7447:x1875420980975872:12345-0@lo:502: Request processed in 76us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540921.588784:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788540921.588817:0:7447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000030307e8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:7447:1875420980975872:0@lo:502: 00000040:00080000:2.0:1788540921.589021:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788540921.589046:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:2.0:1788540921.589075:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:2.0:1788540921.589091:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:2.0:1788540921.589111:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:2.0:1788540921.589126:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:2.0:1788540921.589140:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:2.0:1788540921.589166:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:2.0:1788540921.589181:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:2.0:1788540921.589194:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:2.0:1788540921.589205:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:2.0:1788540921.589212:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:2.0:1788540921.589218:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:2.0:1788540921.589225:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:2.0:1788540921.589232:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:2.0:1788540921.589251:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:2.0:1788540921.589278:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:2.0:1788540921.589292:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:2.0:1788540921.589303:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:2.0:1788540921.589314:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:2.0:1788540921.589326:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:2.0:1788540921.589339:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:2.0:1788540921.589363:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:2.0:1788540921.589384:0:7447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000030307e8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:7447:1875420980976000:0@lo:502: 00000100:00100000:2.0:1788540921.589425:0:7447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540921.589556:0:7447:0:(client.c:2716:ptlrpc_set_wait()) set 0000000059bb7e99 going to sleep for 11 seconds 00000100:00100000:1.0:1788540921.589888:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980976000 00000100:00100000:1.0:1788540921.589894:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980976000 00000100:00100000:1.0:1788540921.589935:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788540921.589942:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004ab5c6e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+12:7447:x1875420980976000:12345-0@lo:502: 00000100:00100000:1.0:1788540921.590087:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004ab5c6e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+12:7447:x1875420980976000:12345-0@lo:502: Request processed in 144us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540921.590094:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788540921.590226:0:7447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000030307e8f pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:7447:1875420980976000:0@lo:502: 00000040:00080000:2.0:1788540921.590284:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:2.0:1788540921.590293:0:7447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:2.0:1788540921.591970:0:7459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788540921.591984:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788540921.591987:0:7459:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788540921.591994:0:7459:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1788540921.591996:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788540921.592011:0:7459:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (000000003eb40c21) 00000020:00000080:2.0:1788540921.592033:0:7459:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:2.0:1788540921.592038:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788540921.592159:0:7459:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788540921.592168:0:7459:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2aac941e5f4a72f8 00000020:00000080:2.0:1788540921.592370:0:7459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1788540921.592374:0:7459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788540921.592378:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788540921.592380:0:7459:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788540921.592383:0:7459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788540921.592386:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788540921.592387:0:7459:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1788540921.592390:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788540921.592404:0:7459:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (0000000031c2890c) 00000020:00000080:2.0:1788540921.592415:0:7459:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:2.0:1788540921.592420:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788540921.592422:0:7459:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1788540921.592425:0:7459:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1788540921.592430:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788540921.592627:0:7459:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006363c53d from lustre-MDT0001, refs=2 00000020:00000080:2.0:1788540921.592640:0:7459:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (000000006abf0cca) 00000020:00000080:2.0:1788540921.592649:0:7459:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:2.0:1788540921.592730:0:7459:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788540921.592735:0:7459:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2aac941e5f4a730d 00000020:00000080:2.0:1788540921.592827:0:7459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1788540921.592833:0:7459:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788540921.592837:0:7459:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x2aac941e5f4a7314 00080000:01000000:2.0:1788540921.592841:0:7459:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788540921.592844:0:7459:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2aac941e5f4a731b 00080000:10000000:2.0:1788540921.593286:0:7459:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1788540921.593406:0:7459:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:1.0:1788540921.690301:0:7459:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:1.0:1788540921.690731:0:7459:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:1.0:1788540921.694722:0:7459:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1788540921.695198:0:7459:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788540921.710033:0:7459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1788540921.710046:0:7459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788540921.710053:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788540921.710056:0:7459:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1788540921.710059:0:7459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788540921.710065:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788540921.710066:0:7459:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1788540921.710069:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788540921.710074:0:7459:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.156@tcp to nid 0x20000c0a8ca9c (192.168.202.156@tcp) 00000020:00000080:0.0:1788540921.710107:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788540921.710120:0:7459:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (000000005779785e) 00000020:00000080:0.0:1788540921.710141:0:7459:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1788540921.710208:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788540921.710298:0:7459:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1788540921.710305:0:7459:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788540921.710313:0:7459:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2aac941e5f4a7329 00010000:00080000:0.0:1788540921.710349:0:7459:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000d854110d@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.156@tcp at head 00010000:00010000:0.0:1788540921.716810:0:7459:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:1.0:1788540921.723275:0:7459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788540921.723291:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788540921.723342:0:7459:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788540921.723365:0:7459:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2aac941e5f4a7330 00000100:00080000:1.0:1788540921.723375:0:7459:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788540921.723381:0:7459:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000d854110d using connection 192.168.202.156@tcp/0@lo 00000100:00100000:1.0:1788540921.723414:0:7459:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c620b2cb x1875420980976128/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788540921.723600:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c620b2cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420980976128:0@lo:38: 00000100:00100000:2.0:1788540921.723664:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788540921.723734:0:7459:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788540921.723823:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788540921.723833:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aaa0d286 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875420980976256:0@lo:400: 00000100:00100000:1.0:1788540921.723864:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540921.724049:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980976256 00000100:00100000:1.0:1788540921.724057:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980976256 00000100:00100000:1.0:1788540921.724101:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788540921.724109:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa84bcab pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875420980976256:12345-0@lo:400: 00000100:00100000:1.0:1788540921.724157:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa84bcab pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875420980976256:12345-0@lo:400: Request processed in 50us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540921.724165:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788540921.724201:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000aaa0d286 x1875420980976256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540921.724213:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aaa0d286 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875420980976256:0@lo:400: 00000020:01000000:1.0:1788540921.724275:0:7459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788540921.724281:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788540921.724283:0:7459:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1788540921.724286:0:7459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788540921.724288:0:7459:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788540921.724290:0:7459:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788540921.724291:0:7459:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788540921.724293:0:7459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788540921.724296:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788540921.724297:0:7459:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788540921.724299:0:7459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788540921.724303:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788540921.724305:0:7459:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1788540921.724308:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788540921.724352:0:7459:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788540921.724367:0:7459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788540921.724370:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788540921.724371:0:7459:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1788540921.724374:0:7459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788540921.724376:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788540921.724377:0:7459:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788540921.724380:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788540921.724381:0:7459:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788540921.724408:0:7459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788540921.724410:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788540921.724412:0:7459:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788540921.724415:0:7459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:0.0:1788540921.724560:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980976128 00000100:00100000:0.0:1788540921.724566:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980976128 00000100:00100000:0.0:1788540921.724588:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788540921.724592:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000030307e8f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875420980976128:12345-0@lo:38: 00010000:00080000:0.0:1788540921.724611:0:6522:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 202 last 0 00000020:00000080:0.0:1788540921.724643:0:6522:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2aac941e5f4a7337 00000004:00100000:0.0:1788540921.724656:0:6522:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788540921.724661:0:6522:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000020:01000000:0.0:1788540921.725700:0:7447:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:0.0:1788540921.725733:0:7447:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788540921.725753:0:7447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: 000000009654f4a6/0x2aac941e5f4a72e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a72ea expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540921.725773:0:7447:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: 000000009654f4a6/0x2aac941e5f4a72e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a72ea expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788540921.725782:0:7447:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a6839117000 from 1 10000000:01000000:0.0:1788540921.725785:0:7447:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788540921.725822:0:7447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: 00000000af111ead/0x2aac941e5f4a733e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540921.725830:0:7447:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: 00000000af111ead/0x2aac941e5f4a733e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540921.725852:0:7447:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: 00000000af111ead/0x2aac941e5f4a733e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540921.725897:0:7447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002a47c1ec pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:7447:1875420980976384:0@lo:101: 00000100:00100000:0.0:1788540921.725958:0:7447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540921.725993:0:7447:0:(client.c:2716:ptlrpc_set_wait()) set 00000000381bbcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788540921.726225:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980976384 00000100:00100000:3.0:1788540921.726232:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980976384 00000100:00100000:3.0:1788540921.726277:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788540921.726285:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001c32366d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+12:7447:x1875420980976384:12345-0@lo:101: 00010000:00010000:3.0:1788540921.726295:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788540921.726306:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f889216a/0x2aac941e5f4a7345 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a733e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540921.726328:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f889216a/0x2aac941e5f4a7345 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a733e expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540921.726338:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f889216a/0x2aac941e5f4a7345 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a733e expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540921.726359:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f889216a, rc 0) 00000100:00100000:3.0:1788540921.726397:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001c32366d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+13:7447:x1875420980976384:12345-0@lo:101: Request processed in 113us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540921.726404:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788540921.726460:0:7447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002a47c1ec pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:7447:1875420980976384:0@lo:101: 00010000:00010000:3.0:1788540921.726475:0:7447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: 00000000af111ead/0x2aac941e5f4a733e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7345 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540921.726483:0:7447:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: 00000000af111ead/0x2aac941e5f4a733e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a7345 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540921.727342:0:7447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f48e01b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:7447:1875420980976512:0@lo:256: 00000100:00100000:3.0:1788540921.730364:0:7447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540921.730410:0:7447:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bd87d3f1 going to sleep for 11 seconds 00000100:00100000:2.0:1788540921.730976:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980976512 00000100:00100000:2.0:1788540921.730986:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980976512 00000100:00100000:2.0:1788540921.731039:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788540921.731049:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f74e33f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+13:7447:x1875420980976512:12345-0@lo:256: 20000000:01000000:2.0:1788540921.731072:0:6509:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788540921.731093:0:6509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788540921.731097:0:6509:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1788540921.731205:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f74e33f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+13:7447:x1875420980976512:12345-0@lo:256: Request processed in 157us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540921.731213:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788540921.731717:0:7447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f48e01b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:7447:1875420980976512:0@lo:256: 10000000:01000000:0.0:1788540921.733279:0:7447:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788540921.733308:0:7447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: 00000000af111ead/0x2aac941e5f4a733e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7345 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540921.733321:0:7447:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: 00000000af111ead/0x2aac941e5f4a733e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7345 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788540921.733332:0:7447:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a6839117000 from 1 10000000:01000000:0.0:1788540921.733335:0:7447:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788540921.733377:0:7447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: 00000000d436e380/0x2aac941e5f4a734c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540921.733384:0:7447:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: 00000000d436e380/0x2aac941e5f4a734c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540921.733395:0:7447:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: 00000000d436e380/0x2aac941e5f4a734c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540921.733418:0:7447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006dd6ad65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:7447:1875420980976640:0@lo:101: 00000100:00100000:0.0:1788540921.734415:0:7447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540921.734707:0:7447:0:(client.c:2716:ptlrpc_set_wait()) set 00000000381bbcc0 going to sleep for 11 seconds 00000100:00080000:0.0:1788540921.735687:0:6522:0:(import.c:65:import_set_state_nolock()) 00000000b92ac190 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788540921.735777:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000030307e8f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1875420980976128:12345-0@lo:38: Request processed in 11182us (12110us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540921.735788:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788540921.736191:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788540921.736201:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1788540921.736208:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788540921.736213:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788540921.736215:0:3640:0:(import.c:65:import_set_state_nolock()) 00000000d854110d lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788540921.736238:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c620b2cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420980976128:0@lo:38: 00000100:00100000:2.0:1788540921.736750:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aaa0d286 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420980976768:0@lo:41: 00000100:00100000:2.0:1788540921.736833:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540921.737178:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980976768 00000100:00100000:1.0:1788540921.737186:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980976768 00000100:00100000:1.0:1788540921.737234:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788540921.737242:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ed155f8b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1875420980976768:12345-0@lo:41: 00000004:00000024:1.0:1788540921.737280:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1788540921.737331:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ed155f8b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1875420980976768:12345-0@lo:41: Request processed in 90us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540921.737338:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788540921.737790:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aaa0d286 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420980976768:0@lo:41: 00000100:00100000:3.0:1788540921.738228:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980976640 00000100:00100000:3.0:1788540921.738234:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980976640 00000100:00100000:3.0:1788540921.738311:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788540921.738319:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c7c54c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+13:7447:x1875420980976640:12345-0@lo:101: 00010000:00010000:3.0:1788540921.738329:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788540921.738344:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c7a7ee25/0x2aac941e5f4a7353 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a734c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540921.738368:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c7a7ee25/0x2aac941e5f4a7353 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a734c expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540921.738378:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c7a7ee25/0x2aac941e5f4a7353 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a734c expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540921.738402:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c7a7ee25, rc 0) 00000100:00100000:3.0:1788540921.738462:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c7c54c6a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+14:7447:x1875420980976640:12345-0@lo:101: Request processed in 144us (4049us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540921.738468:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788540921.738543:0:7447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006dd6ad65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:7447:1875420980976640:0@lo:101: 00010000:00010000:0.0:1788540921.738560:0:7447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: 00000000d436e380/0x2aac941e5f4a734c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7353 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540921.738570:0:7447:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: 00000000d436e380/0x2aac941e5f4a734c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a7353 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540921.738670:0:7447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006dd6ad65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:7447:1875420980976896:0@lo:501: 00000100:00100000:0.0:1788540921.738702:0:7447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540921.739367:0:7447:0:(client.c:2716:ptlrpc_set_wait()) set 00000000381bbcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788540921.739458:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980976896 00000100:00100000:2.0:1788540921.739464:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980976896 00000100:00100000:2.0:1788540921.739491:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788540921.739497:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e55bf32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+14:7447:x1875420980976896:12345-0@lo:501: 00000100:00100000:2.0:1788540921.739669:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e55bf32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+14:7447:x1875420980976896:12345-0@lo:501: Request processed in 173us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540921.739674:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788540921.739731:0:7447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006dd6ad65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:7447:1875420980976896:0@lo:501: 00000100:00100000:0.0:1788540921.739758:0:7447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006dd6ad65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:7447:1875420980977024:0@lo:503: 00000100:00100000:0.0:1788540921.739808:0:7447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540921.739821:0:7447:0:(client.c:2716:ptlrpc_set_wait()) set 00000000381bbcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788540921.739911:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980977024 00000100:00100000:2.0:1788540921.739914:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980977024 00000100:00100000:2.0:1788540921.739928:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788540921.739939:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cfe0826d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+14:7447:x1875420980977024:12345-0@lo:503: 00000040:00080000:2.0:1788540921.739969:0:6509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788540921.740004:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cfe0826d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+14:7447:x1875420980977024:12345-0@lo:503: Request processed in 64us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540921.740011:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788540921.740173:0:7447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006dd6ad65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:7447:1875420980977024:0@lo:503: 00000040:00080000:0.0:1788540921.740461:0:7447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788540921.740507:0:7447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:0.0:1788540921.740658:0:7447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788540921.741657:0:7464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:2.0:1788540921.741906:0:7447:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1788540921.741925:0:7447:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788540921.742002:0:7447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: 00000000d436e380/0x2aac941e5f4a734c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7353 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540921.742012:0:7447:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: 00000000d436e380/0x2aac941e5f4a734c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7353 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788540921.742062:0:7447:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788540921.742064:0:7447:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a6839117000 10000000:01000000:2.0:1788540921.742067:0:7447:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a6839117000 10000000:01000000:2.0:1788540921.742129:0:7447:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788540921.742136:0:7447:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a6839117000 from 1 10000000:01000000:2.0:1788540921.742138:0:7447:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788540921.742171:0:7447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: 00000000691e1b6e/0x2aac941e5f4a735a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540921.742178:0:7447:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: 00000000691e1b6e/0x2aac941e5f4a735a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540921.742187:0:7447:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: 00000000691e1b6e/0x2aac941e5f4a735a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540921.742206:0:7447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006cde16c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:7447:1875420980977152:0@lo:101: 00000100:00100000:2.0:1788540921.742275:0:7447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540921.742306:0:7447:0:(client.c:2716:ptlrpc_set_wait()) set 000000007b2e55be going to sleep for 11 seconds 00000100:00100000:0.0:1788540921.742600:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980977152 00000100:00100000:0.0:1788540921.742607:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980977152 00000100:00100000:0.0:1788540921.742650:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788540921.742656:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003da078e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+14:7447:x1875420980977152:12345-0@lo:101: 00010000:00010000:0.0:1788540921.742671:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788540921.742680:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000084d2274b/0x2aac941e5f4a7361 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a735a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540921.742697:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000084d2274b/0x2aac941e5f4a7361 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a735a expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540921.742703:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000084d2274b/0x2aac941e5f4a7361 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a735a expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540921.742708:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000084d2274b, rc 0) 00000100:00100000:0.0:1788540921.742741:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003da078e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+15:7447:x1875420980977152:12345-0@lo:101: Request processed in 86us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540921.742745:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788540921.743269:0:7447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006cde16c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:7447:1875420980977152:0@lo:101: 00010000:00010000:2.0:1788540921.743285:0:7447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: 00000000691e1b6e/0x2aac941e5f4a735a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7361 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540921.743292:0:7447:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: 00000000691e1b6e/0x2aac941e5f4a735a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a7361 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540921.743368:0:7447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006cde16c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:7447:1875420980977280:0@lo:501: 00000100:00100000:2.0:1788540921.743390:0:7447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540921.743414:0:7447:0:(client.c:2716:ptlrpc_set_wait()) set 000000007b2e55be going to sleep for 11 seconds 00000100:00100000:0.0:1788540921.743497:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980977280 00000100:00100000:0.0:1788540921.743501:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980977280 00000100:00100000:0.0:1788540921.743601:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788540921.743606:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064fd4daa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+15:7447:x1875420980977280:12345-0@lo:501: 00000100:00100000:0.0:1788540921.743690:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064fd4daa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+15:7447:x1875420980977280:12345-0@lo:501: Request processed in 85us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540921.743695:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788540921.743737:0:7447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006cde16c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:7447:1875420980977280:0@lo:501: 00000100:00100000:2.0:1788540921.743755:0:7447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006cde16c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:7447:1875420980977408:0@lo:503: 00000100:00100000:2.0:1788540921.743794:0:7447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540921.744235:0:7447:0:(client.c:2716:ptlrpc_set_wait()) set 000000007b2e55be going to sleep for 11 seconds 00000100:00100000:1.0:1788540921.744272:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980977408 00000100:00100000:1.0:1788540921.744277:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980977408 00000100:00100000:1.0:1788540921.744303:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788540921.744308:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003c14800d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+15:7447:x1875420980977408:12345-0@lo:503: 00000100:00100000:1.0:1788540921.744407:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003c14800d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+15:7447:x1875420980977408:12345-0@lo:503: Request processed in 98us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540921.744414:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788540921.744600:0:7447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006cde16c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:7447:1875420980977408:0@lo:503: 00000040:00080000:2.0:1788540921.744853:0:7447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788540921.744937:0:7447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006cde16c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:7447:1875420980977536:0@lo:502: 00000100:00100000:2.0:1788540921.744974:0:7447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540921.744999:0:7447:0:(client.c:2716:ptlrpc_set_wait()) set 000000007b2e55be going to sleep for 11 seconds 00000100:00100000:1.0:1788540921.745228:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980977536 00000100:00100000:1.0:1788540921.745234:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980977536 00000100:00100000:1.0:1788540921.745274:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788540921.745281:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004b5585c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+15:7447:x1875420980977536:12345-0@lo:502: 00000100:00100000:1.0:1788540921.745367:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004b5585c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+15:7447:x1875420980977536:12345-0@lo:502: Request processed in 87us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540921.745373:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788540921.745414:0:7447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006cde16c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:7447:1875420980977536:0@lo:502: 00000040:00080000:1.0:1788540921.745624:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788540921.745643:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788540921.745650:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788540921.745657:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788540921.745663:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788540921.745670:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788540921.745677:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788540921.745683:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788540921.745690:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788540921.745696:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788540921.745703:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788540921.745709:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788540921.745715:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788540921.745722:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788540921.745728:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788540921.745735:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788540921.745755:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788540921.745762:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788540921.745769:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788540921.745776:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788540921.745782:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788540921.745788:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788540921.745802:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788540921.745811:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788540921.745817:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1788540921.745833:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1788540921.745840:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1788540921.745846:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:1.0:1788540921.745865:0:7447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007b6594dc pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:7447:1875420980977664:0@lo:502: 00000100:00100000:1.0:1788540921.745915:0:7447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540921.745937:0:7447:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c282f266 going to sleep for 11 seconds 00000100:00100000:1.0:1788540921.745950:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980977664 00000100:00100000:1.0:1788540921.745954:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980977664 00000100:00100000:1.0:1788540921.745973:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788540921.745978:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008b621552 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+15:7447:x1875420980977664:12345-0@lo:502: 00000100:00100000:1.0:1788540921.746037:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008b621552 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+15:7447:x1875420980977664:12345-0@lo:502: Request processed in 58us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540921.746042:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788540921.746090:0:7447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007b6594dc pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:7447:1875420980977664:0@lo:502: 00000040:00080000:1.0:1788540921.746121:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1788540921.746126:0:7447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1788540921.747234:0:7465:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1788540921.747250:0:7465:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (0000000081eb3ed9) 00000020:00000080:1.0:1788540921.747282:0:7465:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1788540921.747353:0:7465:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006363c53d from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788540921.747357:0:7465:0:(tgt_mount.c:187:server_put_mount()) put mount 000000006363c53d from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788540921.747359:0:7465:0:(obd_mount.c:710:lustre_put_lsi()) put 000000006363c53d 3 00010000:00080000:1.0:1788540921.747388:0:7465:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000b409597c@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.156@tcp at head 00010000:00010000:1.0:1788540921.750275:0:7465:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:1.0:1788540921.750497:0:7465:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1788540921.750586:0:7465:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788540921.750595:0:7465:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x2aac941e5f4a736f 00000100:00080000:1.0:1788540921.750603:0:7465:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788540921.750607:0:7465:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000b409597c using connection 192.168.202.156@tcp/0@lo 00000100:00100000:1.0:1788540921.750647:0:7465:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000007b6594dc x1875420980977792/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788540921.750668:0:7465:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000040:00080000:1.0:1788540921.751002:0:7465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:1.0:1788540921.751219:0:7466:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000020:01000000:2.0:1788540921.751375:0:7447:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1788540921.751400:0:7447:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788540921.751417:0:7447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: 00000000691e1b6e/0x2aac941e5f4a735a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7361 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540921.751424:0:7447:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: 00000000691e1b6e/0x2aac941e5f4a735a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7361 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788540921.751473:0:7447:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788540921.751475:0:7447:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788540921.751476:0:7447:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788540921.751477:0:7447:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788540921.751478:0:7447:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788540921.751479:0:7447:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788540921.751480:0:7447:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788540921.751481:0:7447:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788540921.751482:0:7447:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788540921.751484:0:7447:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788540921.751485:0:7447:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788540921.751488:0:7447:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:2.0:1788540921.751491:0:7447:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788540921.751492:0:7447:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788540921.751493:0:7447:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788540921.751494:0:7447:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788540921.751496:0:7447:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788540921.751497:0:7447:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788540921.751498:0:7447:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788540921.751499:0:7447:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788540921.751500:0:7447:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788540921.751506:0:7447:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788540921.751506:0:7447:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788540921.751607:0:7447:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788540921.751625:0:7447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000883ff69d pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:7447:1875420980977920:0@lo:253: 00000100:00100000:2.0:1788540921.751691:0:7447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540921.751760:0:7447:0:(client.c:2716:ptlrpc_set_wait()) set 000000002a821cab going to sleep for 11 seconds 00000100:00100000:2.0:1788540921.751785:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007b6594dc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875420980977792:0@lo:38: 00000100:00100000:2.0:1788540921.752029:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540921.752128:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980977920 00000100:00100000:0.0:1788540921.752136:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980977920 00000100:00100000:0.0:1788540921.752173:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788540921.752180:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001122e659 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+15:7447:x1875420980977920:12345-0@lo:253: 20000000:01000000:0.0:1788540921.752205:0:6511:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788540921.752218:0:6511:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788540921.752339:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980977792 00000100:00100000:0.0:1788540921.752349:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980977792 00000100:00100000:0.0:1788540921.752367:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788540921.752370:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004800a0a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875420980977792:12345-0@lo:38: 00010000:00080000:0.0:1788540921.752385:0:6517:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 202 last 0 00000020:00000080:0.0:1788540921.752409:0:6517:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x2aac941e5f4a7376 00000004:00100000:0.0:1788540921.752421:0:6517:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788540921.752453:0:6517:0:(import.c:65:import_set_state_nolock()) 00000000e422013d : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788540921.752492:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004800a0a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875420980977792:12345-0@lo:38: Request processed in 122us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540921.752497:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788540921.753344:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007b6594dc x1875420980977792/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788540931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540921.753357:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788540921.753364:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1788540921.753371:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788540921.753375:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788540921.753378:0:3640:0:(import.c:65:import_set_state_nolock()) 00000000b409597c lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788540921.753382:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007b6594dc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875420980977792:0@lo:38: 00000001:00100000:2.0:1788540921.753899:0:6496:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1788540921.754059:0:6511:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788540921.754076:0:6511:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1788540921.754172:0:6533:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788540921.754178:0:6533:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788540921.754195:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000077fe442a/0x2aac941e5f4a737d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.754211:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000044589fb0/0x2aac941e5f4a729d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a7296 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.754218:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f889216a/0x2aac941e5f4a7345 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a733e expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.754223:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000077fe442a/0x2aac941e5f4a737d lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.754265:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f889216a/0x2aac941e5f4a7345 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a733e expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.754276:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f889216a/0x2aac941e5f4a7345 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a733e expref: 15 pid: 6511 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540921.754288:0:6533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f323927f pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1875420980978048:0@lo:104: 00000100:00100000:1.0:1788540921.754341:0:6533:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788540921.754386:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000044589fb0/0x2aac941e5f4a729d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a7296 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.754417:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000044589fb0/0x2aac941e5f4a729d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a7296 expref: 15 pid: 6512 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540921.754423:0:6533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ea420a94 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1875420980978176:0@lo:104: 00000100:00100000:1.0:1788540921.754494:0:6533:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540921.754545:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980978048 00000100:00100000:2.0:1788540921.754551:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980978048 00000100:00100000:2.0:1788540921.754577:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980978176 00000100:00100000:2.0:1788540921.754580:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980978176 00000100:00100000:1.0:1788540921.754581:0:6533:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a11ae055 going to sleep for 11 seconds 00000100:00100000:2.0:1788540921.754594:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788540921.754600:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000da4ccb47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+4:6533:x1875420980978048:12345-0@lo:104: 00010000:00010000:2.0:1788540921.754612:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: 00000000af111ead/0x2aac941e5f4a733e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a7345 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540921.754664:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788540921.754669:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000da4ccb47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+4:6533:x1875420980978048:12345-0@lo:104: Request processed in 70us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540921.754675:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788540921.754690:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788540921.754696:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001514c7c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+3:6533:x1875420980978176:12345-0@lo:104: 00010000:00010000:2.0:1788540921.754702:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: 00000000ed98f274/0x2aac941e5f4a7296 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a729d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540921.754706:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001122e659 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+15:7447:x1875420980977920:12345-0@lo:253: Request processed in 2527us (3016us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540921.754713:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:2.0:1788540921.754730:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788540921.754734:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001514c7c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+3:6533:x1875420980978176:12345-0@lo:104: Request processed in 40us (240us total) trans 0 rc 0/0 00010000:00010000:1.0:1788540921.754738:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788540921.754742:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: 00000000af111ead/0x2aac941e5f4a733e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a7345 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540921.754744:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788540921.754749:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000af111ead already unused, calling callback (00000000e5ff5456) 10000000:00010000:1.0:1788540921.754752:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: 00000000af111ead/0x2aac941e5f4a733e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a7345 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.754759:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: 00000000af111ead/0x2aac941e5f4a733e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a7345 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788540921.754777:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: 00000000af111ead/0x2aac941e5f4a733e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a7345 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788540921.754783:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788540921.754892:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: 00000000af111ead/0x2aac941e5f4a733e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7345 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.754898:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788540921.754920:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: 00000000af111ead/0x2aac941e5f4a733e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7345 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540921.754952:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ea9741d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420980978304:0@lo:103: 00000100:00100000:2.0:1788540921.754980:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788540921.755003:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: 00000000af111ead/0x2aac941e5f4a733e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7345 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.755015:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788540921.755017:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: 00000000ed98f274/0x2aac941e5f4a7296 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a729d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.755023:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ed98f274 already unused, calling callback (00000000e5ff5456) 10000000:00010000:1.0:1788540921.755026:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: 00000000ed98f274/0x2aac941e5f4a7296 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a729d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.755031:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: 00000000ed98f274/0x2aac941e5f4a7296 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a729d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788540921.755036:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: 00000000ed98f274/0x2aac941e5f4a7296 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a729d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788540921.755040:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788540921.755065:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: 00000000ed98f274/0x2aac941e5f4a7296 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a729d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.755071:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788540921.755080:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: 00000000ed98f274/0x2aac941e5f4a7296 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a729d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.755087:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: 00000000ed98f274/0x2aac941e5f4a7296 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a729d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.755098:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788540921.755108:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788540921.755110:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788540921.755117:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788540921.755124:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c651575e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420980978432:0@lo:103: 00000100:00100000:1.0:1788540921.755151:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540921.755176:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980978304 00000100:00100000:1.0:1788540921.755180:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980978304 00010000:00010000:1.0:1788540921.755196:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f889216a/0x2aac941e5f4a7345 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a733e expref: 15 pid: 6511 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540921.755215:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980978432 00000100:00100000:1.0:1788540921.755218:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980978432 00010000:00010000:1.0:1788540921.755228:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000044589fb0/0x2aac941e5f4a729d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a7296 expref: 16 pid: 6512 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540921.755240:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788540921.755245:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d346db3e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:425687b6-1d99-41d2-88d8-2fb230997596+16:3643:x1875420980978304:12345-0@lo:103: 00010000:00010000:1.0:1788540921.755263:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788540921.755268:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f889216a/0x2aac941e5f4a7345 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a733e expref: 16 pid: 6511 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.755277:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f889216a/0x2aac941e5f4a7345 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a733e expref: 16 pid: 6511 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.755295:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788540921.755322:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d346db3e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:425687b6-1d99-41d2-88d8-2fb230997596+16:3643:x1875420980978304:12345-0@lo:103: Request processed in 77us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540921.755329:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788540921.755343:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788540921.755348:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a8cdad2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:425687b6-1d99-41d2-88d8-2fb230997596+15:3643:x1875420980978432:12345-0@lo:103: 00010000:00010000:1.0:1788540921.755365:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788540921.755369:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000044589fb0/0x2aac941e5f4a729d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a7296 expref: 15 pid: 6512 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.755377:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000044589fb0/0x2aac941e5f4a729d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a7296 expref: 15 pid: 6512 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.755387:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000077fe442a/0x2aac941e5f4a737d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.755395:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000077fe442a/0x2aac941e5f4a737d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788540921.755409:0:6503:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005435104s 00010000:00010000:1.0:1788540921.755413:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000077fe442a/0x2aac941e5f4a737d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.755418:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000077fe442a/0x2aac941e5f4a737d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.755421:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000077fe442a/0x2aac941e5f4a737d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.755424:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000077fe442a/0x2aac941e5f4a737d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.755427:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000077fe442a already unused, calling callback (00000000b72a7d0e) 00010000:00010000:1.0:1788540921.755429:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000077fe442a/0x2aac941e5f4a737d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.755433:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000077fe442a/0x2aac941e5f4a737d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540921.755613:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788540921.755652:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000077fe442a/0x2aac941e5f4a737d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540921.755662:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788540921.756008:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f889216a/0x2aac941e5f4a7345 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a733e expref: 15 pid: 6511 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540921.756017:0:6533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f323927f pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1875420980978048:0@lo:104: 00010000:00010000:0.0:1788540921.756027:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000044589fb0/0x2aac941e5f4a729d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a7296 expref: 14 pid: 6512 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540921.756043:0:6533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ea420a94 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1875420980978176:0@lo:104: 00010000:00010000:0.0:1788540921.756060:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000077fe442a/0x2aac941e5f4a737d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540921.756068:0:6533:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000077fe442a/0x2aac941e5f4a737d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540921.756073:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000077fe442a/0x2aac941e5f4a737d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540921.756078:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000077fe442a/0x2aac941e5f4a737d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540921.756113:0:7447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000883ff69d pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:7447:1875420980977920:0@lo:253: 10000000:01000000:0.0:1788540921.756123:0:7447:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788540921.756126:0:7447:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788540921.756128:0:7447:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788540921.756130:0:7447:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788540921.756131:0:7447:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788540921.756132:0:7447:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788540921.756133:0:7447:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788540921.756134:0:7447:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788540921.756136:0:7447:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788540921.756137:0:7447:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788540921.756138:0:7447:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788540921.756140:0:7447:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788540921.756153:0:7447:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788540921.757083:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a8cdad2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:425687b6-1d99-41d2-88d8-2fb230997596+13:3643:x1875420980978432:12345-0@lo:103: Request processed in 1731us (1928us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540921.757094:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788540921.757171:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c651575e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420980978432:0@lo:103: 00000100:00100000:1.0:1788540921.757182:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ea9741d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420980978304:0@lo:103: 00080000:10000000:1.0:1788540921.766730:0:7447:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:1.0:1788540921.767262:0:7447:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1788540921.767482:0:7447:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1788540921.767611:0:7447:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1788540921.767727:0:7447:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1788540921.767860:0:7447:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1788540921.769272:0:7447:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1788540921.769513:0:7447:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1788540921.769692:0:7447:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:2.0:1788540921.770009:0:7447:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1788540921.770358:0:7447:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:2.0:1788540921.770531:0:7447:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:2.0:1788540921.772794:0:7447:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1788540921.773366:0:7470:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1788540921.773371:0:7470:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1788540921.773378:0:7471:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788540921.773409:0:7447:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:3.0:1788540921.773428:0:7471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003b143d0a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7471:1875420980978560:0@lo:700: 00000100:00100000:3.0:1788540921.773523:0:7471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540921.773564:0:7471:0:(client.c:2716:ptlrpc_set_wait()) set 000000009bab3dd1 going to sleep for 11 seconds 00000100:00100000:1.0:1788540921.773707:0:7472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ea9741d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7472:1875420980978688:0@lo:1000: 00000100:00100000:1.0:1788540921.773751:0:7472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540921.773788:0:7472:0:(client.c:2716:ptlrpc_set_wait()) set 00000000adabc818 going to sleep for 11 seconds 00000100:00100000:3.0:1788540921.773811:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980978688 00000100:00100000:3.0:1788540921.773818:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980978688 00000100:00100000:3.0:1788540921.773919:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788540921.773928:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c651575e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7472:x1875420980978688:12345-0@lo:1000: 00000100:00100000:3.0:1788540921.774006:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c651575e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7472:x1875420980978688:12345-0@lo:1000: Request processed in 80us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540921.774013:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:01000000:2.0:1788540921.774582:0:7447:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1788540921.774687:0:7447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788540921.774942:0:7472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ea9741d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7472:1875420980978688:0@lo:1000: 00000040:01000000:1.0:1788540921.774982:0:7472:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:1.0:1788540921.775008:0:7472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ea9741d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7472:1875420980978816:0@lo:700: 00000100:00100000:1.0:1788540921.775056:0:7472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540921.775075:0:7472:0:(client.c:2716:ptlrpc_set_wait()) set 000000007253a336 going to sleep for 11 seconds 00000100:00100000:3.0:1788540921.775783:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980978816 00000100:00100000:3.0:1788540921.775792:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980978816 00000100:00100000:3.0:1788540921.775854:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788540921.775862:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000019095b8d pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7472:x1875420980978816:12345-0@lo:700: 00000004:00000080:2.0:1788540921.775905:0:7447:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788540921.775913:0:7447:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000100:00100000:3.0:1788540921.776133:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000019095b8d pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7472:x1875420980978816:12345-0@lo:700: Request processed in 270us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540921.776149:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788540921.776206:0:7472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ea9741d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7472:1875420980978816:0@lo:700: 00000100:00100000:0.0:1788540921.776245:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980978560 00000100:00100000:0.0:1788540921.776250:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980978560 00000100:00100000:3.0:1788540921.776267:0:7472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e92567bf pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7472:1875420980978944:0@lo:900: 00000100:00100000:0.0:1788540921.776301:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788540921.776306:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e0b51668 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7471:x1875420980978560:12345-0@lo:700: 00000040:00080000:2.0:1788540921.776508:0:7447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788540921.777046:0:7472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540921.777143:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980978944 00000100:00100000:0.0:1788540921.777232:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980978944 00000100:00100000:0.0:1788540921.777275:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788540921.777282:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009092a13b pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7472:x1875420980978944:12345-0@lo:900: 00000100:00100000:3.0:1788540921.777347:0:7472:0:(client.c:2716:ptlrpc_set_wait()) set 000000008f2e662a going to sleep for 11 seconds 00000100:00100000:0.0:1788540921.777905:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009092a13b pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7472:x1875420980978944:12345-0@lo:900: Request processed in 623us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540921.777914:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788540921.778376:0:7472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e92567bf x1875420980978944/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788540937 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540921.778390:0:7472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e92567bf pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7472:1875420980978944:0@lo:900: 00000040:00080000:2.0:1788540921.778521:0:7447:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788540921.779736:0:7447:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788540921.779852:0:7447:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000100:00100000:3.0:1788540921.780383:0:7472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e92567bf pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7472:1875420980979072:0@lo:1000: 00000100:00100000:3.0:1788540921.780452:0:7472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540921.780500:0:7472:0:(client.c:2716:ptlrpc_set_wait()) set 0000000035fff218 going to sleep for 11 seconds 00000100:00100000:0.0:1788540921.781417:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980979072 00000100:00100000:0.0:1788540921.781427:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980979072 00000100:00100000:0.0:1788540921.781485:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788540921.781494:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb6cbecd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7472:x1875420980979072:12345-0@lo:1000: 00000040:00080000:2.0:1788540921.783719:0:7447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788540921.784082:0:7447:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788540921.784750:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1788540921.784929:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1788540921.785081:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1788540921.785215:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1788540921.785394:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1788540921.785625:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1788540921.785771:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 40000000:02000000:3.0:1788540921.787482:0:6524:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000100:00100000:0.0:1788540921.789130:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb6cbecd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7472:x1875420980979072:12345-0@lo:1000: Request processed in 7627us (8667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540921.789156:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788540921.792786:0:7472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e92567bf pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7472:1875420980979072:0@lo:1000: 00100000:10000000:2.0:1788540921.793413:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1788540921.793650:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00000004:00080000:1.0:1788540921.793667:0:7472:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000008f2e662a with version 0 00000020:00100000:1.0:1788540921.793750:0:7472:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788540921.793758:0:7472:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000b367e4c4 x1875420980979328/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788540921.793779:0:7472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b367e4c4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7472:1875420980979328:0@lo:1000: 00100000:10000000:2.0:1788540921.793798:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1788540921.793986:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00000100:00100000:1.0:1788540921.795743:0:7472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540921.795807:0:7472:0:(client.c:2716:ptlrpc_set_wait()) set 00000000adabc818 going to sleep for 11 seconds 00000100:00100000:0.0:1788540921.796183:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980979328 00000100:00100000:0.0:1788540921.796193:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980979328 00000100:00100000:0.0:1788540921.796396:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788540921.796406:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000641dbeea pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7472:x1875420980979328:12345-0@lo:1000: 00100000:10000000:2.0:1788540921.797861:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1788540921.799237:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1788540921.799899:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1788540921.803434:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1788540921.803722:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1788540921.804084:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00000001:00080000:0.0:1788540921.804372:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:1.0:1788540921.804795:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000641dbeea pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7472:x1875420980979328:12345-0@lo:1000: Request processed in 8387us (9055us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788540921.804820:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00100000:10000000:2.0:1788540921.806917:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1788540921.807749:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00000100:00100000:3.0:1788540921.808350:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e0b51668 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7471:x1875420980978560:12345-0@lo:700: Request processed in 32039us (34834us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540921.808368:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788540921.808429:0:7471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003b143d0a x1875420980978560/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788540937 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1788540921.808789:0:7472:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1788540921.808849:0:7472:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788540921.808890:0:7472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b367e4c4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7472:1875420980979328:0@lo:1000: 00000100:00100000:0.0:1788540921.809002:0:7472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006dd6ad65 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7472:1875420980979456:0@lo:1000: 00000100:00100000:0.0:1788540921.809060:0:7472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00100000:10000000:2.0:1788540921.809113:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00000100:00100000:0.0:1788540921.809132:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980979456 00000100:00100000:0.0:1788540921.809142:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980979456 00000100:00100000:0.0:1788540921.809188:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788540921.809196:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f3610d16 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7472:x1875420980979456:12345-0@lo:1000: 00000100:00100000:3.0:1788540921.809247:0:7471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003b143d0a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7471:1875420980978560:0@lo:700: 40000000:02000000:3.0:1788540921.809268:0:7471:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000100:00100000:0.0:1788540921.809282:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f3610d16 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7472:x1875420980979456:12345-0@lo:1000: Request processed in 84us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540921.809293:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788540921.809332:0:7472:0:(client.c:2716:ptlrpc_set_wait()) set 0000000042bd0cfb going to sleep for 11 seconds 00000100:00100000:0.0:1788540921.809346:0:7472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006dd6ad65 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7472:1875420980979456:0@lo:1000: 00000040:00080000:0.0:1788540921.809363:0:7472:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1788540921.809389:0:7472:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000042bd0cfb with version 1 00000004:00080000:0.0:1788540921.809405:0:7462:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000004052650e version 1 rpc_version 1 00000020:00100000:0.0:1788540921.809419:0:7462:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788540921.809424:0:7462:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000006dd6ad65 x1875420980979712/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788540921.809437:0:7462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006dd6ad65 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7462:1875420980979712:0@lo:1000: 00000100:00100000:0.0:1788540921.809462:0:7462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540921.809476:0:7462:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e24e367a going to sleep for 11 seconds 00000100:00100000:0.0:1788540921.809490:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980979712 00000100:00100000:0.0:1788540921.809493:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980979712 00000100:00100000:0.0:1788540921.810738:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788540921.810750:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000084c3804e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7462:x1875420980979712:12345-0@lo:1000: 00100000:10000000:2.0:1788540921.810912:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1788540921.811621:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1788540921.811773:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1788540921.811988:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1788540921.812599:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1788540921.812746:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00000040:00080000:1.0:1788540921.813108:0:7472:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788540921.813219:0:7472:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00100000:10000000:2.0:1788540921.813270:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1788540921.813435:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1788540921.815075:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1788540921.815492:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1788540921.815681:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1788540921.815854:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1788540921.816724:0:7447:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:0.0:1788540921.818862:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:2.0:1788540921.819026:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000084c3804e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7462:x1875420980979712:12345-0@lo:1000: Request processed in 8276us (9560us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788540921.819044:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:0.0:1788540921.819939:0:7462:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1788540921.819945:0:7462:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788540921.819964:0:7462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006dd6ad65 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7462:1875420980979712:0@lo:1000: 00000001:00080000:2.0:1788540921.828892:0:7447:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788540921.828935:0:7447:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb5cdc1c83988 00100000:10000000:2.0:1788540921.829008:0:7447:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1788540921.830210:0:7447:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788540921.830235:0:7447:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.156@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788540921.830264:0:7447:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788540921.830282:0:7447:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1788540921.831599:0:7447:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788540921.831839:0:7447:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:3.0:1788540921.861247:0:7471:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788540921.871768:0:7471:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788540921.871839:0:7471:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788540921.871845:0:7471:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:0.0:1788540922.315790:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788540923.338431:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788540924.372387:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788540925.387487:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788540926.228043:0:7717:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg256-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788540926.411121:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788540926.922401:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788540926.922423:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f369a1a7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420980979840:0@lo:41: 00000100:00100000:2.0:1788540926.922572:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540926.922804:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c02893bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875420980980096:0@lo:400: 00000100:00100000:1.0:1788540926.922835:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540926.922854:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788540926.922858:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b367e4c4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875420980980224:0@lo:400: 00000100:00100000:2.0:1788540926.923106:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e4fdce7f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420980979968:0@lo:400: 00000100:00100000:2.0:1788540926.923136:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540926.923185:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980979968 00000100:00100000:2.0:1788540926.923191:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980979968 00000100:00100000:2.0:1788540926.923255:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788540926.923263:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ef50469 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+13:3642:x1875420980979968:12345-0@lo:400: 00000100:00100000:2.0:1788540926.923308:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ef50469 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+13:3642:x1875420980979968:12345-0@lo:400: Request processed in 47us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540926.923315:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788540926.923372:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e4fdce7f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420980979968:0@lo:400: 00000100:00100000:3.0:1788540926.923558:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980979840 00000100:00100000:3.0:1788540926.923563:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980979840 00000100:00100000:3.0:1788540926.923609:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788540926.923616:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eaba7ac9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420980979840:12345-0@lo:41: 00000004:00000024:3.0:1788540926.923645:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1788540926.923699:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540926.923702:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eaba7ac9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420980979840:12345-0@lo:41: Request processed in 88us (1132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540926.923709:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788540926.923730:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980980096 00000100:00100000:1.0:1788540926.923734:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980980096 00000100:00100000:3.0:1788540926.923743:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f369a1a7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420980979840:0@lo:41: 00000100:00100000:1.0:1788540926.923758:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980980224 00000100:00100000:1.0:1788540926.923761:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980980224 00000100:00100000:1.0:1788540926.923774:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788540926.923780:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000ea9741d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875420980980096:12345-0@lo:400: 00000100:00100000:1.0:1788540926.923820:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000ea9741d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875420980980096:12345-0@lo:400: Request processed in 41us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540926.923825:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788540926.923838:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788540926.923843:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ea420a94 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875420980980224:12345-0@lo:400: 00010000:00080000:3.0:1788540926.923884:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000c02893bf x1875420980980096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540926.923884:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ea420a94 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875420980980224:12345-0@lo:400: Request processed in 26us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540926.923890:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788540926.923895:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c02893bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875420980980096:0@lo:400: 00010000:00080000:3.0:1788540926.923910:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000b367e4c4 x1875420980980224/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540926.923918:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b367e4c4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875420980980224:0@lo:400: 00000020:00000004:1.0:1788540927.232618:0:7769:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788540927.232821:0:7769:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788540927.435147:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788540928.458611:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788540929.482126:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788540929.976596:0:7870:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788540929.976785:0:7870:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788540930.506262:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788540931.161456:0:7919:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc3e305a30 20000000:00000080:1.0:1788540931.161481:0:7919:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a682f674400 uarg=0000000000000000 20000000:01000000:1.0:1788540931.161531:0:7919:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788540931.161542:0:7919:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788540931.161548:0:7919:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788540931.161727:0:7919:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1788540931.161743:0:7919:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1788540931.169767:0:7919:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788540931.170624:0:7919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788540931.170669:0:7919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1788540931.170693:0:7919:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1788540931.170712:0:7919:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788540931.170733:0:7919:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000010e4f94b/0x2aac941e5f4a7384 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.170756:0:7919:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000079364d83/0x2aac941e5f4a7265 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a725e expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.170764:0:7919:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c7a7ee25/0x2aac941e5f4a7353 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a734c expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.170772:0:7919:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000010e4f94b/0x2aac941e5f4a7384 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.170818:0:7919:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c7a7ee25/0x2aac941e5f4a7353 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a734c expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.170832:0:7919:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c7a7ee25/0x2aac941e5f4a7353 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a734c expref: 12 pid: 6512 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540931.170848:0:7919:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f323927f pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7919:1875420980980352:0@lo:104: 00000100:00100000:1.0:1788540931.171254:0:7919:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788540931.171353:0:7919:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000079364d83/0x2aac941e5f4a7265 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a725e expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.171362:0:7919:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000079364d83/0x2aac941e5f4a7265 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a725e expref: 12 pid: 6512 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540931.171370:0:7919:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007b6594dc pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7919:1875420980980480:0@lo:104: 00000100:00100000:1.0:1788540931.171388:0:7919:0:(client.c:2716:ptlrpc_set_wait()) set 000000006010eae6 going to sleep for 11 seconds 00000100:00100000:3.0:1788540931.175738:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788540931.175789:0:6501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540931.175825:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980980352 00000100:00100000:3.0:1788540931.175833:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980980352 00000100:00100000:0.0:1788540931.176124:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980980480 00000100:00100000:0.0:1788540931.176129:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980980480 00000100:00100000:0.0:1788540931.176152:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788540931.176161:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b92214c2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:425687b6-1d99-41d2-88d8-2fb230997596+4:7919:x1875420980980352:12345-0@lo:104: 00010000:00010000:0.0:1788540931.176191:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: 00000000d436e380/0x2aac941e5f4a734c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a7353 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540931.176322:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788540931.176328:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b92214c2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:425687b6-1d99-41d2-88d8-2fb230997596+4:7919:x1875420980980352:12345-0@lo:104: Request processed in 169us (5076us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540931.176336:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788540931.176373:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788540931.176379:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003b143d0a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:425687b6-1d99-41d2-88d8-2fb230997596+3:7919:x1875420980980480:12345-0@lo:104: 00010000:00010000:0.0:1788540931.176386:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: 0000000017ac3779/0x2aac941e5f4a725e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a7265 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540931.176467:0:7919:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f323927f pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7919:1875420980980352:0@lo:104: 00000100:00100000:1.0:1788540931.176496:0:7919:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007b6594dc pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7919:1875420980980480:0@lo:104: 00010000:00010000:1.0:1788540931.176517:0:7919:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000010e4f94b/0x2aac941e5f4a7384 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540931.178179:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788540931.178190:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: 00000000d436e380/0x2aac941e5f4a734c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a7353 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540931.178202:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d436e380 already unused, calling callback (00000000e5ff5456) 10000000:00010000:2.0:1788540931.178205:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: 00000000d436e380/0x2aac941e5f4a734c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a7353 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540931.178236:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: 00000000d436e380/0x2aac941e5f4a734c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a7353 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788540931.178243:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: 00000000d436e380/0x2aac941e5f4a734c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a7353 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788540931.178249:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788540931.178302:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: 00000000d436e380/0x2aac941e5f4a734c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7353 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540931.178309:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788540931.178334:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: 00000000d436e380/0x2aac941e5f4a734c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7353 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540931.178340:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: 00000000d436e380/0x2aac941e5f4a734c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7353 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540931.178357:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788540931.178360:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: 0000000017ac3779/0x2aac941e5f4a725e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a7265 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540931.178365:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000017ac3779 already unused, calling callback (00000000e5ff5456) 10000000:00010000:2.0:1788540931.178367:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: 0000000017ac3779/0x2aac941e5f4a725e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a7265 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540931.178373:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: 0000000017ac3779/0x2aac941e5f4a725e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a7265 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788540931.178378:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: 0000000017ac3779/0x2aac941e5f4a725e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a7265 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788540931.178390:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788540931.178403:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: 0000000017ac3779/0x2aac941e5f4a725e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7265 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540931.178408:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788540931.178413:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: 0000000017ac3779/0x2aac941e5f4a725e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7265 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540931.178419:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: 0000000017ac3779/0x2aac941e5f4a725e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7265 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540931.178436:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540931.178438:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540931.178439:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788540931.178464:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000305600d7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420980980608:0@lo:103: 00000100:00100000:2.0:1788540931.178531:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540931.178577:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788540931.178583:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a1a9d066 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420980980736:0@lo:103: 00000100:00100000:2.0:1788540931.178616:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540931.178653:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980980608 00000100:00100000:2.0:1788540931.178660:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980980608 00010000:00010000:2.0:1788540931.178687:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c7a7ee25/0x2aac941e5f4a7353 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a734c expref: 13 pid: 6512 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540931.178713:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980980736 00000100:00100000:2.0:1788540931.178716:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980980736 00010000:00010000:2.0:1788540931.178727:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000079364d83/0x2aac941e5f4a7265 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a725e expref: 14 pid: 6512 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540931.178754:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788540931.178760:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa36e73e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:425687b6-1d99-41d2-88d8-2fb230997596+14:3641:x1875420980980608:12345-0@lo:103: 00010000:00010000:2.0:1788540931.178772:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788540931.178777:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c7a7ee25/0x2aac941e5f4a7353 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a734c expref: 14 pid: 6512 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540931.178787:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c7a7ee25/0x2aac941e5f4a7353 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a734c expref: 14 pid: 6512 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540931.178800:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c7a7ee25/0x2aac941e5f4a7353 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a734c expref: 14 pid: 6512 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540931.178812:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788540931.178843:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa36e73e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:425687b6-1d99-41d2-88d8-2fb230997596+13:3641:x1875420980980608:12345-0@lo:103: Request processed in 84us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540931.178849:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788540931.178866:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788540931.178896:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e07d237 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:425687b6-1d99-41d2-88d8-2fb230997596+12:3641:x1875420980980736:12345-0@lo:103: 00010000:00010000:2.0:1788540931.178904:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788540931.178908:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000079364d83/0x2aac941e5f4a7265 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a725e expref: 12 pid: 6512 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540931.178915:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000079364d83/0x2aac941e5f4a7265 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a725e expref: 12 pid: 6512 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540931.178923:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000079364d83/0x2aac941e5f4a7265 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a725e expref: 12 pid: 6512 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540931.178944:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000010e4f94b/0x2aac941e5f4a7384 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540931.178952:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000010e4f94b/0x2aac941e5f4a7384 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540931.178976:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000010e4f94b/0x2aac941e5f4a7384 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540931.178983:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000010e4f94b/0x2aac941e5f4a7384 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540931.178988:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000010e4f94b/0x2aac941e5f4a7384 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540931.179499:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000305600d7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420980980608:0@lo:103: 00010000:00010000:2.0:1788540931.179617:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000010e4f94b/0x2aac941e5f4a7384 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540931.179622:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000010e4f94b already unused, calling callback (00000000b72a7d0e) 00010000:00010000:2.0:1788540931.179625:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000010e4f94b/0x2aac941e5f4a7384 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540931.179632:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000010e4f94b/0x2aac941e5f4a7384 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540931.179653:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000010e4f94b/0x2aac941e5f4a7384 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540931.179663:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788540931.179706:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e07d237 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:425687b6-1d99-41d2-88d8-2fb230997596+11:3641:x1875420980980736:12345-0@lo:103: Request processed in 812us (1091us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540931.179724:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1788540931.179777:0:7919:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000010e4f94b/0x2aac941e5f4a7384 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.179785:0:7919:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000010e4f94b/0x2aac941e5f4a7384 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.179791:0:7919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000010e4f94b/0x2aac941e5f4a7384 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540931.180827:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a1a9d066 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420980980736:0@lo:103: 00010000:00010000:0.0:1788540931.181883:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1788540931.181896:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003b143d0a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:425687b6-1d99-41d2-88d8-2fb230997596+3:7919:x1875420980980480:12345-0@lo:104: Request processed in 5515us (6108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540931.181908:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1788540931.182228:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788540931.331145:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788540931.331154:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a6839117000 from 4 10000000:01000000:2.0:1788540931.331158:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788540931.331221:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: 00000000e8dce746/0x2aac941e5f4a738b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540931.331236:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: 00000000e8dce746/0x2aac941e5f4a738b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540931.331247:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: 00000000e8dce746/0x2aac941e5f4a738b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540931.331271:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d346db3e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980980864:0@lo:101: 00000100:00100000:2.0:1788540931.331345:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540931.331402:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set 00000000549004e5 going to sleep for 11 seconds 00000100:00100000:1.0:1788540931.331456:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980980864 00000100:00100000:1.0:1788540931.331464:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980980864 00000100:00100000:1.0:1788540931.331524:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788540931.331533:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000de0e6d9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+11:6514:x1875420980980864:12345-0@lo:101: 00010000:00010000:1.0:1788540931.331545:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788540931.331559:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000010e4f94b/0x2aac941e5f4a7392 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a738b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.331588:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000010e4f94b/0x2aac941e5f4a7392 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a738b expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.331599:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000010e4f94b/0x2aac941e5f4a7392 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a738b expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.331608:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000010e4f94b, rc 0) 00000100:00100000:1.0:1788540931.331650:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000de0e6d9b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+12:6514:x1875420980980864:12345-0@lo:101: Request processed in 119us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540931.331674:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788540931.333174:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d346db3e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980980864:0@lo:101: 00010000:00010000:2.0:1788540931.333207:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: 00000000e8dce746/0x2aac941e5f4a738b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7392 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540931.333220:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: 00000000e8dce746/0x2aac941e5f4a738b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a7392 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540931.333297:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d346db3e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980980992:0@lo:256: 00000100:00100000:2.0:1788540931.333961:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540931.334022:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set 00000000549004e5 going to sleep for 11 seconds 00000100:00100000:1.0:1788540931.334197:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980980992 00000100:00100000:1.0:1788540931.334207:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980980992 00000100:00100000:1.0:1788540931.334264:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788540931.334273:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000316615e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+12:6514:x1875420980980992:12345-0@lo:256: 20000000:01000000:1.0:1788540931.334298:0:6512:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788540931.334323:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788540931.334326:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1788540931.334427:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000316615e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+12:6514:x1875420980980992:12345-0@lo:256: Request processed in 155us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540931.334436:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788540931.334717:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d346db3e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980980992:0@lo:256: 10000000:01000000:2.0:1788540931.334782:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788540931.334795:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: 00000000e8dce746/0x2aac941e5f4a738b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7392 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540931.334805:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: 00000000e8dce746/0x2aac941e5f4a738b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7392 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788540931.334816:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788540931.334819:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a6839117000 from 1 10000000:01000000:2.0:1788540931.334822:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788540931.334852:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: 00000000d490e8eb/0x2aac941e5f4a7399 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540931.334860:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: 00000000d490e8eb/0x2aac941e5f4a7399 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540931.334901:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: 00000000d490e8eb/0x2aac941e5f4a7399 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540931.334920:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d346db3e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980981120:0@lo:101: 00000100:00100000:2.0:1788540931.334952:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540931.334977:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set 00000000549004e5 going to sleep for 11 seconds 00000100:00100000:1.0:1788540931.335117:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980981120 00000100:00100000:1.0:1788540931.335122:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980981120 00000100:00100000:1.0:1788540931.335153:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788540931.335159:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000946043cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+12:6514:x1875420980981120:12345-0@lo:101: 00010000:00010000:1.0:1788540931.335178:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788540931.335190:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d37481b6/0x2aac941e5f4a73a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a7399 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.335209:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d37481b6/0x2aac941e5f4a73a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a7399 expref: 13 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.335219:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d37481b6/0x2aac941e5f4a73a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a7399 expref: 13 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.335227:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d37481b6, rc 0) 00000100:00100000:1.0:1788540931.335257:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000946043cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+13:6514:x1875420980981120:12345-0@lo:101: Request processed in 98us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540931.335271:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788540931.335304:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d346db3e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980981120:0@lo:101: 00010000:00010000:1.0:1788540931.335314:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: 00000000d490e8eb/0x2aac941e5f4a7399 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a73a0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.335322:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: 00000000d490e8eb/0x2aac941e5f4a7399 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a73a0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540931.335373:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007b6594dc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980981248:0@lo:501: 00000100:00100000:1.0:1788540931.335396:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540931.335408:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set 0000000061091870 going to sleep for 11 seconds 00000100:00100000:1.0:1788540931.335417:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980981248 00000100:00100000:1.0:1788540931.335420:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980981248 00000100:00100000:1.0:1788540931.335438:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788540931.335443:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000042e8ca0d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+13:6514:x1875420980981248:12345-0@lo:501: 00000100:00100000:1.0:1788540931.335546:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000042e8ca0d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+13:6514:x1875420980981248:12345-0@lo:501: Request processed in 103us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540931.335552:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788540931.335579:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007b6594dc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980981248:0@lo:501: 00000100:00100000:1.0:1788540931.335619:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007b6594dc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980981376:0@lo:503: 00000100:00100000:1.0:1788540931.335658:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540931.335671:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set 0000000061091870 going to sleep for 11 seconds 00000100:00100000:1.0:1788540931.335683:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980981376 00000100:00100000:1.0:1788540931.335687:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980981376 00000100:00100000:1.0:1788540931.335721:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788540931.335729:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003dc58de4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+13:6514:x1875420980981376:12345-0@lo:503: 00000100:00100000:1.0:1788540931.335807:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003dc58de4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+13:6514:x1875420980981376:12345-0@lo:503: Request processed in 80us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540931.335813:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788540931.335845:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007b6594dc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980981376:0@lo:503: 00000100:00100000:1.0:1788540931.336342:0:7926:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007b6594dc pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:7926:1875420980981504:0@lo:502: 00000100:00100000:1.0:1788540931.336381:0:7926:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540931.338416:0:7926:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bd255645 going to sleep for 11 seconds 00000100:00100000:2.0:1788540931.346699:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980981504 00000100:00100000:2.0:1788540931.346724:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980981504 00000100:00100000:3.0:1788540931.350254:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788540931.350270:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d46ee440 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+13:7926:x1875420980981504:12345-0@lo:502: 00000100:00100000:3.0:1788540931.350461:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d46ee440 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+13:7926:x1875420980981504:12345-0@lo:502: Request processed in 194us (14079us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540931.350471:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788540931.350565:0:7926:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007b6594dc pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:7926:1875420980981504:0@lo:502: 00000020:01000000:2.0:1788540931.350600:0:7926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788540931.350610:0:7926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788540931.350612:0:7926:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788540931.350618:0:7926:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a6839117000 00000020:00000080:2.0:1788540931.350620:0:7926:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788540931.350671:0:7926:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6805676d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:7926:1875420980981632:0@lo:502: 00000100:00100000:2.0:1788540931.351849:0:7926:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540931.361520:0:7926:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683530a780 going to sleep for 11 seconds 00000100:00100000:1.0:1788540931.367073:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980981632 00000100:00100000:1.0:1788540931.367090:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980981632 00000100:00100000:1.0:1788540931.367162:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788540931.367183:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+13:7926:x1875420980981632:12345-0@lo:502: 00000100:00100000:1.0:1788540931.367394:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+13:7926:x1875420980981632:12345-0@lo:502: Request processed in 212us (15548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540931.367402:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788540931.370314:0:7926:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6805676d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:7926:1875420980981632:0@lo:502: 00000020:01000000:1.0:1788540931.370385:0:7926:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788540931.370398:0:7926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788540931.370401:0:7926:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788540931.370405:0:7926:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1788540931.370485:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788540931.370503:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788540931.370513:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6842048600/0x2aac941e5f4a7399 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a73a0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.370525:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a6842048600/0x2aac941e5f4a7399 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a73a0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788540931.370554:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788540931.370557:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a68112dc000 from 21 10000000:01000000:1.0:1788540931.370560:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788540931.370611:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6812044a00/0x2aac941e5f4a73a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.370619:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a6812044a00/0x2aac941e5f4a73a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.370629:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a6812044a00/0x2aac941e5f4a73a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540931.370649:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980981760:0@lo:101: 00000100:00100000:1.0:1788540931.370713:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540931.370748:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683f241840 going to sleep for 11 seconds 00000100:00100000:1.0:1788540931.370766:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980981760 00000100:00100000:1.0:1788540931.370772:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980981760 00000100:00100000:1.0:1788540931.370810:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788540931.370818:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+13:6514:x1875420980981760:12345-0@lo:101: 00010000:00010000:1.0:1788540931.370831:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788540931.370843:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6812045600/0x2aac941e5f4a73ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a73a7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.370866:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6812045600/0x2aac941e5f4a73ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a73a7 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.370910:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6812045600/0x2aac941e5f4a73ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a73a7 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.370930:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6812045600, rc 0) 00000100:00100000:1.0:1788540931.370970:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+14:6514:x1875420980981760:12345-0@lo:101: Request processed in 152us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540931.370977:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788540931.371135:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980981760:0@lo:101: 00010000:00010000:1.0:1788540931.371147:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a6812044a00/0x2aac941e5f4a73a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a73ae expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.371155:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a6812044a00/0x2aac941e5f4a73a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a73ae expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540931.371214:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980981888:0@lo:501: 00000100:00100000:1.0:1788540931.371238:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540931.371245:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683f241840 going to sleep for 11 seconds 00000100:00100000:1.0:1788540931.371261:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980981888 00000100:00100000:1.0:1788540931.371263:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980981888 00000100:00100000:1.0:1788540931.371280:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788540931.371285:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807636c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+14:6514:x1875420980981888:12345-0@lo:501: 00000100:00100000:1.0:1788540931.371394:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807636c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+14:6514:x1875420980981888:12345-0@lo:501: Request processed in 108us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540931.371401:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788540931.371422:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980981888:0@lo:501: 00000100:00100000:1.0:1788540931.371446:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980982016:0@lo:503: 00000100:00100000:1.0:1788540931.371481:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540931.371489:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683f241840 going to sleep for 11 seconds 00000100:00100000:1.0:1788540931.371511:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980982016 00000100:00100000:1.0:1788540931.371515:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980982016 00000100:00100000:1.0:1788540931.371530:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788540931.371535:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807634450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+14:6514:x1875420980982016:12345-0@lo:503: 00000100:00100000:1.0:1788540931.371611:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807634450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+14:6514:x1875420980982016:12345-0@lo:503: Request processed in 74us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540931.371617:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788540931.371649:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980982016:0@lo:503: 00000100:00100000:2.0:1788540931.384378:0:7930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6805677800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:7930:1875420980982144:0@lo:502: 00000100:00100000:2.0:1788540931.384467:0:7930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540931.384520:0:7930:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683530a480 going to sleep for 11 seconds 00000100:00100000:1.0:1788540931.384636:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980982144 00000100:00100000:1.0:1788540931.384644:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980982144 00000100:00100000:1.0:1788540931.384694:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788540931.384705:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807634050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+14:7930:x1875420980982144:12345-0@lo:502: 00000100:00100000:1.0:1788540931.384832:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807634050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+14:7930:x1875420980982144:12345-0@lo:502: Request processed in 128us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540931.384840:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788540931.387155:0:7930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6805677800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:7930:1875420980982144:0@lo:502: 00000100:00100000:2.0:1788540931.387264:0:7930:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6805677800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:7930:1875420980982272:0@lo:502: 00000100:00100000:2.0:1788540931.387344:0:7930:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540931.387561:0:7930:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683530a480 going to sleep for 11 seconds 00000100:00100000:2.0:1788540931.388148:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980982272 00000100:00100000:2.0:1788540931.388157:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980982272 00000100:00100000:1.0:1788540931.390312:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788540931.390339:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807635c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+14:7930:x1875420980982272:12345-0@lo:502: 00000100:00100000:1.0:1788540931.390520:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807635c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+14:7930:x1875420980982272:12345-0@lo:502: Request processed in 194us (3175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540931.390528:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788540931.396507:0:7930:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6805677800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:7930:1875420980982272:0@lo:502: 00000040:00080000:3.0:1788540931.396551:0:7930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1788540931.403005:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1788540931.403047:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788540931.403067:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6812044a00/0x2aac941e5f4a73a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a73ae expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540931.403084:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a6812044a00/0x2aac941e5f4a73a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a73ae expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788540931.403111:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788540931.403114:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a68112dc000 from 4 10000000:01000000:0.0:1788540931.403117:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788540931.403174:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75f200/0x2aac941e5f4a73b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540931.403182:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a682e75f200/0x2aac941e5f4a73b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540931.403192:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a682e75f200/0x2aac941e5f4a73b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540931.403215:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6811425180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980982400:0@lo:101: 00000100:00100000:0.0:1788540931.403283:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540931.408840:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68076fbe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788540931.409271:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980982400 00000100:00100000:1.0:1788540931.409282:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980982400 00000100:00100000:1.0:1788540931.409336:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788540931.409347:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+14:6514:x1875420980982400:12345-0@lo:101: 00010000:00010000:1.0:1788540931.409362:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788540931.409381:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6812045c00/0x2aac941e5f4a73bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a73b5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.409435:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6812045c00/0x2aac941e5f4a73bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a73b5 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.409447:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6812045c00/0x2aac941e5f4a73bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a73b5 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.409456:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6812045c00, rc 0) 00000100:00100000:1.0:1788540931.409525:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+15:6514:x1875420980982400:12345-0@lo:101: Request processed in 181us (6241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540931.409532:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788540931.409573:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6811425180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980982400:0@lo:101: 00010000:00010000:1.0:1788540931.409590:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a682e75f200/0x2aac941e5f4a73b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a73bc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.409611:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a682e75f200/0x2aac941e5f4a73b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a73bc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540931.409680:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980982528:0@lo:256: 00000100:00100000:1.0:1788540931.409726:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540931.409737:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683f241480 going to sleep for 11 seconds 00000100:00100000:1.0:1788540931.409755:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980982528 00000100:00100000:1.0:1788540931.409759:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980982528 00000100:00100000:1.0:1788540931.409776:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788540931.409782:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+15:6514:x1875420980982528:12345-0@lo:256: 20000000:01000000:1.0:1788540931.409797:0:6512:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788540931.409813:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788540931.409817:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1788540931.410090:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+15:6514:x1875420980982528:12345-0@lo:256: Request processed in 307us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540931.410097:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788540931.410122:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980982528:0@lo:256: 10000000:01000000:1.0:1788540931.410163:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788540931.410266:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75f200/0x2aac941e5f4a73b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a73bc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.410275:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a682e75f200/0x2aac941e5f4a73b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a73bc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788540931.410284:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788540931.410286:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1788540931.410289:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788540931.410309:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6812044c00/0x2aac941e5f4a73c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.410316:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a6812044c00/0x2aac941e5f4a73c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.410325:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a6812044c00/0x2aac941e5f4a73c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540931.410337:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980982656:0@lo:101: 00000100:00100000:1.0:1788540931.410362:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540931.410371:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6802daed80 going to sleep for 11 seconds 00000100:00100000:1.0:1788540931.410388:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980982656 00000100:00100000:1.0:1788540931.410392:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980982656 00000100:00100000:1.0:1788540931.410410:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788540931.410416:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807636850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+15:6514:x1875420980982656:12345-0@lo:101: 00010000:00010000:1.0:1788540931.410429:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788540931.410437:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6812044200/0x2aac941e5f4a73ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a73c3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.410451:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6812044200/0x2aac941e5f4a73ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a73c3 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.410460:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6812044200/0x2aac941e5f4a73ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a73c3 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.410467:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6812044200, rc 0) 00000100:00100000:1.0:1788540931.410495:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807636850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+16:6514:x1875420980982656:12345-0@lo:101: Request processed in 79us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540931.410502:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788540931.410523:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980982656:0@lo:101: 00010000:00010000:1.0:1788540931.410533:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a6812044c00/0x2aac941e5f4a73c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a73ca expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.410541:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a6812044c00/0x2aac941e5f4a73c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a73ca expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540931.410593:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980982784:0@lo:501: 00000100:00100000:1.0:1788540931.411759:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540931.411774:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6802daed80 going to sleep for 11 seconds 00000100:00100000:1.0:1788540931.411800:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980982784 00000100:00100000:1.0:1788540931.411805:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980982784 00000100:00100000:1.0:1788540931.411831:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788540931.411838:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e78bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+16:6514:x1875420980982784:12345-0@lo:501: 00000100:00100000:1.0:1788540931.413135:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e78bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+16:6514:x1875420980982784:12345-0@lo:501: Request processed in 1292us (1371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540931.413146:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788540931.413326:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980982784:0@lo:501: 00000100:00100000:3.0:1788540931.413382:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980982912:0@lo:503: 00000100:00100000:3.0:1788540931.413425:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540931.413949:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6809a93780 going to sleep for 11 seconds 00000100:00100000:1.0:1788540931.415067:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980982912 00000100:00100000:1.0:1788540931.415079:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980982912 00000100:00100000:1.0:1788540931.415182:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788540931.415192:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e78a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+16:6514:x1875420980982912:12345-0@lo:503: 00000100:00100000:1.0:1788540931.415344:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e78a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+16:6514:x1875420980982912:12345-0@lo:503: Request processed in 154us (1918us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540931.415353:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788540931.415438:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980982912:0@lo:503: 00000100:00100000:3.0:1788540931.415672:0:7932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:7932:1875420980983040:0@lo:502: 00000100:00100000:3.0:1788540931.415718:0:7932:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540931.425235:0:7932:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6809a933c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788540931.425347:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980983040 00000100:00100000:0.0:1788540931.425357:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980983040 00000100:00100000:0.0:1788540931.425465:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788540931.425475:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e78a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+16:7932:x1875420980983040:12345-0@lo:502: 00000100:00100000:0.0:1788540931.425652:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e78a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+16:7932:x1875420980983040:12345-0@lo:502: Request processed in 178us (9933us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540931.425660:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788540931.429137:0:7932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:7932:1875420980983040:0@lo:502: 00000020:01000000:2.0:1788540931.429191:0:7932:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788540931.429207:0:7932:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788540931.429209:0:7932:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1788540931.429214:0:7932:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788540931.429218:0:7932:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.156@tcp to nid 0x20000c0a8ca9c (192.168.202.156@tcp) 00000020:00000080:2.0:1788540931.429246:0:7932:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788540931.429262:0:7932:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9a683f36cd40) 00000020:00000080:2.0:1788540931.429282:0:7932:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:2.0:1788540931.429287:0:7932:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788540931.429391:0:7932:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1788540931.429397:0:7932:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788540931.429404:0:7932:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2aac941e5f4a73d8 00010000:00080000:2.0:1788540931.429431:0:7932:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a683f37d000@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.156@tcp at head 00010000:00010000:2.0:1788540931.433701:0:7932:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:1.0:1788540931.445438:0:7932:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788540931.445455:0:7932:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788540931.445497:0:7932:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788540931.445520:0:7932:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2aac941e5f4a73df 00000100:00080000:1.0:1788540931.445531:0:7932:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788540931.445537:0:7932:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a683f37d000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:1.0:1788540931.445574:0:7932:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a68045f5f80 x1875420980983168/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788540931.445610:0:7932:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:1.0:1788540931.445644:0:7932:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:3.0:1788540931.445924:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420980983424:0@lo:400: 00000100:00100000:3.0:1788540931.445989:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540931.446035:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788540931.446041:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875420980983296:0@lo:400: 00000100:00100000:3.0:1788540931.446066:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540931.446093:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875420980983552:0@lo:400: 00000100:00100000:3.0:1788540931.446117:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540931.446155:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980983424 00000100:00100000:3.0:1788540931.446162:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980983424 00000100:00100000:3.0:1788540931.446213:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788540931.446223:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420980983424:12345-0@lo:400: 00000100:00100000:3.0:1788540931.446277:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420980983424:12345-0@lo:400: Request processed in 55us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540931.446284:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788540931.446306:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980983296 00000100:00100000:3.0:1788540931.446310:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980983296 00000100:00100000:3.0:1788540931.446333:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980983552 00000100:00100000:3.0:1788540931.446336:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980983552 00000100:00100000:3.0:1788540931.446350:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788540931.446364:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875420980983296:12345-0@lo:400: 00000100:00100000:3.0:1788540931.446398:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875420980983296:12345-0@lo:400: Request processed in 35us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540931.446405:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788540931.446417:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788540931.446423:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875420980983552:12345-0@lo:400: 00000100:00100000:3.0:1788540931.446452:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875420980983552:12345-0@lo:400: Request processed in 30us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540931.446458:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788540931.446495:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a68045e2680 x1875420980983296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540931.446509:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875420980983296:0@lo:400: 00000100:00100000:3.0:1788540931.446521:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420980983424:0@lo:400: 00010000:00080000:3.0:1788540931.446550:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a68045e0e00 x1875420980983552/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540931.446559:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875420980983552:0@lo:400: 00000100:00080000:3.0:1788540931.449506:0:7936:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff9a68045e0e00 x1875420980983680/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540931.449522:0:7936:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6809a93d80 going to sleep for 0 seconds 00000020:01000000:1.0:1788540931.449925:0:7932:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788540931.449932:0:7932:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788540931.449934:0:7932:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1788540931.449937:0:7932:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788540931.449941:0:7932:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788540931.449943:0:7932:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788540931.449946:0:7932:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788540931.449948:0:7932:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788540931.449986:0:7932:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:7932:1875420980983808:0@lo:502: 00000100:00100000:1.0:1788540931.450061:0:7932:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540931.450101:0:7932:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6802dae840 going to sleep for 11 seconds 00000100:00100000:3.0:1788540931.450156:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980983808 00000100:00100000:3.0:1788540931.450173:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980983808 00000100:00100000:3.0:1788540931.450227:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788540931.450238:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e78a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+16:7932:x1875420980983808:12345-0@lo:502: 00000100:00100000:3.0:1788540931.450381:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e78a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+16:7932:x1875420980983808:12345-0@lo:502: Request processed in 143us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540931.450397:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788540931.450490:0:7932:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:7932:1875420980983808:0@lo:502: 00000020:01000000:1.0:1788540931.450516:0:7932:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788540931.450520:0:7932:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788540931.450521:0:7932:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788540931.450526:0:7932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1788540931.451047:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1788540931.451067:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788540931.451077:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6812044c00/0x2aac941e5f4a73c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a73ca expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540931.451089:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a6812044c00/0x2aac941e5f4a73c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a73ca expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788540931.451098:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788540931.451101:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a68112dc000 from 1 10000000:01000000:3.0:1788540931.451103:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788540931.451130:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6842173200/0x2aac941e5f4a73e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540931.451138:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a6842173200/0x2aac941e5f4a73e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540931.451148:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a6842173200/0x2aac941e5f4a73e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540931.451163:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980983936:0@lo:101: 00000100:00100000:3.0:1788540931.451210:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540931.451233:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6809a93300 going to sleep for 11 seconds 00000100:00100000:1.0:1788540931.451289:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980983936 00000100:00100000:1.0:1788540931.451295:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980983936 00000100:00100000:1.0:1788540931.451331:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788540931.451339:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e788c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+16:6514:x1875420980983936:12345-0@lo:101: 00010000:00010000:1.0:1788540931.451348:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788540931.451360:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6812044000/0x2aac941e5f4a73ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a73e6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.451383:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6812044000/0x2aac941e5f4a73ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a73e6 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.451394:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6812044000/0x2aac941e5f4a73ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a73e6 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.451403:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6812044000, rc 0) 00000100:00100000:1.0:1788540931.451438:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e788c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+17:6514:x1875420980983936:12345-0@lo:101: Request processed in 99us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540931.451444:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788540931.451477:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980983936:0@lo:101: 00010000:00010000:1.0:1788540931.451491:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a6842173200/0x2aac941e5f4a73e6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a73ed expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.451509:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a6842173200/0x2aac941e5f4a73e6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a73ed expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540931.451563:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980984064:0@lo:501: 00000100:00100000:1.0:1788540931.451587:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540931.451658:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6802daee40 going to sleep for 11 seconds 00000100:00100000:1.0:1788540931.451671:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980984064 00000100:00100000:1.0:1788540931.451675:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980984064 00000100:00100000:1.0:1788540931.451697:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788540931.451703:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e78b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+17:6514:x1875420980984064:12345-0@lo:501: 00000100:00100000:1.0:1788540931.451800:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e78b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+17:6514:x1875420980984064:12345-0@lo:501: Request processed in 97us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540931.451806:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788540931.451833:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980984064:0@lo:501: 00000100:00100000:1.0:1788540931.451859:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980984192:0@lo:503: 00000100:00100000:1.0:1788540931.451917:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540931.451930:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6802daee40 going to sleep for 11 seconds 00000100:00100000:1.0:1788540931.451940:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980984192 00000100:00100000:1.0:1788540931.451944:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980984192 00000100:00100000:1.0:1788540931.451965:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788540931.451970:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e78b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+17:6514:x1875420980984192:12345-0@lo:503: 00000100:00100000:1.0:1788540931.452036:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e78b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+17:6514:x1875420980984192:12345-0@lo:503: Request processed in 65us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540931.452042:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788540931.452082:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980984192:0@lo:503: 00000100:00100000:0.0:1788540931.452569:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420980983168:0@lo:38: 00000100:00100000:0.0:1788540931.452671:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540931.452726:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980983168 00000100:00100000:0.0:1788540931.452731:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980983168 00000100:00100000:0.0:1788540931.452755:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788540931.452760:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6811426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875420980983168:12345-0@lo:38: 00010000:00080000:0.0:1788540931.452792:0:6522:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 212 last 0 00000020:00000080:0.0:1788540931.452826:0:6522:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2aac941e5f4a73f4 00000004:00100000:0.0:1788540931.452842:0:6522:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788540931.452848:0:6522:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1788540931.471661:0:7937:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:7937:1875420980984320:0@lo:502: 00000100:00100000:3.0:1788540931.471745:0:7937:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540931.471791:0:7937:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6809a93300 going to sleep for 11 seconds 00000100:00100000:1.0:1788540931.471944:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980984320 00000100:00100000:1.0:1788540931.471951:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980984320 00000100:00100000:1.0:1788540931.471999:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788540931.472009:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e789450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+17:7937:x1875420980984320:12345-0@lo:502: 00000100:00100000:1.0:1788540931.472125:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e789450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+17:7937:x1875420980984320:12345-0@lo:502: Request processed in 117us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540931.472133:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788540931.472249:0:7937:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:7937:1875420980984320:0@lo:502: 00000020:01000000:3.0:1788540931.472287:0:7937:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788540931.472296:0:7937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788540931.472299:0:7937:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788540931.472305:0:7937:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a68112dc000 00000020:00000080:3.0:1788540931.472308:0:7937:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788540931.472331:0:7937:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:7937:1875420980984448:0@lo:502: 00000100:00100000:3.0:1788540931.472364:0:7937:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540931.472389:0:7937:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6808989d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788540931.472429:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980984448 00000100:00100000:1.0:1788540931.472433:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980984448 00000100:00100000:1.0:1788540931.472462:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788540931.472470:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e789c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+17:7937:x1875420980984448:12345-0@lo:502: 00000100:00100000:1.0:1788540931.472530:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e789c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+17:7937:x1875420980984448:12345-0@lo:502: Request processed in 60us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540931.472536:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788540931.472692:0:7937:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:7937:1875420980984448:0@lo:502: 00000020:01000000:3.0:1788540931.472710:0:7937:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788540931.472715:0:7937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788540931.472716:0:7937:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788540931.472720:0:7937:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1788540931.472863:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788540931.472908:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788540931.472919:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6842173200/0x2aac941e5f4a73e6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a73ed expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.472930:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a6842173200/0x2aac941e5f4a73e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a73ed expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788540931.472939:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788540931.472941:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9a682e74b380 from 1 10000000:01000000:1.0:1788540931.472944:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788540931.472967:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6812044e00/0x2aac941e5f4a73fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.472975:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a6812044e00/0x2aac941e5f4a73fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540931.472990:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a6812044e00/0x2aac941e5f4a73fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540931.473002:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980984576:0@lo:101: 00000100:00100000:1.0:1788540931.473031:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540931.473048:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6802dae240 going to sleep for 11 seconds 00000100:00100000:3.0:1788540931.473102:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980984576 00000100:00100000:3.0:1788540931.473106:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980984576 00000100:00100000:3.0:1788540931.473138:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788540931.473145:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+17:6514:x1875420980984576:12345-0@lo:101: 00010000:00010000:3.0:1788540931.473154:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788540931.473177:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6842172c00/0x2aac941e5f4a7402 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a73fb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540931.473199:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6842172c00/0x2aac941e5f4a7402 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a73fb expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540931.473211:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6842172c00/0x2aac941e5f4a7402 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a73fb expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540931.473220:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6842172c00, rc 0) 00000100:00100000:3.0:1788540931.473253:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+18:6514:x1875420980984576:12345-0@lo:101: Request processed in 108us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540931.473265:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788540931.473297:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980984576:0@lo:101: 00010000:00010000:3.0:1788540931.473309:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a6812044e00/0x2aac941e5f4a73fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7402 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540931.473318:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a6812044e00/0x2aac941e5f4a73fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a7402 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540931.473368:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980984704:0@lo:501: 00000100:00100000:3.0:1788540931.473395:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540931.473409:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6808989480 going to sleep for 11 seconds 00000100:00100000:3.0:1788540931.473421:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980984704 00000100:00100000:3.0:1788540931.473425:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980984704 00000100:00100000:3.0:1788540931.473450:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788540931.473455:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+18:6514:x1875420980984704:12345-0@lo:501: 00000100:00100000:3.0:1788540931.473529:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+18:6514:x1875420980984704:12345-0@lo:501: Request processed in 72us (132us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788540931.473535:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788540931.473560:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980984704:0@lo:501: 10000000:01000000:3.0:1788540931.473578:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788540931.473583:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6812044e00/0x2aac941e5f4a73fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7402 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540931.473589:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a6812044e00/0x2aac941e5f4a73fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7402 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788540931.492463:0:6522:0:(import.c:65:import_set_state_nolock()) ffff9a683517d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788540931.492582:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6811426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1875420980983168:12345-0@lo:38: Request processed in 39818us (39909us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540931.492594:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788540931.509182:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788540931.509201:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788540931.509216:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788540931.509222:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788540931.509227:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a683f37d000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788540931.509248:0:3640:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000ef2f5132): req@ffff9a68045e0e00 x1875420980983680/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788540931.509268:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420980983168:0@lo:38: 00000100:00100000:2.0:1788540931.510061:0:7936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540931.510103:0:7936:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6809a93d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788540931.510201:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980983680 00000100:00100000:0.0:1788540931.510209:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980983680 00000100:00100000:3.0:1788540931.510394:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6805676a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420980984832:0@lo:41: 00000100:00100000:3.0:1788540931.510436:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540931.515843:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980984832 00000100:00100000:0.0:1788540931.515864:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980984832 00000100:00100000:0.0:1788540931.515947:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788540931.515958:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6805677480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7936:x1875420980983680:12345-0@lo:1000: 00000100:00100000:0.0:1788540931.516100:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6805677480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7936:x1875420980983680:12345-0@lo:1000: Request processed in 143us (6040us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540931.516108:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788540931.516126:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788540931.516132:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1875420980984832:12345-0@lo:41: 00000004:00000024:0.0:1788540931.516153:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1788540931.516215:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1875420980984832:12345-0@lo:41: Request processed in 83us (5778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540931.516222:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788540931.516279:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6805676a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420980984832:0@lo:41: 00000100:00100000:2.0:1788540931.516481:0:7936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e0e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7936:1875420980983680:0@lo:1000: 00000040:01000000:2.0:1788540931.516518:0:7936:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788540931.516564:0:7936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6805674e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7936:1875420980984960:0@lo:1000: 00000100:00100000:2.0:1788540931.516607:0:7936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540931.516634:0:7936:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683530a300 going to sleep for 11 seconds 00000100:00100000:0.0:1788540931.518716:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980984960 00000100:00100000:0.0:1788540931.518732:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980984960 00000100:00100000:0.0:1788540931.518792:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788540931.518818:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6805674380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7936:x1875420980984960:12345-0@lo:1000: 00000100:00100000:0.0:1788540931.519000:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6805674380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7936:x1875420980984960:12345-0@lo:1000: Request processed in 183us (2392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540931.519007:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788540931.519025:0:7936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6805674e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7936:1875420980984960:0@lo:1000: 00000100:00100000:2.0:1788540931.519086:0:7936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6805674e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7936:1875420980985088:0@lo:700: 00000100:00100000:2.0:1788540931.519119:0:7936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540931.519146:0:7936:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683530a840 going to sleep for 11 seconds 00000100:00100000:1.0:1788540931.519517:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980985088 00000100:00100000:1.0:1788540931.519524:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980985088 00000100:00100000:1.0:1788540931.519566:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788540931.519576:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6805676680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7936:x1875420980985088:12345-0@lo:700: 00000100:00100000:1.0:1788540931.519640:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6805676680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7936:x1875420980985088:12345-0@lo:700: Request processed in 66us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540931.519648:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788540931.519908:0:7936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6805674e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7936:1875420980985088:0@lo:700: 00000100:00100000:2.0:1788540931.520027:0:7936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6805674e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7936:1875420980985216:0@lo:1000: 00000100:00100000:2.0:1788540931.520057:0:7936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540931.520077:0:7936:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683530ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788540931.520309:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980985216 00000100:00100000:0.0:1788540931.520314:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980985216 00000100:00100000:0.0:1788540931.520348:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788540931.520355:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6805676a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7936:x1875420980985216:12345-0@lo:1000: 00000100:00100000:0.0:1788540931.520475:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6805676a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7936:x1875420980985216:12345-0@lo:1000: Request processed in 119us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540931.520482:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788540931.522627:0:7936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6805674e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7936:1875420980985216:0@lo:1000: 00000004:00080000:1.0:1788540931.522706:0:7936:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9a683530a840 with version 0 00000020:00100000:1.0:1788540931.522734:0:7936:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788540931.522743:0:7936:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9a68045f4000 x1875420980985472/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788540931.522763:0:7936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f4000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7936:1875420980985472:0@lo:1000: 00000100:00100000:1.0:1788540931.522822:0:7936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540931.522958:0:7936:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6802dae780 going to sleep for 11 seconds 00000100:00100000:0.0:1788540931.525779:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980985472 00000100:00100000:0.0:1788540931.525801:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980985472 00000100:00100000:0.0:1788540931.525866:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788540931.525894:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7936:x1875420980985472:12345-0@lo:1000: 00010000:00010000:2.0:1788540931.529971:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788540931.531796:0:7448:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:1.0:1788540931.531809:0:7448:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788540931.532106:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7936:x1875420980985472:12345-0@lo:1000: Request processed in 6208us (9276us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788540931.532122:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:1.0:1788540931.533047:0:7936:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1788540931.533055:0:7936:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788540931.533077:0:7936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f4000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7936:1875420980985472:0@lo:1000: 00000100:00100000:1.0:1788540931.533218:0:7936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f4000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7936:1875420980985600:0@lo:1000: 00000100:00100000:1.0:1788540931.533281:0:7936:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540931.533327:0:7936:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6802daec00 going to sleep for 11 seconds 00000100:00100000:2.0:1788540931.533345:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980985600 00000100:00100000:2.0:1788540931.533352:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980985600 00000100:00100000:2.0:1788540931.533403:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788540931.533411:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7936:x1875420980985600:12345-0@lo:1000: 00000100:00100000:2.0:1788540931.533517:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7936:x1875420980985600:12345-0@lo:1000: Request processed in 106us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540931.533524:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788540931.534021:0:7936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f4000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7936:1875420980985600:0@lo:1000: 00000040:00080000:1.0:1788540931.534042:0:7936:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1788540931.534072:0:7936:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9a6802dae780 with version 1 00000004:00080000:2.0:1788540931.534249:0:7933:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9a683530a9c0 version 1 rpc_version 1 00000020:00100000:2.0:1788540931.534280:0:7933:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788540931.534289:0:7933:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9a6805677800 x1875420980985856/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788540931.534306:0:7933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6805677800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7933:1875420980985856:0@lo:1000: 00000100:00100000:2.0:1788540931.534351:0:7933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540931.534388:0:7933:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683530a540 going to sleep for 11 seconds 00000100:00100000:0.0:1788540931.534682:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980985856 00000100:00100000:0.0:1788540931.534689:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980985856 00000100:00100000:0.0:1788540931.534734:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788540931.534743:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6805676d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7933:x1875420980985856:12345-0@lo:1000: 00000040:00080000:1.0:1788540931.538563:0:7936:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788540931.538663:0:7936:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788540931.538667:0:7936:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:1.0:1788540931.545569:0:7448:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:2.0:1788540931.545786:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6805676d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7933:x1875420980985856:12345-0@lo:1000: Request processed in 11038us (11428us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788540931.545801:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:1.0:1788540931.545981:0:7933:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1788540931.545998:0:7933:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788540931.546017:0:7933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6805677800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7933:1875420980985856:0@lo:1000: 00000100:00100000:3.0:1788540932.045224:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420980985984:0@lo:41: 00000100:00100000:3.0:1788540932.045303:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540932.045382:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980985984 00000100:00100000:3.0:1788540932.045388:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980985984 00000100:00100000:3.0:1788540932.045427:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788540932.045433:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420980985984:12345-0@lo:41: 00000004:00000024:3.0:1788540932.045461:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1788540932.045501:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420980985984:12345-0@lo:41: Request processed in 67us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540932.045508:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788540932.045556:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420980985984:0@lo:41: 00010000:00010000:3.0:1788540932.554112:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788540933.580224:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788540934.602281:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788540935.628446:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788540936.655368:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875420980986496:0@lo:400: 00000100:00100000:1.0:1788540936.655447:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540936.655506:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788540936.655513:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420980986112:0@lo:400: 00000100:00100000:1.0:1788540936.655543:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540936.655566:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420980986624:0@lo:400: 00000100:00100000:1.0:1788540936.655593:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540936.655619:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980986496 00000100:00100000:1.0:1788540936.655641:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980986496 00000100:00100000:1.0:1788540936.655692:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788540936.655702:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875420980986496:12345-0@lo:400: 00000100:00100000:1.0:1788540936.655754:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875420980986496:12345-0@lo:400: Request processed in 54us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540936.655777:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788540936.655803:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980986112 00000100:00100000:1.0:1788540936.655807:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980986112 00000100:00100000:1.0:1788540936.655834:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788540936.655841:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+18:3643:x1875420980986112:12345-0@lo:400: 00000100:00100000:1.0:1788540936.655896:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+18:3643:x1875420980986112:12345-0@lo:400: Request processed in 56us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540936.655903:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788540936.655949:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420980986112:0@lo:400: 00010000:00080000:1.0:1788540936.655963:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a68045f5c00 x1875420980986496/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540936.655975:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875420980986496:0@lo:400: 00000100:00100000:3.0:1788540936.656102:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980986624 00000100:00100000:3.0:1788540936.656107:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980986624 00000100:00100000:3.0:1788540936.656146:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788540936.656152:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420980986624:12345-0@lo:400: 00000100:00100000:3.0:1788540936.656207:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420980986624:12345-0@lo:400: Request processed in 55us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540936.656214:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788540936.656486:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420980986624:0@lo:400: 00000100:00100000:2.0:1788540936.656568:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875420980986240:0@lo:400: 00000100:00100000:2.0:1788540936.656601:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540936.656640:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788540936.656647:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420980986368:0@lo:400: 00000100:00100000:2.0:1788540936.656671:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540936.656732:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980986368 00000100:00100000:2.0:1788540936.656736:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980986368 00000100:00100000:2.0:1788540936.656761:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788540936.656768:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6805675180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420980986368:12345-0@lo:400: 00000100:00100000:2.0:1788540936.656804:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6805675180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420980986368:12345-0@lo:400: Request processed in 36us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540936.656810:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788540936.656835:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420980986368:0@lo:400: 00010000:00010000:1.0:1788540936.660314:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788540936.660439:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980986240 00000100:00100000:3.0:1788540936.660450:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980986240 00000100:00100000:3.0:1788540936.660518:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788540936.660529:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6805675f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875420980986240:12345-0@lo:400: 00000100:00100000:3.0:1788540936.660646:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6805675f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875420980986240:12345-0@lo:400: Request processed in 119us (4044us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540936.660665:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788540936.661862:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420980986752:0@lo:41: 00000100:00100000:3.0:1788540936.661952:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788540936.661997:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a68045f6d80 x1875420980986240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540936.662013:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875420980986240:0@lo:400: 00000100:00100000:2.0:1788540936.668151:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980986752 00000100:00100000:2.0:1788540936.668169:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980986752 00000100:00100000:2.0:1788540936.668229:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788540936.668239:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420980986752:12345-0@lo:41: 00000004:00000024:2.0:1788540936.668280:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1788540936.668368:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420980986752:12345-0@lo:41: Request processed in 130us (6415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540936.668375:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788540936.668426:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420980986752:0@lo:41: 00000100:00100000:2.0:1788540937.163799:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420980986880:0@lo:41: 00000100:00100000:2.0:1788540937.163915:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540937.163957:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980986880 00000100:00100000:3.0:1788540937.163966:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980986880 00000100:00100000:3.0:1788540937.164017:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788540937.164026:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6805675c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420980986880:12345-0@lo:41: 00000004:00000024:3.0:1788540937.164064:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1788540937.164138:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6805675c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420980986880:12345-0@lo:41: Request processed in 111us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540937.164146:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788540937.164222:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420980986880:0@lo:41: 00010000:00010000:1.0:1788540937.676589:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788540938.698537:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540939.722738:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788540940.746151:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788540941.034418:0:8424:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788540941.034423:0:8424:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788540941.034424:0:8424:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788540941.035167:0:8424:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a683533b800 00000020:01000004:1.0:1788540941.035184:0:8424:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788540941.035196:0:8424:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788540941.035218:0:8424:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9a6835583380) 00000020:00000080:1.0:1788540941.035234:0:8424:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788540941.083234:0:8424:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788540941.083296:0:8424:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:3.0:1788540941.114535:0:8424:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788540941.114771:0:8424:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788540941.114784:0:8424:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788540941.114796:0:8424:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2aac941e5f4a7410 00000020:01000004:3.0:1788540941.114803:0:8424:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788540941.114823:0:8424:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.156@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788540941.114826:0:8424:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.156@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788540941.114831:0:8424:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788540941.114835:0:8424:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788540941.114846:0:8424:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9a682fe08000) 00000020:00000080:3.0:1788540941.114862:0:8424:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:3.0:1788540941.119595:0:8424:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788540941.120091:0:8424:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788540941.120099:0:8424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788540941.123517:0:8424:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788540941.123530:0:8424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788540941.125461:0:8424:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788540941.125469:0:8424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788540941.128764:0:8424:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788540941.129331:0:8424:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788540941.129337:0:8424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788540941.130530:0:8424:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788540941.130540:0:8424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788540941.155322:0:8424:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788540941.155581:0:8424:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788540941.155646:0:8424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788540941.157229:0:8424:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788540941.157242:0:8424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788540941.158846:0:8424:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788540941.158862:0:8424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788540941.163403:0:8424:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788540941.164139:0:8424:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788540941.164148:0:8424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788540941.164821:0:8424:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788540941.164829:0:8424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788540941.235297:0:8424:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788540941.235532:0:8424:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788540941.235540:0:8424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788540941.239847:0:8424:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788540941.239865:0:8424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788540941.240672:0:8424:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788540941.240702:0:8424:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1788540941.240709:0:8424:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.156@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788540941.257525:0:8424:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.156@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788540941.257558:0:8424:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.156@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1788540941.257561:0:8424:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788540941.257563:0:8424:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788540941.257564:0:8424:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788540941.257565:0:8424:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788540941.257566:0:8424:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788540941.257567:0:8424:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788540941.257568:0:8424:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788540941.257569:0:8424:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788540941.257572:0:8424:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788540941.257574:0:8424:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788540941.257575:0:8424:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788540941.257579:0:8424:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1788540941.257580:0:8424:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788540941.257581:0:8424:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788540941.257582:0:8424:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788540941.257582:0:8424:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788540941.257583:0:8424:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788540941.257584:0:8424:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788540941.257584:0:8424:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788540941.257585:0:8424:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788540941.257585:0:8424:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788540941.257586:0:8424:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788540941.257587:0:8424:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788540941.257614:0:8424:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788540941.257633:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6805677800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:8424:1875420980987008:0@lo:253: 00000100:00100000:2.0:1788540941.257783:0:8424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540941.257844:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68076fb6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788540941.257965:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980987008 00000100:00100000:1.0:1788540941.257972:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980987008 00000100:00100000:1.0:1788540941.258029:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788540941.258040:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+18:8424:x1875420980987008:12345-0@lo:253: 20000000:01000000:1.0:1788540941.258190:0:6509:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788540941.258195:0:6509:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1788540941.258201:0:6509:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1788540941.258204:0:6509:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1788540941.258424:0:6509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788540941.258568:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1788540941.258590:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1788540941.258608:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1788540941.258716:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1788540941.258736:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1788540941.258753:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1788540941.258848:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1788540941.258865:0:6509:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.156@tcp 20000000:01000000:1.0:1788540941.258867:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.156@tcp (null) (null) (null) 00000040:00080000:1.0:1788540941.259067:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1788540941.259086:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788540941.259103:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1788540941.259111:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.156@tcp (null) (null) 00000040:00080000:1.0:1788540941.259125:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1788540941.259131:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788540941.259143:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1788540941.259161:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1788540941.259250:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:1.0:1788540941.259263:0:6509:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.156@tcp 20000000:01000000:1.0:1788540941.259265:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.156@tcp (null) (null) (null) 00000040:00080000:1.0:1788540941.259280:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:1.0:1788540941.259285:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788540941.259299:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:1.0:1788540941.259305:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.202.156@tcp (null) (null) 00000040:00080000:1.0:1788540941.259318:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:1.0:1788540941.259324:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788540941.259338:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:1.0:1788540941.259354:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:1.0:1788540941.261491:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:1.0:1788540941.263600:0:6509:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.156@tcp 20000000:01000000:1.0:1788540941.263606:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.156@tcp (null) (null) (null) 00000040:00080000:1.0:1788540941.263725:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:1.0:1788540941.263738:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788540941.263754:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:1.0:1788540941.263761:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.156@tcp (null) (null) 00000040:00080000:1.0:1788540941.263776:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:1.0:1788540941.263784:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788540941.263798:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:1.0:1788540941.263815:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:1.0:1788540941.263835:0:6509:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788540941.263838:0:6509:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788540941.263842:0:6509:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788540941.264280:0:6509:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788540941.264284:0:6509:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788540941.268417:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1788540941.277092:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1788540941.277128:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1788540941.277144:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1788540941.277156:0:6509:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788540941.277159:0:6509:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788540941.277766:0:8443:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 18 1->4: lustre sys.timeout 20000000:01000000:2.0:1788540941.277794:0:8443:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 18 2->4: lustre sys.timeout 00000040:00080000:2.0:1788540941.277811:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1788540941.278051:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:3.0:1788540941.278084:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:3.0:1788540941.278104:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:3.0:1788540941.278117:0:6509:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788540941.278119:0:6509:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788540941.279528:0:8444:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:3.0:1788540941.279569:0:8444:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:3.0:1788540941.279587:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:1.0:1788540941.279851:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:1.0:1788540941.279979:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:1.0:1788540941.279998:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:1.0:1788540941.280010:0:6509:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788540941.280013:0:6509:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788540941.280547:0:8445:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:1.0:1788540941.280574:0:8445:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:1.0:1788540941.280592:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1788540941.280855:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1788540941.281023:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1788540941.281046:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:3.0:1788540941.281065:0:6509:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788540941.281097:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a6842173400/0x2aac941e5f4a741e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540941.281116:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6812045200/0x2aac941e5f4a72ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a72e3 expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540941.281130:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a682e75fc00/0x2aac941e5f4a7361 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a735a expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540941.281137:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6812045600/0x2aac941e5f4a73ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a73a7 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540941.281143:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6812044200/0x2aac941e5f4a73ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a73c3 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540941.281149:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6842172c00/0x2aac941e5f4a7402 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a73fb expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540941.281155:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a6842173400/0x2aac941e5f4a741e lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540941.281194:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6842172c00/0x2aac941e5f4a7402 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a73fb expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540941.281209:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6842172c00/0x2aac941e5f4a7402 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a73fb expref: 18 pid: 6512 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540941.281225:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e2d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6509:1875420980987136:0@lo:104: 00000100:00100000:3.0:1788540941.281772:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788540941.281941:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6812044200/0x2aac941e5f4a73ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a73c3 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540941.281951:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6812044200/0x2aac941e5f4a73ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a73c3 expref: 18 pid: 6512 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540941.281961:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e3800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6509:1875420980987264:0@lo:104: 00000100:00100000:3.0:1788540941.281999:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788540941.287819:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6812045600/0x2aac941e5f4a73ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a73a7 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540941.287840:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6812045600/0x2aac941e5f4a73ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a73a7 expref: 18 pid: 6512 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540941.287856:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e0700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6509:1875420980987392:0@lo:104: 00000100:00100000:3.0:1788540941.287946:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540941.292179:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980987136 00000100:00100000:0.0:1788540941.292208:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980987136 00000100:00100000:0.0:1788540941.292283:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980987264 00000100:00100000:0.0:1788540941.292286:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980987264 00000100:00100000:0.0:1788540941.292831:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788540941.292858:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:425687b6-1d99-41d2-88d8-2fb230997596+4:6509:x1875420980987136:12345-0@lo:104: 00010000:00010000:0.0:1788540941.292972:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a6812044e00/0x2aac941e5f4a73fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a7402 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540941.293093:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788540941.293100:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:425687b6-1d99-41d2-88d8-2fb230997596+4:6509:x1875420980987136:12345-0@lo:104: Request processed in 245us (11330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540941.293108:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788540941.293128:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788540941.293135:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:425687b6-1d99-41d2-88d8-2fb230997596+3:6509:x1875420980987264:12345-0@lo:104: 00010000:00010000:0.0:1788540941.293144:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a6812044c00/0x2aac941e5f4a73c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a73ca expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540941.293179:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788540941.293184:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:425687b6-1d99-41d2-88d8-2fb230997596+3:6509:x1875420980987264:12345-0@lo:104: Request processed in 51us (11185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540941.294372:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1788540941.294603:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788540941.294612:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a6812044e00/0x2aac941e5f4a73fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a7402 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.294621:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6812044e00 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:1.0:1788540941.294625:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a6812044e00/0x2aac941e5f4a73fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a7402 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.294635:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a6812044e00/0x2aac941e5f4a73fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a7402 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788540941.294642:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a6812044e00/0x2aac941e5f4a73fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a7402 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788540941.294648:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788540941.294694:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a6812044e00/0x2aac941e5f4a73fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7402 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.294712:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788540941.294739:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a6812044e00/0x2aac941e5f4a73fb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7402 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.294747:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a6812044e00/0x2aac941e5f4a73fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7402 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.294780:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788540941.294784:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a6812044c00/0x2aac941e5f4a73c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a73ca expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.294789:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6812044c00 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:1.0:1788540941.294793:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a6812044c00/0x2aac941e5f4a73c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a73ca expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.294800:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a6812044c00/0x2aac941e5f4a73c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a73ca expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788540941.294806:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a6812044c00/0x2aac941e5f4a73c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a73ca expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788540941.294811:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788540941.294826:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a6812044c00/0x2aac941e5f4a73c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a73ca expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.294832:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788540941.294837:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a6812044c00/0x2aac941e5f4a73c3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a73ca expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.294844:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a6812044c00/0x2aac941e5f4a73c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a73ca expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.294852:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788540941.294853:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788540941.294855:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788540941.294861:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788540941.294907:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420980987520:0@lo:103: 00000100:00100000:1.0:1788540941.295157:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540941.295276:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788540941.295283:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420980987648:0@lo:103: 00000100:00100000:1.0:1788540941.295317:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540941.295460:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980987520 00000100:00100000:1.0:1788540941.295467:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980987520 00010000:00010000:1.0:1788540941.295493:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6842172c00/0x2aac941e5f4a7402 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a73fb expref: 19 pid: 6512 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540941.295516:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980987648 00000100:00100000:1.0:1788540941.295519:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980987648 00010000:00010000:1.0:1788540941.295532:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6812044200/0x2aac941e5f4a73ca lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a73c3 expref: 20 pid: 6512 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540941.295545:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788540941.295553:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+20:3643:x1875420980987520:12345-0@lo:103: 00010000:00010000:1.0:1788540941.295565:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788540941.295582:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6842172c00/0x2aac941e5f4a7402 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a73fb expref: 20 pid: 6512 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.295594:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6842172c00/0x2aac941e5f4a7402 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a73fb expref: 20 pid: 6512 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.295612:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788540941.295645:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+20:3643:x1875420980987520:12345-0@lo:103: Request processed in 93us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540941.295652:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788540941.295667:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788540941.295673:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+19:3643:x1875420980987648:12345-0@lo:103: 00010000:00010000:1.0:1788540941.295688:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788540941.295693:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6812044200/0x2aac941e5f4a73ca lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a73c3 expref: 19 pid: 6512 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.296058:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6812044200/0x2aac941e5f4a73ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a73c3 expref: 19 pid: 6512 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.296069:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788540941.296111:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+19:3643:x1875420980987648:12345-0@lo:103: Request processed in 438us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540941.296118:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788540941.296159:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420980987648:0@lo:103: 00000100:00100000:1.0:1788540941.296168:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420980987520:0@lo:103: 00010000:00010000:3.0:1788540941.296761:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a682e75fc00/0x2aac941e5f4a7361 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a735a expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540941.296772:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a682e75fc00/0x2aac941e5f4a7361 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a735a expref: 18 pid: 6509 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540941.296783:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e0380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6509:1875420980987776:0@lo:104: 00000100:00100000:3.0:1788540941.296833:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788540941.296857:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6812045200/0x2aac941e5f4a72ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a72e3 expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540941.296865:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6812045200/0x2aac941e5f4a72ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a72e3 expref: 18 pid: 6509 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540941.296907:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa5c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6509:1875420980987904:0@lo:104: 00000100:00100000:3.0:1788540941.297053:0:6509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540941.297065:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683530aa80 going to sleep for 11 seconds 00010000:00010000:3.0:1788540941.297091:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6842172c00/0x2aac941e5f4a7402 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a73fb expref: 18 pid: 6512 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540941.297105:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e2d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6509:1875420980987136:0@lo:104: 00010000:00010000:3.0:1788540941.297126:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6812044200/0x2aac941e5f4a73ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a73c3 expref: 17 pid: 6512 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540941.297136:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e3800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6509:1875420980987264:0@lo:104: 00000100:00100000:0.0:1788540941.298063:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980987392 00000100:00100000:0.0:1788540941.298072:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980987392 00000100:00100000:0.0:1788540941.298117:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980987776 00000100:00100000:0.0:1788540941.298120:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980987776 00000100:00100000:0.0:1788540941.298130:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980987904 00000100:00100000:0.0:1788540941.298132:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980987904 00000100:00100000:0.0:1788540941.298143:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788540941.298150:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:425687b6-1d99-41d2-88d8-2fb230997596+5:6509:x1875420980987392:12345-0@lo:104: 00010000:00010000:0.0:1788540941.298164:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a6812044a00/0x2aac941e5f4a73a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a73ae expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540941.298243:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788540941.298257:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:425687b6-1d99-41d2-88d8-2fb230997596+5:6509:x1875420980987392:12345-0@lo:104: Request processed in 107us (10312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540941.298264:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788540941.298279:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788540941.298284:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:425687b6-1d99-41d2-88d8-2fb230997596+4:6509:x1875420980987776:12345-0@lo:104: 00010000:00010000:0.0:1788540941.298310:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a6842048800/0x2aac941e5f4a735a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a7361 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.298674:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788540941.298682:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a6812044a00/0x2aac941e5f4a73a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a73ae expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.298689:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6812044a00 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:1.0:1788540941.298693:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a6812044a00/0x2aac941e5f4a73a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a73ae expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.298713:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a6812044a00/0x2aac941e5f4a73a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a73ae expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788540941.298721:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a6812044a00/0x2aac941e5f4a73a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a73ae expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788540941.298727:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788540941.298775:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a6812044a00/0x2aac941e5f4a73a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a73ae expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.298788:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788540941.298810:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a6812044a00/0x2aac941e5f4a73a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a73ae expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.298818:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a6812044a00/0x2aac941e5f4a73a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a73ae expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.298832:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788540941.298833:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788540941.298835:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788540941.298851:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420980988032:0@lo:103: 00000100:00100000:1.0:1788540941.299099:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540941.299159:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980988032 00000100:00100000:1.0:1788540941.299164:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980988032 00010000:00010000:1.0:1788540941.299197:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6812045600/0x2aac941e5f4a73ae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a73a7 expref: 17 pid: 6512 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540941.299221:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788540941.299229:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+17:3641:x1875420980988032:12345-0@lo:103: 00010000:00010000:1.0:1788540941.299253:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788540941.299259:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6812045600/0x2aac941e5f4a73ae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a73a7 expref: 17 pid: 6512 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.299269:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6812045600/0x2aac941e5f4a73ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a73a7 expref: 17 pid: 6512 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.299285:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788540941.299326:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+17:3641:x1875420980988032:12345-0@lo:103: Request processed in 97us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540941.299540:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788540941.299763:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420980988032:0@lo:103: 00010000:00010000:0.0:1788540941.300239:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788540941.300248:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:425687b6-1d99-41d2-88d8-2fb230997596+4:6509:x1875420980987776:12345-0@lo:104: Request processed in 1962us (3414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540941.300256:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788540941.300278:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788540941.300287:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:425687b6-1d99-41d2-88d8-2fb230997596+3:6509:x1875420980987904:12345-0@lo:104: 00010000:00010000:0.0:1788540941.300496:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a6842172000/0x2aac941e5f4a72e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a72ea expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540941.300661:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788540941.300666:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:425687b6-1d99-41d2-88d8-2fb230997596+3:6509:x1875420980987904:12345-0@lo:104: Request processed in 383us (3614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540941.300672:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1788540941.301039:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6812045600/0x2aac941e5f4a73ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a73a7 expref: 16 pid: 6512 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540941.301051:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e0700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6509:1875420980987392:0@lo:104: 00000100:00100000:3.0:1788540941.301061:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e0380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6509:1875420980987776:0@lo:104: 00000100:00100000:3.0:1788540941.301067:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa5c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6509:1875420980987904:0@lo:104: 00010000:00010000:3.0:1788540941.301106:0:6509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a6842173400/0x2aac941e5f4a741e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.301329:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788540941.301329:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788540941.301335:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a6842172000/0x2aac941e5f4a72e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a72ea expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540941.301343:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842172000 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:0.0:1788540941.301346:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a6842172000/0x2aac941e5f4a72e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a72ea expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540941.301370:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a6842172000/0x2aac941e5f4a72e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a72ea expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788540941.301377:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a6842172000/0x2aac941e5f4a72e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a72ea expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788540941.301383:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788540941.301459:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a6842172000/0x2aac941e5f4a72e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a72ea expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540941.301466:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788540941.301491:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a6842172000/0x2aac941e5f4a72e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a72ea expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540941.301499:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a6842172000/0x2aac941e5f4a72e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a72ea expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540941.301510:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788540941.301512:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788540941.301513:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788540941.301516:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788540941.301539:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6811424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420980988160:0@lo:103: 00000100:00100000:1.0:1788540941.301590:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788540941.302158:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788540941.302165:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a6842048800/0x2aac941e5f4a735a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a7361 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.302172:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842048800 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:1.0:1788540941.302175:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a6842048800/0x2aac941e5f4a735a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a7361 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.302183:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a6842048800/0x2aac941e5f4a735a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a7361 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540941.302224:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980988160 00000100:00100000:0.0:1788540941.302230:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980988160 00010000:00010000:0.0:1788540941.302254:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6812045200/0x2aac941e5f4a72ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a72e3 expref: 16 pid: 6509 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540941.302281:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788540941.302288:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:425687b6-1d99-41d2-88d8-2fb230997596+16:3641:x1875420980988160:12345-0@lo:103: 00010000:00010000:0.0:1788540941.302299:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788540941.302304:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6812045200/0x2aac941e5f4a72ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a72e3 expref: 16 pid: 6509 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540941.302323:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6812045200/0x2aac941e5f4a72ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a72e3 expref: 16 pid: 6509 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540941.302339:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6812045200/0x2aac941e5f4a72ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a72e3 expref: 16 pid: 6509 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540941.302352:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788540941.302398:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:425687b6-1d99-41d2-88d8-2fb230997596+15:3641:x1875420980988160:12345-0@lo:103: Request processed in 110us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540941.302404:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788540941.302442:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6811424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420980988160:0@lo:103: 10000000:00010000:1.0:1788540941.303061:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a6842048800/0x2aac941e5f4a735a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a7361 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788540941.303067:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788540941.308609:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a6842048800/0x2aac941e5f4a735a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7361 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.308627:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788540941.308658:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a6842048800/0x2aac941e5f4a735a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7361 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.308666:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a6842048800/0x2aac941e5f4a735a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7361 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540941.308675:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420980988288:0@lo:103: 00010000:00010000:1.0:1788540941.308697:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788540941.308710:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788540941.308712:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788540941.308740:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540941.308926:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980988288 00000100:00100000:1.0:1788540941.308934:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980988288 00010000:00010000:1.0:1788540941.308968:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a682e75fc00/0x2aac941e5f4a7361 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a735a expref: 15 pid: 6509 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540941.309000:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788540941.309010:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680763fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:425687b6-1d99-41d2-88d8-2fb230997596+15:3643:x1875420980988288:12345-0@lo:103: 00010000:00010000:1.0:1788540941.309024:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788540941.309028:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a682e75fc00/0x2aac941e5f4a7361 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a735a expref: 15 pid: 6509 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.309039:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a682e75fc00/0x2aac941e5f4a7361 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a735a expref: 15 pid: 6509 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.309053:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a682e75fc00/0x2aac941e5f4a7361 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a735a expref: 15 pid: 6509 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.309068:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a6842173400/0x2aac941e5f4a741e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.309107:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6842173400/0x2aac941e5f4a741e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.309124:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6842173400/0x2aac941e5f4a741e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.309132:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6842173400/0x2aac941e5f4a741e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.309145:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a6842173400/0x2aac941e5f4a741e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.309153:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a6842173400/0x2aac941e5f4a741e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.309159:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842173400 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:1.0:1788540941.309163:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a6842173400/0x2aac941e5f4a741e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.309171:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a6842173400/0x2aac941e5f4a741e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.309199:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a6842173400/0x2aac941e5f4a741e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.309210:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788540941.309252:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680763fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:425687b6-1d99-41d2-88d8-2fb230997596+14:3643:x1875420980988288:12345-0@lo:103: Request processed in 242us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540941.309260:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788540941.309333:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420980988288:0@lo:103: 00010000:00010000:3.0:1788540941.309797:0:6509:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a6842173400/0x2aac941e5f4a741e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540941.309807:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a6842173400/0x2aac941e5f4a741e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540941.309814:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6842173400/0x2aac941e5f4a741e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788540941.309828:0:6509:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:2.0:1788540941.312014:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540941.312021:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788540941.315922:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+13:8424:x1875420980987008:12345-0@lo:253: Request processed in 57874us (58129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540941.315937:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788540941.316061:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6805677800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:8424:1875420980987008:0@lo:253: 10000000:01000000:2.0:1788540941.316089:0:8424:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788540941.316093:0:8424:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788540941.316095:0:8424:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788540941.316096:0:8424:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788540941.316097:0:8424:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1788540941.316098:0:8424:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788540941.316099:0:8424:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788540941.316100:0:8424:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788540941.316102:0:8424:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788540941.316104:0:8424:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788540941.316120:0:8424:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788540941.316141:0:8424:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a683533b800 from lustre-OST0000 10000000:01000000:2.0:1788540941.316172:0:8424:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788540941.316175:0:8424:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788540941.316182:0:8424:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a682e74b380 local copy 10000000:01000000:2.0:1788540941.316185:0:8424:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788540941.316224:0:8424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6842048800/0x2aac941e5f4a7425 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540941.316235:0:8424:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.156@tcp lock: ffff9a6842048800/0x2aac941e5f4a7425 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540941.316246:0:8424:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a6842048800/0x2aac941e5f4a7425 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540941.316263:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6805677800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:8424:1875420980988416:0@lo:101: 00000100:00100000:2.0:1788540941.316297:0:8424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540941.316330:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68076fb6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788540941.316433:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980988416 00000100:00100000:1.0:1788540941.316440:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980988416 00000100:00100000:1.0:1788540941.316484:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788540941.316494:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+13:8424:x1875420980988416:12345-0@lo:101: 00010000:00010000:1.0:1788540941.316507:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788540941.316640:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a68354dbc00/0x2aac941e5f4a742c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a7425 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.316676:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68354dbc00/0x2aac941e5f4a742c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a7425 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.316686:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a68354dbc00/0x2aac941e5f4a742c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a7425 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.316696:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68354dbc00, rc 0) 00000100:00100000:1.0:1788540941.316806:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+14:8424:x1875420980988416:12345-0@lo:101: Request processed in 314us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540941.316813:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788540941.316953:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6805677800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:8424:1875420980988416:0@lo:101: 00010000:00010000:2.0:1788540941.316966:0:8424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a6842048800/0x2aac941e5f4a7425 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x2aac941e5f4a742c expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540941.316975:0:8424:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a6842048800/0x2aac941e5f4a7425 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2aac941e5f4a742c expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540941.317097:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6805677800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:8424:1875420980988544:0@lo:501: 00000100:00100000:2.0:1788540941.317123:0:8424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540941.317149:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68076fb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788540941.317195:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980988544 00000100:00100000:3.0:1788540941.317199:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980988544 00000100:00100000:3.0:1788540941.317230:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788540941.317244:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+14:8424:x1875420980988544:12345-0@lo:501: 00000100:00100000:3.0:1788540941.317311:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+14:8424:x1875420980988544:12345-0@lo:501: Request processed in 68us (187us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788540941.317319:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788540941.317409:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6805677800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:8424:1875420980988544:0@lo:501: 10000000:01000000:2.0:1788540941.317421:0:8424:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.156@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788540941.317443:0:8424:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.156@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788540941.317449:0:8424:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6842048800/0x2aac941e5f4a7425 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2aac941e5f4a742c expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540941.317457:0:8424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6842048800/0x2aac941e5f4a7425 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2aac941e5f4a742c expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540941.317464:0:8424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.156@tcp lock: ffff9a6842048800/0x2aac941e5f4a7425 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2aac941e5f4a742c expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540941.317484:0:8424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788540941.317505:0:8424:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a683533b800 10000000:01000000:2.0:1788540941.317511:0:8424:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788540941.317516:0:8424:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788540941.317518:0:8424:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788540941.317522:0:8424:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788540941.317524:0:8424:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788540941.317541:0:8424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6842049e00/0x2aac941e5f4a7433 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540941.317549:0:8424:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a6842049e00/0x2aac941e5f4a7433 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540941.317556:0:8424:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a6842049e00/0x2aac941e5f4a7433 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540941.317568:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6805677800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:8424:1875420980988672:0@lo:101: 00000100:00100000:2.0:1788540941.317594:0:8424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540941.317625:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68076fb240 going to sleep for 11 seconds 00000100:00100000:1.0:1788540941.317659:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980988672 00000100:00100000:1.0:1788540941.317665:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980988672 00010000:00010000:0.0:1788540941.317678:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788540941.317685:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a6842048800/0x2aac941e5f4a7425 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x2aac941e5f4a742c expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540941.317693:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842048800 already unused, calling callback (ffffffffc150fc20) 00000100:00100000:1.0:1788540941.317696:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 10000000:00010000:0.0:1788540941.317697:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a6842048800/0x2aac941e5f4a7425 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x2aac941e5f4a742c expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540941.317706:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a6842048800/0x2aac941e5f4a7425 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x2aac941e5f4a742c expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540941.317710:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+14:8424:x1875420980988672:12345-0@lo:101: 10000000:00010000:0.0:1788540941.317713:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a6842048800/0x2aac941e5f4a7425 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x2aac941e5f4a742c expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.317717:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 10000000:01000000:0.0:1788540941.317719:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788540941.317725:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a68354db200/0x2aac941e5f4a743a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a7433 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.317739:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68354db200/0x2aac941e5f4a743a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a7433 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540941.317743:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a6842048800/0x2aac941e5f4a7425 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2aac941e5f4a742c expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.317747:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a68354db200/0x2aac941e5f4a743a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a7433 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540941.317748:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788540941.317754:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68354db200, rc 0) 00010000:00010000:0.0:1788540941.317780:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a6842048800/0x2aac941e5f4a7425 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2aac941e5f4a742c expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540941.317781:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+15:8424:x1875420980988672:12345-0@lo:101: Request processed in 72us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540941.317787:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00010000:0.0:1788540941.317787:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a6842048800/0x2aac941e5f4a7425 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2aac941e5f4a742c expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540941.317800:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788540941.317801:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788540941.317803:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788540941.317812:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788540941.317822:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6811424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420980988800:0@lo:103: 00000100:00100000:1.0:1788540941.317846:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540941.317860:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6805677800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:8424:1875420980988672:0@lo:101: 00010000:00010000:2.0:1788540941.317898:0:8424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a6842049e00/0x2aac941e5f4a7433 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a743a expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540941.317906:0:8424:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a6842049e00/0x2aac941e5f4a7433 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a743a expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540941.317958:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6805677800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:8424:1875420980988928:0@lo:501: 00000100:00100000:2.0:1788540941.317981:0:8424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540941.318001:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68076fb240 going to sleep for 11 seconds 00000100:00100000:0.0:1788540941.318073:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980988800 00000100:00100000:0.0:1788540941.318087:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980988800 00000100:00100000:0.0:1788540941.318120:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788540941.318122:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980988928 00000100:00100000:3.0:1788540941.318126:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980988928 00000100:00100000:0.0:1788540941.318127:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+15:3643:x1875420980988800:12345-0@lo:103: 00010000:00010000:0.0:1788540941.318136:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788540941.318144:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00010000:00010000:0.0:1788540941.318148:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a68354dbc00/0x2aac941e5f4a742c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2aac941e5f4a7425 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540941.318149:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+16:8424:x1875420980988928:12345-0@lo:501: 00010000:00010000:0.0:1788540941.318158:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788540941.318185:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+15:3643:x1875420980988800:12345-0@lo:103: Request processed in 59us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540941.318191:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788540941.318262:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+14:8424:x1875420980988928:12345-0@lo:501: Request processed in 112us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540941.318268:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788540941.318304:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6805677800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:8424:1875420980988928:0@lo:501: 00000100:00100000:0.0:1788540941.318330:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6811424a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:8424:1875420980989056:0@lo:503: 00000100:00100000:0.0:1788540941.318370:0:8424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540941.318393:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6808953c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788540941.318489:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980989056 00000100:00100000:3.0:1788540941.318493:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980989056 00000100:00100000:3.0:1788540941.318511:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788540941.318529:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+14:8424:x1875420980989056:12345-0@lo:503: 00000100:00100000:3.0:1788540941.318793:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+14:8424:x1875420980989056:12345-0@lo:503: Request processed in 275us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540941.318801:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788540941.318926:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6811424a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:8424:1875420980989056:0@lo:503: 00000040:00080000:0.0:1788540941.319193:0:8424:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788540941.319289:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6811424a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:8424:1875420980989184:0@lo:502: 00000100:00100000:0.0:1788540941.319328:0:8424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540941.319348:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6808953c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788540941.319498:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6811424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420980988800:0@lo:103: 00000100:00100000:1.0:1788540941.319532:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980989184 00000100:00100000:1.0:1788540941.319535:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980989184 00000100:00100000:1.0:1788540941.319557:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788540941.320040:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+14:8424:x1875420980989184:12345-0@lo:502: 00000100:00100000:1.0:1788540941.320176:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+14:8424:x1875420980989184:12345-0@lo:502: Request processed in 612us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540941.320183:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788540941.320463:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6811424a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:8424:1875420980989184:0@lo:502: 00000040:00080000:0.0:1788540941.320699:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788540941.320729:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788540941.320742:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788540941.320756:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788540941.320769:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788540941.320781:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788540941.320808:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6811424a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:8424:1875420980989312:0@lo:502: 00000100:00100000:0.0:1788540941.320850:0:8424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540941.320920:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6808953c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788540941.321132:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980989312 00000100:00100000:3.0:1788540941.321138:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980989312 00000100:00100000:3.0:1788540941.321175:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788540941.321182:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+14:8424:x1875420980989312:12345-0@lo:502: 00000100:00100000:3.0:1788540941.321283:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+14:8424:x1875420980989312:12345-0@lo:502: Request processed in 100us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540941.321290:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788540941.321384:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6811424a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:8424:1875420980989312:0@lo:502: 00000040:00080000:2.0:1788540941.321436:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788540941.321445:0:8424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1788540941.324054:0:8447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788540941.324067:0:8447:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1788540941.324083:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788540941.324085:0:8447:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788540941.324095:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788540941.324115:0:8447:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9a6835580000) 00000020:00000080:1.0:1788540941.324152:0:8447:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788540941.324159:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788540941.324240:0:8447:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a683533b800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788540941.324249:0:8447:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788540941.324255:0:8447:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2aac941e5f4a7448 00010000:00010000:0.0:1788540941.328123:0:8447:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:0.0:1788540941.328414:0:8447:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1788540941.337066:0:8447:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788540941.337492:0:8447:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1788540941.348475:0:8447:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1788540941.348670:0:8447:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1788540941.368332:0:8447:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1788540941.369803:0:8447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788540941.369816:0:8447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788540941.369823:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788540941.369826:0:8447:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788540941.369829:0:8447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788540941.369833:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788540941.369835:0:8447:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788540941.369838:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788540941.369840:0:8447:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788540941.369865:0:8447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788540941.369996:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788540941.369998:0:8447:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788540941.370003:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788540941.370166:0:8424:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1788540941.370195:0:8424:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788540941.370215:0:8424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6842049e00/0x2aac941e5f4a7433 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a743a expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540941.370227:0:8424:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a6842049e00/0x2aac941e5f4a7433 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a743a expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788540941.370236:0:8424:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a683533b800 from 1 10000000:01000000:2.0:1788540941.370239:0:8424:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788540941.370280:0:8424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6842049000/0x2aac941e5f4a744f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540941.370290:0:8424:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a6842049000/0x2aac941e5f4a744f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540941.370302:0:8424:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a6842049000/0x2aac941e5f4a744f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540941.370337:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6805674e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:8424:1875420980989440:0@lo:101: 00000100:00100000:2.0:1788540941.370421:0:8424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540941.370470:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68076fb240 going to sleep for 11 seconds 00000100:00100000:1.0:1788540941.371149:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980989440 00000100:00100000:1.0:1788540941.371159:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980989440 00000100:00100000:1.0:1788540941.371211:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788540941.371222:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+14:8424:x1875420980989440:12345-0@lo:101: 00010000:00010000:1.0:1788540941.371237:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788540941.371252:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a68354dac00/0x2aac941e5f4a7456 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a744f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.371293:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68354dac00/0x2aac941e5f4a7456 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a744f expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.371305:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a68354dac00/0x2aac941e5f4a7456 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a744f expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.371315:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68354dac00, rc 0) 00000100:00100000:1.0:1788540941.371362:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+15:8424:x1875420980989440:12345-0@lo:101: Request processed in 141us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540941.371369:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788540941.371500:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6805674e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:8424:1875420980989440:0@lo:101: 00010000:00010000:2.0:1788540941.371515:0:8424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a6842049000/0x2aac941e5f4a744f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7456 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540941.371524:0:8424:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a6842049000/0x2aac941e5f4a744f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a7456 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540941.371631:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6805674e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:8424:1875420980989568:0@lo:501: 00000100:00100000:2.0:1788540941.371664:0:8424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540941.371732:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68076fb240 going to sleep for 11 seconds 00000100:00100000:3.0:1788540941.379952:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980989568 00000100:00100000:3.0:1788540941.379971:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980989568 00000100:00100000:3.0:1788540941.380038:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788540941.380055:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+15:8424:x1875420980989568:12345-0@lo:501: 00000100:00100000:3.0:1788540941.380250:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+15:8424:x1875420980989568:12345-0@lo:501: Request processed in 202us (8584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540941.380258:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788540941.381568:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6805674e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:8424:1875420980989568:0@lo:501: 00000100:00100000:0.0:1788540941.381643:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6811425500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:8424:1875420980989696:0@lo:503: 00000100:00100000:0.0:1788540941.381707:0:8424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540941.381745:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6808953300 going to sleep for 11 seconds 00000100:00100000:1.0:1788540941.383005:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980989696 00000100:00100000:1.0:1788540941.383015:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980989696 00000100:00100000:1.0:1788540941.383061:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788540941.383070:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+15:8424:x1875420980989696:12345-0@lo:503: 00000100:00100000:1.0:1788540941.383232:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+15:8424:x1875420980989696:12345-0@lo:503: Request processed in 163us (1524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540941.383241:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788540941.383430:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6811425500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:8424:1875420980989696:0@lo:503: 00000040:00080000:0.0:1788540941.383848:0:8424:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788540941.384142:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6811425500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:8424:1875420980989824:0@lo:502: 00000100:00100000:0.0:1788540941.384197:0:8424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540941.384284:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6808953180 going to sleep for 11 seconds 00000100:00100000:2.0:1788540941.384531:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980989824 00000100:00100000:2.0:1788540941.384538:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980989824 00000100:00100000:2.0:1788540941.384761:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788540941.384773:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+15:8424:x1875420980989824:12345-0@lo:502: 00000100:00100000:2.0:1788540941.384982:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+15:8424:x1875420980989824:12345-0@lo:502: Request processed in 211us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540941.384989:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788540941.385094:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6811425500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:8424:1875420980989824:0@lo:502: 00000040:00080000:0.0:1788540941.385316:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788540941.385346:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788540941.385374:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6811425500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:8424:1875420980989952:0@lo:502: 00000100:00100000:0.0:1788540941.385414:0:8424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540941.388126:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6808953180 going to sleep for 11 seconds 00000100:00100000:1.0:1788540941.391908:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980989952 00000100:00100000:1.0:1788540941.391926:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980989952 00000100:00100000:1.0:1788540941.392011:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788540941.392022:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+15:8424:x1875420980989952:12345-0@lo:502: 00000100:00100000:1.0:1788540941.392205:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+15:8424:x1875420980989952:12345-0@lo:502: Request processed in 184us (6789us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540941.392214:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788540941.392450:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6811425500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:8424:1875420980989952:0@lo:502: 00000040:00080000:0.0:1788540941.392531:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788540941.392545:0:8424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788540941.394417:0:8451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788540941.394430:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788540941.394432:0:8451:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788540941.394438:0:8451:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a683533b800 00000020:00000080:0.0:1788540941.394441:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788540941.394453:0:8451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788540941.394455:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788540941.394456:0:8451:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788540941.394459:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788540941.394592:0:8424:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788540941.394632:0:8424:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788540941.394655:0:8424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6842049000/0x2aac941e5f4a744f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7456 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.394676:0:8424:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a6842049000/0x2aac941e5f4a744f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7456 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788540941.394736:0:8424:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788540941.394739:0:8424:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a683533b800 10000000:01000000:1.0:1788540941.394742:0:8424:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a683533b800 10000000:01000000:1.0:1788540941.394746:0:8424:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788540941.394752:0:8424:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a683533b800 from 1 10000000:01000000:1.0:1788540941.394755:0:8424:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788540941.394788:0:8424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68354da000/0x2aac941e5f4a745d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.394796:0:8424:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a68354da000/0x2aac941e5f4a745d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.394806:0:8424:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a68354da000/0x2aac941e5f4a745d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540941.394828:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:8424:1875420980990080:0@lo:101: 00000100:00100000:1.0:1788540941.395293:0:8424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540941.395338:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683572bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788540941.395385:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980990080 00000100:00100000:0.0:1788540941.395393:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980990080 00000100:00100000:0.0:1788540941.395426:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788540941.395436:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e778050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+15:8424:x1875420980990080:12345-0@lo:101: 00010000:00010000:0.0:1788540941.395449:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788540941.395463:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a682e75ea00/0x2aac941e5f4a7464 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a745d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540941.395485:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a682e75ea00/0x2aac941e5f4a7464 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a745d expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540941.395496:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a682e75ea00/0x2aac941e5f4a7464 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a745d expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540941.395513:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75ea00, rc 0) 00000100:00100000:0.0:1788540941.395562:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e778050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+16:8424:x1875420980990080:12345-0@lo:101: Request processed in 127us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540941.395569:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788540941.395786:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:8424:1875420980990080:0@lo:101: 00010000:00010000:1.0:1788540941.395800:0:8424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a68354da000/0x2aac941e5f4a745d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7464 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.395809:0:8424:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a68354da000/0x2aac941e5f4a745d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a7464 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540941.395957:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:8424:1875420980990208:0@lo:501: 00000100:00100000:1.0:1788540941.395985:0:8424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540941.396001:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683572bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788540941.396151:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980990208 00000100:00100000:0.0:1788540941.396156:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980990208 00000100:00100000:0.0:1788540941.396181:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788540941.396187:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e778850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+16:8424:x1875420980990208:12345-0@lo:501: 00000100:00100000:0.0:1788540941.396292:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e778850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+16:8424:x1875420980990208:12345-0@lo:501: Request processed in 104us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540941.396300:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788540941.396402:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:8424:1875420980990208:0@lo:501: 00000100:00100000:1.0:1788540941.396432:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:8424:1875420980990336:0@lo:503: 00000100:00100000:1.0:1788540941.396477:0:8424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540941.396504:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683572bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788540941.396542:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980990336 00000100:00100000:0.0:1788540941.396546:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980990336 00000100:00100000:0.0:1788540941.396575:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788540941.396581:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e77b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+16:8424:x1875420980990336:12345-0@lo:503: 00000100:00100000:0.0:1788540941.396836:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e77b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+16:8424:x1875420980990336:12345-0@lo:503: Request processed in 254us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540941.396843:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788540941.396997:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:8424:1875420980990336:0@lo:503: 00000040:00080000:2.0:1788540941.397276:0:8424:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788540941.397364:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6805674e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:8424:1875420980990464:0@lo:502: 00000100:00100000:2.0:1788540941.397407:0:8424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540941.397433:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68076fb3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788540941.397457:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980990464 00000100:00100000:2.0:1788540941.397461:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980990464 00000100:00100000:2.0:1788540941.397489:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788540941.397496:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e77bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+16:8424:x1875420980990464:12345-0@lo:502: 00000100:00100000:2.0:1788540941.397576:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e77bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+16:8424:x1875420980990464:12345-0@lo:502: Request processed in 79us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540941.397582:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788540941.397633:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6805674e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:8424:1875420980990464:0@lo:502: 00000040:00080000:2.0:1788540941.397847:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788540941.398527:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788540941.398557:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788540941.398572:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788540941.398592:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788540941.398605:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788540941.398678:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788540941.398696:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788540941.398712:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788540941.398724:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788540941.398738:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788540941.398752:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788540941.398786:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788540941.398800:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788540941.398813:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788540941.398826:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788540941.398841:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788540941.398854:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788540941.398866:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788540941.399426:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788540941.399446:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788540941.399461:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788540941.399474:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788540941.399498:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788540941.399530:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1788540941.399546:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1788540941.399560:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1788540941.399572:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1788540941.399600:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1788540941.399816:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1788540941.399834:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1788540941.399844:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1788540941.399854:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1788540941.399866:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1788540941.400114:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1788540941.400127:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1788540941.400137:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:2.0:1788540941.400180:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6805674e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:8424:1875420980990592:0@lo:502: 00000100:00100000:2.0:1788540941.400254:0:8424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540941.400332:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a681084bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788540941.400469:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980990592 00000100:00100000:0.0:1788540941.400477:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980990592 00000100:00100000:0.0:1788540941.400565:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788540941.400575:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e77a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+16:8424:x1875420980990592:12345-0@lo:502: 00000100:00100000:0.0:1788540941.400786:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e77a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+16:8424:x1875420980990592:12345-0@lo:502: Request processed in 211us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540941.400793:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788540941.400908:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6805674e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:8424:1875420980990592:0@lo:502: 00000040:00080000:1.0:1788540941.400965:0:8424:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1788540941.400976:0:8424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1788540941.401686:0:8452:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788540941.401703:0:8452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9a6835584d40) 00000020:00000080:1.0:1788540941.401724:0:8452:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1788540941.401817:0:8452:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a683533b800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788540941.401822:0:8452:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a683533b800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788540941.401824:0:8452:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a683533b800 3 00010000:00080000:1.0:1788540941.401853:0:8452:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a6705afc800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.156@tcp at head 00010000:00010000:1.0:1788540941.407257:0:8452:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:1.0:1788540941.408006:0:8452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788540941.408054:0:8452:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788540941.408069:0:8452:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x2aac941e5f4a7472 00000100:00080000:1.0:1788540941.408089:0:8452:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788540941.408096:0:8452:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a6705afc800 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:1.0:1788540941.408135:0:8452:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a68045f4700 x1875420980990720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788540941.408176:0:8452:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000020:01000004:1.0:1788540941.408396:0:8452:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788540941.408411:0:8452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9a68355819c0) 00000020:00000080:1.0:1788540941.408424:0:8452:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:1.0:1788540941.408484:0:8452:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a683533b800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788540941.408489:0:8452:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a683533b800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788540941.408491:0:8452:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a683533b800 3 00010000:00080000:1.0:1788540941.408519:0:8452:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a6705afd800@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.156@tcp at head 00010000:00010000:1.0:1788540941.410179:0:8452:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000100:00100000:2.0:1788540941.410306:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875420980990720:0@lo:38: 00000100:00100000:2.0:1788540941.410379:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540941.410454:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980990720 00000100:00100000:2.0:1788540941.410461:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980990720 00000100:00100000:2.0:1788540941.410496:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788540941.410503:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6805677800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875420980990720:12345-0@lo:38: 00010000:00080000:2.0:1788540941.410531:0:6517:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 222 last 0 00000020:00000080:2.0:1788540941.410576:0:6517:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x2aac941e5f4a7480 00000004:00100000:2.0:1788540941.410592:0:6517:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788540941.410627:0:6517:0:(import.c:65:import_set_state_nolock()) ffff9a683548b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788540941.410679:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6805677800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875420980990720:12345-0@lo:38: Request processed in 175us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540941.410697:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788540941.410743:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a68045f4700 x1875420980990720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788540951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788540941.410754:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788540941.410762:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1788540941.410771:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788540941.410776:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788540941.410779:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a6705afc800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788540941.410786:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875420980990720:0@lo:38: 00000100:00100000:0.0:1788540941.411419:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6811424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420980990976:0@lo:400: 00000100:00100000:0.0:1788540941.411470:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540941.411498:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788540941.411504:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6811425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875420980990848:0@lo:400: 00000100:00100000:0.0:1788540941.411527:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540941.411555:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6811426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875420980991104:0@lo:400: 00000100:00100000:0.0:1788540941.411577:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540941.411595:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788540941.411601:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6811424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420980991232:0@lo:400: 00000100:00100000:0.0:1788540941.411637:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540941.411671:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980990976 00000100:00100000:0.0:1788540941.411676:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980990976 00000100:00100000:0.0:1788540941.411701:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980991232 00000100:00100000:0.0:1788540941.411704:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980991232 00000100:00100000:0.0:1788540941.411719:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788540941.411725:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6811424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420980990976:12345-0@lo:400: 00000100:00100000:0.0:1788540941.411769:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6811424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420980990976:12345-0@lo:400: Request processed in 44us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540941.411777:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788540941.411792:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788540941.411799:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6811424380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420980991232:12345-0@lo:400: 00000100:00100000:0.0:1788540941.411829:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6811424380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420980991232:12345-0@lo:400: Request processed in 32us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540941.411835:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788540941.411853:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980990848 00000100:00100000:0.0:1788540941.411857:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980990848 00000100:00100000:0.0:1788540941.411902:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980991104 00000100:00100000:0.0:1788540941.412105:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980991104 00000100:00100000:0.0:1788540941.412127:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788540941.412140:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6811425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875420980990848:12345-0@lo:400: 00000100:00100000:0.0:1788540941.412173:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6811425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875420980990848:12345-0@lo:400: Request processed in 34us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540941.412181:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788540941.412194:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788540941.412200:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6811427800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875420980991104:12345-0@lo:400: 00000100:00100000:0.0:1788540941.412228:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6811427800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875420980991104:12345-0@lo:400: Request processed in 28us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540941.412233:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788540941.412269:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6811424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420980991232:0@lo:400: 00010000:00080000:0.0:1788540941.412280:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6811426a00 x1875420980991104/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540941.412300:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6811426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875420980991104:0@lo:400: 00010000:00080000:0.0:1788540941.412324:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6811425500 x1875420980990848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540941.412332:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6811425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875420980990848:0@lo:400: 00000100:00100000:0.0:1788540941.412341:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6811424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420980990976:0@lo:400: 00000020:00000080:1.0:1788540941.413061:0:8452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1788540941.413117:0:8452:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788540941.413130:0:8452:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x2aac941e5f4a7487 00000100:00080000:1.0:1788540941.413139:0:8452:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788540941.413145:0:8452:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9a6705afd800 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:1.0:1788540941.413176:0:8452:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a68045f6a00 x1875420980991360/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788540941.414771:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875420980991360:0@lo:38: 00000100:00100000:0.0:1788540941.414850:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788540941.414966:0:8452:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000040:00080000:1.0:1788540941.417194:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:0.0:1788540941.421511:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980991360 00000100:00100000:0.0:1788540941.421529:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980991360 00000100:00100000:0.0:1788540941.421574:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788540941.421583:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6811424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875420980991360:12345-0@lo:38: 00010000:00080000:0.0:1788540941.421617:0:6519:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 222 last 0 00000020:00000080:0.0:1788540941.421662:0:6519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x2aac941e5f4a748e 00000004:00100000:0.0:1788540941.421678:0:6519:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788540941.421713:0:6519:0:(import.c:65:import_set_state_nolock()) ffff9a6705aeb800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788540941.421799:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6811424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875420980991360:12345-0@lo:38: Request processed in 215us (6948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540941.421807:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788540941.421852:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a68045f6a00 x1875420980991360/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788540951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540941.421863:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788540941.421892:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1788540941.422993:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788540941.423001:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788540941.423005:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a6705afd800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788540941.423013:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875420980991360:0@lo:38: 00000020:01000000:2.0:1788540941.431564:0:8424:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1788540941.431614:0:8424:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788540941.431648:0:8424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68354da000/0x2aac941e5f4a745d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7464 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540941.431661:0:8424:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a68354da000/0x2aac941e5f4a745d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7464 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788540941.431727:0:8424:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788540941.431729:0:8424:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788540941.431731:0:8424:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788540941.431732:0:8424:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788540941.431733:0:8424:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788540941.431735:0:8424:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788540941.431736:0:8424:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788540941.431738:0:8424:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788540941.431739:0:8424:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788540941.431741:0:8424:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788540941.431742:0:8424:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788540941.431747:0:8424:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1788540941.431750:0:8424:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788540941.431757:0:8424:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788540941.431758:0:8424:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788540941.431759:0:8424:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788540941.431760:0:8424:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788540941.431761:0:8424:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788540941.431762:0:8424:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788540941.431763:0:8424:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788540941.431764:0:8424:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788540941.431765:0:8424:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788540941.431766:0:8424:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788540941.431792:0:8424:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788540941.431813:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6805674a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:8424:1875420980991488:0@lo:253: 00000100:00100000:2.0:1788540941.434197:0:8424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540941.434248:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683f1a7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788540941.434496:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980991488 00000100:00100000:3.0:1788540941.434505:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980991488 00000100:00100000:3.0:1788540941.434561:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788540941.434571:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e77a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+16:8424:x1875420980991488:12345-0@lo:253: 20000000:01000000:3.0:1788540941.434602:0:6509:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788540941.434617:0:6509:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788540941.441234:0:6509:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788540941.441256:0:6509:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788540941.441732:0:6533:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788540941.441738:0:6533:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788540941.441762:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a682e75e800/0x2aac941e5f4a7495 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540941.441782:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6812045400/0x2aac941e5f4a7392 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a738b expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540941.441790:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6812045c00/0x2aac941e5f4a73bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a73b5 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540941.441797:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a682e75e800/0x2aac941e5f4a7495 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540941.441840:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6812045c00/0x2aac941e5f4a73bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a73b5 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540941.441863:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6812045c00/0x2aac941e5f4a73bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a73b5 expref: 16 pid: 6512 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540941.441928:0:6533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6811425500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1875420980991616:0@lo:104: 00000100:00100000:0.0:1788540941.441996:0:6533:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788540941.442047:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6812045400/0x2aac941e5f4a7392 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a738b expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540941.442054:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6812045400/0x2aac941e5f4a7392 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a738b expref: 16 pid: 6511 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540941.442062:0:6533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6811426a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1875420980991744:0@lo:104: 00000100:00100000:0.0:1788540941.442095:0:6533:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6808953180 going to sleep for 11 seconds 00000100:00100000:3.0:1788540941.442373:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e77a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+16:8424:x1875420980991488:12345-0@lo:253: Request processed in 7802us (8182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540941.442383:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788540941.442537:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788540941.442555:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540941.442583:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980991616 00000100:00100000:1.0:1788540941.442591:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980991616 00000100:00100000:1.0:1788540941.442981:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980991744 00000100:00100000:1.0:1788540941.442986:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980991744 00000100:00100000:1.0:1788540941.443005:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788540941.443013:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f097c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:425687b6-1d99-41d2-88d8-2fb230997596+4:6533:x1875420980991616:12345-0@lo:104: 00010000:00010000:1.0:1788540941.443027:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a682e75f200/0x2aac941e5f4a73b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a73bc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.443110:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788540941.443116:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f097c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:425687b6-1d99-41d2-88d8-2fb230997596+4:6533:x1875420980991616:12345-0@lo:104: Request processed in 104us (1120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540941.443123:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788540941.443157:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788540941.443163:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:425687b6-1d99-41d2-88d8-2fb230997596+3:6533:x1875420980991744:12345-0@lo:104: 00010000:00010000:1.0:1788540941.443170:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a6842048e00/0x2aac941e5f4a738b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a7392 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.443201:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788540941.443206:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:425687b6-1d99-41d2-88d8-2fb230997596+3:6533:x1875420980991744:12345-0@lo:104: Request processed in 44us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540941.443212:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1788540941.443229:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788540941.443235:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a682e75f200/0x2aac941e5f4a73b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a73bc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.443242:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75f200 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:1.0:1788540941.443246:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a682e75f200/0x2aac941e5f4a73b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a73bc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.443256:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a682e75f200/0x2aac941e5f4a73b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a73bc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788540941.443262:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a682e75f200/0x2aac941e5f4a73b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a73bc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788540941.443267:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:0.0:1788540941.443528:0:6533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6811425500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1875420980991616:0@lo:104: 00000100:00100000:0.0:1788540941.443537:0:6533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6811426a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1875420980991744:0@lo:104: 00010000:00010000:0.0:1788540941.443558:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a682e75e800/0x2aac941e5f4a7495 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.443774:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a682e75f200/0x2aac941e5f4a73b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a73bc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.443782:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788540941.443806:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a682e75f200/0x2aac941e5f4a73b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a73bc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.443813:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a682e75f200/0x2aac941e5f4a73b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a73bc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.443827:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788540941.443830:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a6842048e00/0x2aac941e5f4a738b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a7392 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.443835:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842048e00 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:1.0:1788540941.443837:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a6842048e00/0x2aac941e5f4a738b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a7392 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.443844:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a6842048e00/0x2aac941e5f4a738b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a7392 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788540941.443849:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a6842048e00/0x2aac941e5f4a738b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a7392 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788540941.443854:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788540941.443866:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a6842048e00/0x2aac941e5f4a738b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7392 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540941.443944:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6805674a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:8424:1875420980991488:0@lo:253: 10000000:01000000:3.0:1788540941.443954:0:8424:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788540941.443958:0:8424:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788540941.443960:0:8424:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788540941.443961:0:8424:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788540941.443962:0:8424:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788540941.443964:0:8424:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788540941.443965:0:8424:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788540941.443966:0:8424:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788540941.443968:0:8424:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788540941.443969:0:8424:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788540941.443971:0:8424:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788540941.443973:0:8424:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788540941.443983:0:8424:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1788540941.447277:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788540941.447349:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a6842048e00/0x2aac941e5f4a738b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7392 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.447377:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a6842048e00/0x2aac941e5f4a738b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7392 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540941.447401:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788540941.447403:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788540941.447406:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788540941.447787:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420980991872:0@lo:103: 00000100:00100000:0.0:1788540941.447854:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540941.447927:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788540941.447934:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420980992000:0@lo:103: 00000100:00100000:0.0:1788540941.447955:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540941.447990:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980991872 00000100:00100000:0.0:1788540941.447997:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980991872 00010000:00010000:0.0:1788540941.448029:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6812045c00/0x2aac941e5f4a73bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a73b5 expref: 16 pid: 6512 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540941.448069:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980992000 00000100:00100000:0.0:1788540941.448085:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980992000 00010000:00010000:0.0:1788540941.448101:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6812045400/0x2aac941e5f4a7392 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a738b expref: 17 pid: 6511 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540941.448116:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788540941.448124:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6811426a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:425687b6-1d99-41d2-88d8-2fb230997596+17:3641:x1875420980991872:12345-0@lo:103: 00010000:00010000:0.0:1788540941.448137:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788540941.448142:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6812045c00/0x2aac941e5f4a73bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a73b5 expref: 17 pid: 6512 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540941.448153:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6812045c00/0x2aac941e5f4a73bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a73b5 expref: 17 pid: 6512 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540941.448169:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6812045c00/0x2aac941e5f4a73bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a73b5 expref: 17 pid: 6512 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540941.448183:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788540941.448216:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6811426a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:425687b6-1d99-41d2-88d8-2fb230997596+16:3641:x1875420980991872:12345-0@lo:103: Request processed in 93us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540941.448223:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788540941.448239:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788540941.448245:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6811425500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:425687b6-1d99-41d2-88d8-2fb230997596+15:3641:x1875420980992000:12345-0@lo:103: 00010000:00010000:0.0:1788540941.448253:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788540941.448258:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6812045400/0x2aac941e5f4a7392 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a738b expref: 15 pid: 6511 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540941.448279:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6812045400/0x2aac941e5f4a7392 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a738b expref: 15 pid: 6511 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540941.448306:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6812045400/0x2aac941e5f4a7392 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a738b expref: 15 pid: 6511 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540941.448317:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a682e75e800/0x2aac941e5f4a7495 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540941.448325:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a682e75e800/0x2aac941e5f4a7495 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788540941.448339:0:6504:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006601408s 00010000:00010000:0.0:1788540941.448344:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a682e75e800/0x2aac941e5f4a7495 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540941.448351:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a682e75e800/0x2aac941e5f4a7495 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540941.448357:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a682e75e800/0x2aac941e5f4a7495 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540941.448363:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a682e75e800/0x2aac941e5f4a7495 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540941.448369:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75e800 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788540941.448373:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a682e75e800/0x2aac941e5f4a7495 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540941.448380:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a682e75e800/0x2aac941e5f4a7495 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540941.448395:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a682e75e800/0x2aac941e5f4a7495 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540941.448415:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788540941.448439:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6811425500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:425687b6-1d99-41d2-88d8-2fb230997596+14:3641:x1875420980992000:12345-0@lo:103: Request processed in 194us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540941.448445:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788540941.448483:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420980992000:0@lo:103: 00000100:00100000:0.0:1788540941.448492:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420980991872:0@lo:103: 00010000:00010000:0.0:1788540941.448516:0:6533:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a682e75e800/0x2aac941e5f4a7495 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540941.448524:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a682e75e800/0x2aac941e5f4a7495 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540941.448530:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a682e75e800/0x2aac941e5f4a7495 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540941.448912:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1788540941.462593:0:8424:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1788540941.462765:0:8424:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1788540941.463551:0:8424:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1788540941.463782:0:8424:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1788540941.464408:0:8424:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1788540941.464796:0:8424:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:3.0:1788540941.469465:0:8424:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788540941.483372:0:8424:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788540941.483383:0:8424:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788540941.483421:0:8424:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788540941.483468:0:8424:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.156@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788540941.483489:0:8424:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788540941.483521:0:8424:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1788540941.486534:0:8424:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788540941.486760:0:8424:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1788540941.772995:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788540941.773014:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6805675880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420980992128:0@lo:41: 00000100:00100000:2.0:1788540941.773093:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540941.773166:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980992128 00000100:00100000:2.0:1788540941.773173:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980992128 00000100:00100000:2.0:1788540941.773223:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788540941.773231:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6805674a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420980992128:12345-0@lo:41: 00000004:00000024:2.0:1788540941.773262:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1788540941.773316:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6805674a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420980992128:12345-0@lo:41: Request processed in 85us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540941.773325:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788540941.773372:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6805675880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420980992128:0@lo:41: 00000100:00100000:2.0:1788540942.282487:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420980992256:0@lo:41: 00000100:00100000:2.0:1788540942.282577:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540942.282855:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980992256 00000100:00100000:0.0:1788540942.282865:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980992256 00000100:00100000:0.0:1788540942.282943:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788540942.282953:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6805675880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420980992256:12345-0@lo:41: 00000004:00000024:0.0:1788540942.282987:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:0.0:1788540942.283048:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6805675880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420980992256:12345-0@lo:41: Request processed in 96us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540942.283056:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788540942.283139:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420980992256:0@lo:41: 00000020:00000004:3.0:1788540942.476281:0:8508:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788540942.477138:0:8508:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788540942.794250:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788540943.819822:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540944.842682:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540945.865964:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788540946.890587:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670691b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420980992640:0@lo:400: 00000100:00100000:2.0:1788540946.890678:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540946.890737:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670691a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875420980993152:0@lo:400: 00000100:00100000:2.0:1788540946.890767:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540946.890796:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788540946.890802:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875420980992768:0@lo:400: 00000100:00100000:2.0:1788540946.890823:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788540946.890851:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788540946.890883:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980992640 00000100:00100000:2.0:1788540946.890890:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980992640 00000100:00100000:2.0:1788540946.890928:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788540946.890936:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420980992640:12345-0@lo:400: 00000100:00100000:2.0:1788540946.890986:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420980992640:12345-0@lo:400: Request processed in 49us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540946.890994:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788540946.891044:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670691b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420980992640:0@lo:400: 00000100:00100000:0.0:1788540946.891150:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6805674e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420980992384:0@lo:400: 00000100:00100000:0.0:1788540946.891185:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540946.891208:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706919180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420980992896:0@lo:400: 00000100:00100000:0.0:1788540946.891241:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540946.891261:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788540946.891267:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706919f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875420980992512:0@lo:400: 00000100:00100000:0.0:1788540946.891289:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540946.891305:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706918a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875420980993024:0@lo:400: 00000100:00100000:0.0:1788540946.891327:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540946.891352:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980993152 00000100:00100000:0.0:1788540946.891357:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980993152 00000100:00100000:0.0:1788540946.891397:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980992768 00000100:00100000:0.0:1788540946.891400:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980992768 00000100:00100000:0.0:1788540946.891413:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980992512 00000100:00100000:0.0:1788540946.891416:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980992512 00000100:00100000:0.0:1788540946.891444:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980993024 00000100:00100000:0.0:1788540946.891447:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980993024 00000100:00100000:0.0:1788540946.891463:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788540946.891470:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875420980993152:12345-0@lo:400: 00000100:00100000:0.0:1788540946.891502:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875420980993152:12345-0@lo:400: Request processed in 32us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540946.891508:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788540946.891520:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788540946.891526:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670691b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875420980992768:12345-0@lo:400: 00000100:00100000:0.0:1788540946.891551:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670691b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875420980992768:12345-0@lo:400: Request processed in 26us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540946.891557:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788540946.891568:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788540946.891574:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6811426300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875420980992512:12345-0@lo:400: 00000100:00100000:0.0:1788540946.891604:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6811426300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875420980992512:12345-0@lo:400: Request processed in 31us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540946.891617:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788540946.891630:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788540946.891636:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6811427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875420980993024:12345-0@lo:400: 00000100:00100000:0.0:1788540946.891665:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6811427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875420980993024:12345-0@lo:400: Request processed in 29us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540946.891671:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788540946.891690:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980992896 00000100:00100000:0.0:1788540946.891694:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980992896 00000100:00100000:0.0:1788540946.891708:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788540946.891713:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6811426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420980992896:12345-0@lo:400: 00000100:00100000:0.0:1788540946.891740:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6811426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420980992896:12345-0@lo:400: Request processed in 27us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540946.891746:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788540946.891760:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980992384 00000100:00100000:0.0:1788540946.891763:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980992384 00000100:00100000:0.0:1788540946.891782:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788540946.891788:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e77a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+14:3641:x1875420980992384:12345-0@lo:400: 00000100:00100000:0.0:1788540946.891814:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e77a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+14:3641:x1875420980992384:12345-0@lo:400: Request processed in 26us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540946.891820:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:0.0:1788540946.891960:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6706919f80 x1875420980992512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540946.891971:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706919f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875420980992512:0@lo:400: 00010000:00080000:0.0:1788540946.891981:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6706918a80 x1875420980993024/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540946.892002:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706918a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875420980993024:0@lo:400: 00000100:00100000:0.0:1788540946.892011:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6805674e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420980992384:0@lo:400: 00000100:00100000:0.0:1788540946.892020:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706919180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420980992896:0@lo:400: 00010000:00080000:0.0:1788540946.892070:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6706919c00 x1875420980992768/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540946.892079:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875420980992768:0@lo:400: 00010000:00080000:0.0:1788540946.892087:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a670691a680 x1875420980993152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540946.892094:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670691a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875420980993152:0@lo:400: 00000100:00100000:0.0:1788540946.892103:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788540946.892109:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6811424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420980993280:0@lo:41: 00000100:00100000:0.0:1788540946.892131:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540946.892154:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980993280 00000100:00100000:0.0:1788540946.892157:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980993280 00000100:00100000:0.0:1788540946.892176:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788540946.892182:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6811425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420980993280:12345-0@lo:41: 00000004:00000024:0.0:1788540946.892205:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1788540946.892238:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6811425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420980993280:12345-0@lo:41: Request processed in 56us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540946.892244:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788540946.892272:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6811424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420980993280:0@lo:41: 00000100:00080000:0.0:1788540946.892302:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788540946.892306:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:3.0:1788540947.173652:0:8798:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg256-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788540947.402595:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420980993408:0@lo:41: 00000100:00100000:0.0:1788540947.402673:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540947.402857:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980993408 00000100:00100000:1.0:1788540947.402866:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980993408 00000100:00100000:1.0:1788540947.402941:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788540947.402950:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6811424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420980993408:12345-0@lo:41: 00000004:00000024:1.0:1788540947.402983:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:1.0:1788540947.403045:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6811424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420980993408:12345-0@lo:41: Request processed in 96us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540947.403053:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788540947.403132:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420980993408:0@lo:41: 00010000:00010000:2.0:1788540947.915745:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788540948.263494:0:8850:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788540948.263687:0:8850:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788540948.943000:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540949.962080:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540950.989558:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788540951.130751:0:8951:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788540951.130956:0:8951:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1788540951.498055:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788540951.498065:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a6839117000 from 30 10000000:01000000:1.0:1788540951.498071:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788540951.498119:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68354da200/0x2aac941e5f4a749c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540951.498132:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a68354da200/0x2aac941e5f4a749c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540951.498144:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a68354da200/0x2aac941e5f4a749c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540951.498211:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980993536:0@lo:101: 00000100:00100000:1.0:1788540951.499612:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540951.500640:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a682e6dd840 going to sleep for 11 seconds 00000100:00100000:3.0:1788540951.510916:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980993536 00000100:00100000:3.0:1788540951.510938:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980993536 00000100:00100000:2.0:1788540951.513288:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788540951.513304:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e778c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+14:6514:x1875420980993536:12345-0@lo:101: 00010000:00010000:2.0:1788540951.513322:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788540951.513344:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6842048800/0x2aac941e5f4a74a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a749c expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540951.513375:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6842048800/0x2aac941e5f4a74a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a749c expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540951.513387:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6842048800/0x2aac941e5f4a74a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a749c expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540951.513413:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6842048800, rc 0) 00000100:00100000:2.0:1788540951.513517:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e778c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+15:6514:x1875420980993536:12345-0@lo:101: Request processed in 217us (13911us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540951.513525:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788540951.514365:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980993536:0@lo:101: 00010000:00010000:1.0:1788540951.514403:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a68354da200/0x2aac941e5f4a749c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a74a3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540951.514419:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a68354da200/0x2aac941e5f4a749c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a74a3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540951.514502:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980993664:0@lo:501: 00000100:00100000:1.0:1788540951.514553:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540951.514611:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a682e6dd840 going to sleep for 11 seconds 00000100:00100000:2.0:1788540951.515826:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980993664 00000100:00100000:2.0:1788540951.515837:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980993664 00000100:00100000:2.0:1788540951.515946:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788540951.515979:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e77b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+15:6514:x1875420980993664:12345-0@lo:501: 00000100:00100000:2.0:1788540951.516173:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e77b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+15:6514:x1875420980993664:12345-0@lo:501: Request processed in 195us (1617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540951.516180:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788540951.517192:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980993664:0@lo:501: 00000100:00100000:1.0:1788540951.517287:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980993792:0@lo:503: 00000100:00100000:1.0:1788540951.517382:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540951.517632:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a682e6dd840 going to sleep for 11 seconds 00000100:00100000:0.0:1788540951.518627:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980993792 00000100:00100000:0.0:1788540951.518638:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980993792 00000100:00100000:0.0:1788540951.518728:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788540951.518738:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e77b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+15:6514:x1875420980993792:12345-0@lo:503: 00000100:00100000:0.0:1788540951.519703:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e77b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+15:6514:x1875420980993792:12345-0@lo:503: Request processed in 964us (2317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540951.519713:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788540951.520090:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980993792:0@lo:503: 00000100:00100000:2.0:1788540951.521494:0:8963:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670691b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:8963:1875420980993920:0@lo:502: 00000100:00100000:2.0:1788540951.521581:0:8963:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540951.521693:0:8963:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6802dafcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788540951.521751:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980993920 00000100:00100000:0.0:1788540951.521763:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980993920 00000100:00100000:0.0:1788540951.522109:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788540951.522127:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e779450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+15:8963:x1875420980993920:12345-0@lo:502: 00000100:00100000:0.0:1788540951.522796:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e779450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+15:8963:x1875420980993920:12345-0@lo:502: Request processed in 664us (1207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540951.522812:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788540951.523176:0:8963:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670691b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:8963:1875420980993920:0@lo:502: 00000100:00100000:3.0:1788540951.523543:0:8963:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:8963:1875420980994048:0@lo:502: 00000100:00100000:3.0:1788540951.523606:0:8963:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540951.524221:0:8963:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683549ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788540951.524593:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980994048 00000100:00100000:2.0:1788540951.524602:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980994048 00000100:00100000:2.0:1788540951.524652:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788540951.524662:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e779c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+15:8963:x1875420980994048:12345-0@lo:502: 00000100:00100000:2.0:1788540951.525052:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e779c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+15:8963:x1875420980994048:12345-0@lo:502: Request processed in 384us (1438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540951.525060:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788540951.525672:0:8963:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:8963:1875420980994048:0@lo:502: 00000040:00080000:3.0:1788540951.525714:0:8963:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788540951.526656:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788540951.526682:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788540951.526695:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68354da200/0x2aac941e5f4a749c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a74a3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540951.526714:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a68354da200/0x2aac941e5f4a749c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a74a3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788540951.526725:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788540951.526728:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a6839117000 from 5 10000000:01000000:0.0:1788540951.526731:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788540951.526777:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75fc00/0x2aac941e5f4a74aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540951.526802:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a682e75fc00/0x2aac941e5f4a74aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540951.527606:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a682e75fc00/0x2aac941e5f4a74aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540951.527638:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6811424000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980994176:0@lo:101: 00000100:00100000:0.0:1788540951.527718:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540951.527843:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6705a9b600 going to sleep for 11 seconds 00000100:00100000:1.0:1788540951.528122:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980994176 00000100:00100000:1.0:1788540951.528130:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980994176 00000100:00100000:2.0:1788540951.530104:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788540951.530125:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e77ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+15:6514:x1875420980994176:12345-0@lo:101: 00010000:00010000:2.0:1788540951.530146:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788540951.530556:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6842048e00/0x2aac941e5f4a74b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a74aa expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540951.530589:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6842048e00/0x2aac941e5f4a74b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a74aa expref: 16 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540951.530605:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6842048e00/0x2aac941e5f4a74b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a74aa expref: 16 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540951.530614:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6842048e00, rc 0) 00000100:00100000:2.0:1788540951.530712:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e77ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+16:6514:x1875420980994176:12345-0@lo:101: Request processed in 597us (2994us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540951.530726:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788540951.530843:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6811424000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980994176:0@lo:101: 00010000:00010000:3.0:1788540951.530902:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a682e75fc00/0x2aac941e5f4a74aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a74b1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540951.530919:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a682e75fc00/0x2aac941e5f4a74aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a74b1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540951.531032:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980994304:0@lo:256: 00000100:00100000:3.0:1788540951.531089:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540951.531851:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683549ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788540951.533755:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980994304 00000100:00100000:0.0:1788540951.533772:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980994304 00000100:00100000:0.0:1788540951.534090:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788540951.534101:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e779050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+16:6514:x1875420980994304:12345-0@lo:256: 20000000:01000000:0.0:1788540951.534125:0:6511:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788540951.534173:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788540951.534176:0:6511:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788540951.534564:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e779050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+16:6514:x1875420980994304:12345-0@lo:256: Request processed in 464us (3474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540951.534589:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788540951.534715:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980994304:0@lo:256: 10000000:01000000:3.0:1788540951.534786:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788540951.534796:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75fc00/0x2aac941e5f4a74aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a74b1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540951.534824:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a682e75fc00/0x2aac941e5f4a74aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a74b1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788540951.534835:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788540951.534838:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:3.0:1788540951.534841:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788540951.534916:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6842173400/0x2aac941e5f4a74b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540951.534924:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a6842173400/0x2aac941e5f4a74b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540951.534957:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a6842173400/0x2aac941e5f4a74b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540951.534993:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980994432:0@lo:101: 00000100:00100000:3.0:1788540951.535033:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540951.535073:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683549ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788540951.535569:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980994432 00000100:00100000:0.0:1788540951.535575:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980994432 00000100:00100000:0.0:1788540951.535608:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788540951.535623:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e779850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+16:6514:x1875420980994432:12345-0@lo:101: 00010000:00010000:0.0:1788540951.535633:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788540951.535653:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a682e75f200/0x2aac941e5f4a74bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a74b8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540951.535681:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a682e75f200/0x2aac941e5f4a74bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a74b8 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540951.535718:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a682e75f200/0x2aac941e5f4a74bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a74b8 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540951.535728:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75f200, rc 0) 00000100:00100000:0.0:1788540951.535774:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e779850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+17:6514:x1875420980994432:12345-0@lo:101: Request processed in 152us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540951.535780:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788540951.536031:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980994432:0@lo:101: 00010000:00010000:3.0:1788540951.536053:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a6842173400/0x2aac941e5f4a74b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a74bf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540951.536063:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a6842173400/0x2aac941e5f4a74b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a74bf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540951.536158:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980994560:0@lo:501: 00000100:00100000:3.0:1788540951.536197:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540951.536246:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683549ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788540951.536658:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980994560 00000100:00100000:0.0:1788540951.536664:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980994560 00000100:00100000:0.0:1788540951.536689:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788540951.536696:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e778450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+17:6514:x1875420980994560:12345-0@lo:501: 00000100:00100000:0.0:1788540951.536852:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e778450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+17:6514:x1875420980994560:12345-0@lo:501: Request processed in 155us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540951.536866:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788540951.538187:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980994560:0@lo:501: 00000100:00100000:3.0:1788540951.538256:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980994688:0@lo:503: 00000100:00100000:3.0:1788540951.538351:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540951.538704:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683549ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788540951.539119:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980994688 00000100:00100000:1.0:1788540951.539132:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980994688 00000100:00100000:1.0:1788540951.539226:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788540951.539236:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680cee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+17:6514:x1875420980994688:12345-0@lo:503: 00000100:00100000:1.0:1788540951.539680:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680cee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+17:6514:x1875420980994688:12345-0@lo:503: Request processed in 445us (1328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540951.539703:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788540951.539959:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980994688:0@lo:503: 00000100:00100000:0.0:1788540951.541635:0:8964:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6811424000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:8964:1875420980994816:0@lo:502: 00000100:00100000:0.0:1788540951.541732:0:8964:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540951.541783:0:8964:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6705a9b540 going to sleep for 11 seconds 00000100:00100000:1.0:1788540951.542103:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980994816 00000100:00100000:1.0:1788540951.542117:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980994816 00000100:00100000:1.0:1788540951.542193:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788540951.543518:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680cee4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+17:8964:x1875420980994816:12345-0@lo:502: 00000100:00100000:1.0:1788540951.543836:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680cee4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+17:8964:x1875420980994816:12345-0@lo:502: Request processed in 1632us (2108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540951.543861:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788540951.552613:0:8964:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6811424000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:8964:1875420980994816:0@lo:502: 00000020:01000000:0.0:1788540951.553996:0:8964:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788540951.554011:0:8964:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788540951.554023:0:8964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788540951.554030:0:8964:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788540951.554036:0:8964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788540951.554040:0:8964:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.156@tcp to nid 0x20000c0a8ca9c (192.168.202.156@tcp) 00000020:01000000:0.0:1788540951.554073:0:8964:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788540951.554081:0:8964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788540951.554131:0:8964:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9a68353119c0) 00000020:00000080:0.0:1788540951.554165:0:8964:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1788540951.554173:0:8964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788540951.554330:0:8964:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1788540951.554343:0:8964:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788540951.554352:0:8964:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2aac941e5f4a74cd 00010000:00080000:0.0:1788540951.556140:0:8964:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a683f196000@lustre-OST0000-osc-MDT0001: add connection 192.168.202.156@tcp at head 00010000:00010000:0.0:1788540951.556692:0:8964:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1788540951.583107:0:8964:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788540951.583137:0:8964:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1788540951.583707:0:8964:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788540951.584560:0:8964:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788540951.584702:0:8964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1788540951.584846:0:8964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1788540951.590797:0:8966:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788540951.590823:0:8966:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788540951.597505:0:8964:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788540951.597529:0:8964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788540951.597587:0:8964:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788540951.597617:0:8964:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2aac941e5f4a74d4 00000100:00080000:0.0:1788540951.597632:0:8964:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788540951.597640:0:8964:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9a683f196000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:0.0:1788540951.597682:0:8964:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6811424000 x1875420980994944/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788540951.597723:0:8964:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788540951.597850:0:8964:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788540951.597855:0:8964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788540951.597857:0:8964:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788540951.597861:0:8964:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788540951.597864:0:8964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788540951.597866:0:8964:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788540951.597912:0:8964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788540951.597913:0:8964:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788540951.597953:0:8964:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6805674e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:8964:1875420980995072:0@lo:502: 00000100:00100000:0.0:1788540951.598086:0:8964:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540951.598129:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980995072 00000100:00100000:0.0:1788540951.598135:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980995072 00000100:00100000:0.0:1788540951.598193:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788540951.598477:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6811424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420980994944:0@lo:8: 00000100:00100000:1.0:1788540951.598514:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540951.599475:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980994944 00000100:00100000:3.0:1788540951.599483:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980994944 00000100:00100000:3.0:1788540951.599521:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788540951.599527:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1875420980994944:12345-0@lo:8: 00010000:00080000:3.0:1788540951.599574:0:8430:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 232 last 0 00000020:00000080:3.0:1788540951.599607:0:8430:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2aac941e5f4a74db 00002000:00100000:3.0:1788540951.599650:0:8430:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9a683f352800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1788540951.599660:0:8430:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:3.0:1788540951.599664:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788540951.599741:0:8430:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788540951.600123:0:8430:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1788540951.600155:0:8430:0:(import.c:65:import_set_state_nolock()) ffff9a683f355000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788540951.600243:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1875420980994944:12345-0@lo:8: Request processed in 714us (1728us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540951.600257:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788540951.600400:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875420980995200:0@lo:400: 00000100:00100000:3.0:1788540951.600447:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540951.600476:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875420980995712:0@lo:400: 00000100:00100000:3.0:1788540951.600513:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540951.600541:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788540951.600548:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420980995584:0@lo:400: 00000100:00100000:3.0:1788540951.600581:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540951.600614:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420980995328:0@lo:400: 00000100:00100000:3.0:1788540951.600647:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540951.600671:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875420980995840:0@lo:400: 00000100:00100000:3.0:1788540951.600717:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540951.600737:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788540951.600743:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875420980995456:0@lo:400: 00000100:00100000:3.0:1788540951.600781:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540951.600824:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980995200 00000100:00100000:3.0:1788540951.600829:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980995200 00000100:00100000:3.0:1788540951.600860:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980995712 00000100:00100000:3.0:1788540951.600863:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980995712 00000100:00100000:3.0:1788540951.600916:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980995840 00000100:00100000:3.0:1788540951.600919:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980995840 00000100:00100000:3.0:1788540951.600930:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980995456 00000100:00100000:3.0:1788540951.600932:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980995456 00000100:00100000:3.0:1788540951.600950:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788540951.600957:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875420980995200:12345-0@lo:400: 00000100:00100000:3.0:1788540951.601014:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875420980995200:12345-0@lo:400: Request processed in 57us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540951.601028:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788540951.601042:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788540951.601055:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875420980995712:12345-0@lo:400: 00000100:00100000:3.0:1788540951.601092:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875420980995712:12345-0@lo:400: Request processed in 38us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540951.601097:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788540951.601116:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788540951.601123:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875420980995840:12345-0@lo:400: 00000100:00100000:3.0:1788540951.601162:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875420980995840:12345-0@lo:400: Request processed in 39us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540951.601168:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788540951.601188:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788540951.601195:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875420980995456:12345-0@lo:400: 00000100:00100000:3.0:1788540951.601229:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875420980995456:12345-0@lo:400: Request processed in 36us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540951.601241:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788540951.601275:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980995584 00000100:00100000:3.0:1788540951.601279:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980995584 00000100:00100000:3.0:1788540951.601300:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980995328 00000100:00100000:3.0:1788540951.601303:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980995328 00000100:00100000:3.0:1788540951.601313:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788540951.601318:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420980995584:12345-0@lo:400: 00000100:00100000:3.0:1788540951.601354:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420980995584:12345-0@lo:400: Request processed in 36us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540951.601360:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788540951.601370:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788540951.601382:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420980995328:12345-0@lo:400: 00000100:00100000:3.0:1788540951.601413:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420980995328:12345-0@lo:400: Request processed in 32us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540951.601419:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1788540951.601443:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788540951.601446:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788540951.601484:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6705aa6680 x1875420980995456/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540951.601497:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875420980995456:0@lo:400: 00000100:00100000:3.0:1788540951.601515:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420980995328:0@lo:400: 00010000:00080000:3.0:1788540951.601524:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6705aa7480 x1875420980995840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540951.601531:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875420980995840:0@lo:400: 00000100:00100000:3.0:1788540951.601573:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420980995584:0@lo:400: 00010000:00080000:3.0:1788540951.601584:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6705aa5c00 x1875420980995200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540951.601612:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875420980995200:0@lo:400: 00010000:00080000:3.0:1788540951.601632:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6705aa4e00 x1875420980995712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540951.601641:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875420980995712:0@lo:400: 00010000:00080000:1.0:1788540951.604136:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6811424000 x1875420980994944/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788540961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540951.604161:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788540951.604170:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788540951.604177:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788540951.604183:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788540951.604186:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a683f196000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788540951.604200:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788540951.604206:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6811424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420980994944:0@lo:8: 00000100:00100000:0.0:1788540951.604451:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680cee5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+17:8964:x1875420980995072:12345-0@lo:502: 00000100:00100000:0.0:1788540951.604641:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680cee5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+17:8964:x1875420980995072:12345-0@lo:502: Request processed in 6438us (6559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540951.604651:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788540951.604736:0:8967:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8967:1875420980995968:0@lo:700: 00000100:00100000:0.0:1788540951.604769:0:8967:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540951.604788:0:8967:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6705a9b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788540951.605779:0:8964:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6705a9b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788540951.605837:0:8964:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6805674e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:8964:1875420980995072:0@lo:502: 00000020:01000000:0.0:1788540951.605901:0:8964:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788540951.605909:0:8964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788540951.605917:0:8964:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788540951.605923:0:8964:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000100:00100000:1.0:1788540951.606409:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980995968 00000100:00100000:1.0:1788540951.606417:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980995968 00000100:00100000:1.0:1788540951.606495:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788540951.606509:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8967:x1875420980995968:12345-0@lo:700: 00000100:00100000:1.0:1788540951.606560:0:8438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8438:1875420980996096:0@lo:700: 00000100:00100000:1.0:1788540951.606621:0:8438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540951.606662:0:8438:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a682e6ddf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788540951.606691:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980996096 00000100:00100000:1.0:1788540951.606702:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980996096 00000100:00100000:1.0:1788540951.606740:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788540951.606747:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8438:x1875420980996096:12345-0@lo:700: 00000100:00080000:0.0:1788540951.607661:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000000:3.0:1788540951.609706:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:3.0:1788540951.609762:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788540951.609774:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6842173400/0x2aac941e5f4a74b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a74bf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540951.609785:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a6842173400/0x2aac941e5f4a74b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a74bf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788540951.610139:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788540951.610143:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a68112dc000 from 30 10000000:01000000:3.0:1788540951.610146:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788540951.610377:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6842172c00/0x2aac941e5f4a74e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540951.610387:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a6842172c00/0x2aac941e5f4a74e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540951.610397:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a6842172c00/0x2aac941e5f4a74e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540951.610419:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980996224:0@lo:101: 00000100:00100000:3.0:1788540951.610478:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540951.610583:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683549a480 going to sleep for 11 seconds 00000004:00080000:3.0:1788540951.610630:0:8966:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788540951.610716:0:8966:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 232528844495ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788540951.610723:0:8966:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1788540951.612350:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980996224 00000100:00100000:0.0:1788540951.612362:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980996224 00000100:00100000:0.0:1788540951.612413:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788540951.612422:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680cee7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+17:6514:x1875420980996224:12345-0@lo:101: 00010000:00010000:0.0:1788540951.612437:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788540951.612452:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a682e75e800/0x2aac941e5f4a74e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a74e2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540951.612493:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a682e75e800/0x2aac941e5f4a74e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a74e2 expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540951.612504:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a682e75e800/0x2aac941e5f4a74e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a74e2 expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540951.612513:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75e800, rc 0) 00000100:00100000:0.0:1788540951.613011:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680cee7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+18:6514:x1875420980996224:12345-0@lo:101: Request processed in 588us (2530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540951.613018:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000004:00080000:1.0:1788540951.615742:0:7448:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 40000000:02000000:1.0:1788540951.616028:0:6524:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:3.0:1788540951.618560:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980996224:0@lo:101: 00010000:00010000:3.0:1788540951.618589:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a6842172c00/0x2aac941e5f4a74e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a74e9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540951.618603:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a6842172c00/0x2aac941e5f4a74e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a74e9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540951.618714:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980996352:0@lo:501: 00000100:00100000:3.0:1788540951.618794:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540951.618863:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683549a480 going to sleep for 11 seconds 00000100:00100000:0.0:1788540951.619424:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980996352 00000100:00100000:0.0:1788540951.619432:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980996352 00000100:00100000:0.0:1788540951.619483:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788540951.619492:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680cee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+18:6514:x1875420980996352:12345-0@lo:501: 00000100:00100000:0.0:1788540951.619655:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680cee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+18:6514:x1875420980996352:12345-0@lo:501: Request processed in 164us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540951.619664:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788540951.620658:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980996352:0@lo:501: 00000100:00100000:3.0:1788540951.620721:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980996480:0@lo:503: 00000100:00100000:3.0:1788540951.620786:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540951.620942:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980996480 00000100:00100000:0.0:1788540951.620954:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980996480 00000100:00100000:0.0:1788540951.622461:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788540951.622478:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6805288050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+18:6514:x1875420980996480:12345-0@lo:503: 00000100:00100000:0.0:1788540951.622651:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6805288050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+18:6514:x1875420980996480:12345-0@lo:503: Request processed in 178us (1863us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540951.622665:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788540951.622888:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683549a480 going to sleep for 11 seconds 00000100:00100000:3.0:1788540951.622916:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980996480:0@lo:503: 00000100:00100000:3.0:1788540951.625480:0:8968:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:8968:1875420980996608:0@lo:502: 00000100:00100000:3.0:1788540951.625587:0:8968:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540951.625654:0:8968:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683549a300 going to sleep for 11 seconds 00000100:00100000:0.0:1788540951.626733:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980996608 00000100:00100000:0.0:1788540951.626750:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980996608 00000100:00100000:0.0:1788540951.626833:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788540951.626891:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680528a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+18:8968:x1875420980996608:12345-0@lo:502: 00000100:00100000:0.0:1788540951.627611:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680528a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+18:8968:x1875420980996608:12345-0@lo:502: Request processed in 756us (2023us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540951.627621:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788540951.627749:0:8968:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:8968:1875420980996608:0@lo:502: 00000100:00100000:3.0:1788540951.627845:0:8968:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:8968:1875420980996736:0@lo:502: 00000100:00100000:3.0:1788540951.627927:0:8968:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540951.627962:0:8968:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683549a300 going to sleep for 11 seconds 00000100:00100000:0.0:1788540951.629466:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980996736 00000100:00100000:0.0:1788540951.629482:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980996736 00000100:00100000:0.0:1788540951.629552:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788540951.629568:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6805289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+18:8968:x1875420980996736:12345-0@lo:502: 00000100:00100000:0.0:1788540951.629753:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6805289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+18:8968:x1875420980996736:12345-0@lo:502: Request processed in 180us (1819us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540951.629761:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788540951.630130:0:8968:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:8968:1875420980996736:0@lo:502: 00000040:00080000:3.0:1788540951.630189:0:8968:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788540951.632132:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788540951.632188:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788540951.632213:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6842172c00/0x2aac941e5f4a74e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a74e9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540951.632242:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a6842172c00/0x2aac941e5f4a74e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a74e9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788540951.632252:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788540951.632255:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a68112dc000 from 5 10000000:01000000:0.0:1788540951.632258:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788540951.632324:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75fe00/0x2aac941e5f4a74f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540951.632332:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a682e75fe00/0x2aac941e5f4a74f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540951.632343:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a682e75fe00/0x2aac941e5f4a74f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540951.632374:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980996864:0@lo:101: 00000100:00100000:0.0:1788540951.632455:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540951.632494:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683f33d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788540951.632517:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980996864 00000100:00100000:0.0:1788540951.632523:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980996864 00000100:00100000:0.0:1788540951.632582:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788540951.632591:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6805288850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+18:6514:x1875420980996864:12345-0@lo:101: 00010000:00010000:0.0:1788540951.632609:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788540951.632622:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a682e75f600/0x2aac941e5f4a74f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a74f0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540951.632656:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a682e75f600/0x2aac941e5f4a74f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a74f0 expref: 19 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540951.632667:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a682e75f600/0x2aac941e5f4a74f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a74f0 expref: 19 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540951.632681:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75f600, rc 0) 00000100:00100000:0.0:1788540951.632723:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6805288850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+19:6514:x1875420980996864:12345-0@lo:101: Request processed in 133us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540951.632730:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788540951.632788:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980996864:0@lo:101: 00010000:00010000:0.0:1788540951.632809:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a682e75fe00/0x2aac941e5f4a74f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a74f7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540951.632823:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a682e75fe00/0x2aac941e5f4a74f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a74f7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540951.632919:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980996992:0@lo:256: 00000100:00100000:0.0:1788540951.632964:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540951.632978:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683f33d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788540951.633004:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980996992 00000100:00100000:0.0:1788540951.633008:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980996992 00000100:00100000:0.0:1788540951.633041:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788540951.633056:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6809078850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+19:6514:x1875420980996992:12345-0@lo:256: 20000000:01000000:0.0:1788540951.633070:0:6512:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788540951.633095:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788540951.633104:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788540951.633192:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6809078850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+19:6514:x1875420980996992:12345-0@lo:256: Request processed in 144us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540951.633199:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788540951.633240:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980996992:0@lo:256: 10000000:01000000:0.0:1788540951.633294:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788540951.633300:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75fe00/0x2aac941e5f4a74f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a74f7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540951.633314:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a682e75fe00/0x2aac941e5f4a74f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a74f7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788540951.633321:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788540951.633322:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1788540951.633324:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788540951.633345:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a74fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540951.633368:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a74fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540951.633378:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a74fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540951.633395:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980997120:0@lo:101: 00000100:00100000:0.0:1788540951.633426:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540951.633447:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683f33d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788540951.633458:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980997120 00000100:00100000:0.0:1788540951.633462:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980997120 00000100:00100000:0.0:1788540951.633484:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788540951.633489:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680907a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+19:6514:x1875420980997120:12345-0@lo:101: 00010000:00010000:0.0:1788540951.633502:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788540951.633510:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a682e75ec00/0x2aac941e5f4a7505 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a74fe expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540951.633533:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a682e75ec00/0x2aac941e5f4a7505 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a74fe expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540951.633548:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a682e75ec00/0x2aac941e5f4a7505 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a74fe expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540951.633555:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75ec00, rc 0) 00000100:00100000:0.0:1788540951.633589:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680907a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+20:6514:x1875420980997120:12345-0@lo:101: Request processed in 99us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540951.633617:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788540951.633645:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980997120:0@lo:101: 00010000:00010000:0.0:1788540951.633662:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a74fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7505 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540951.633688:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a74fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a7505 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540951.633737:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980997248:0@lo:501: 00000100:00100000:0.0:1788540951.633778:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540951.633792:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683f33d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788540951.633803:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980997248 00000100:00100000:0.0:1788540951.633807:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980997248 00000100:00100000:0.0:1788540951.633824:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788540951.633830:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680907ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+20:6514:x1875420980997248:12345-0@lo:501: 00000100:00100000:0.0:1788540951.633967:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680907ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+20:6514:x1875420980997248:12345-0@lo:501: Request processed in 136us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540951.633973:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788540951.634013:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980997248:0@lo:501: 00000100:00100000:0.0:1788540951.634040:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980997376:0@lo:503: 00000100:00100000:0.0:1788540951.634096:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540951.634110:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6831c25480 going to sleep for 11 seconds 00000100:00100000:0.0:1788540951.634120:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980997376 00000100:00100000:0.0:1788540951.634124:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980997376 00000100:00100000:0.0:1788540951.634140:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788540951.634146:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6809078450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+20:6514:x1875420980997376:12345-0@lo:503: 00000100:00100000:0.0:1788540951.634252:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6809078450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+20:6514:x1875420980997376:12345-0@lo:503: Request processed in 105us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540951.634259:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788540951.634313:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980997376:0@lo:503: 00000100:00100000:1.0:1788540951.638711:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8438:x1875420980996096:12345-0@lo:700: Request processed in 31955us (32080us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540951.638734:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788540951.639503:0:8438:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68045f6d80 x1875420980996096/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788540967 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540951.639523:0:8438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8438:1875420980996096:0@lo:700: 40000000:02000000:3.0:1788540951.639542:0:8438:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00100000:0.0:1788540951.645151:0:8969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:8969:1875420980997504:0@lo:502: 00000100:00100000:0.0:1788540951.645687:0:8969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540951.645741:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980997504 00000100:00100000:0.0:1788540951.645753:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980997504 00000100:00100000:0.0:1788540951.646392:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788540951.646410:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807634850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+20:8969:x1875420980997504:12345-0@lo:502: 00000100:00100000:0.0:1788540951.646572:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807634850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+20:8969:x1875420980997504:12345-0@lo:502: Request processed in 170us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540951.646579:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788540951.646657:0:8969:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6831c25480 going to sleep for 11 seconds 00000100:00100000:0.0:1788540951.646688:0:8969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:8969:1875420980997504:0@lo:502: 00000020:01000000:0.0:1788540951.646734:0:8969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788540951.646743:0:8969:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788540951.646750:0:8969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788540951.646752:0:8969:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788540951.646757:0:8969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788540951.646768:0:8969:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.156@tcp to nid 0x20000c0a8ca9c (192.168.202.156@tcp) 00000020:01000000:0.0:1788540951.646791:0:8969:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788540951.646801:0:8969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788540951.648966:0:8969:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9a6835313380) 00000020:00000080:0.0:1788540951.649007:0:8969:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:0.0:1788540951.649022:0:8969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788540951.649142:0:8969:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788540951.649155:0:8969:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788540951.649163:0:8969:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2aac941e5f4a7513 00010000:00080000:0.0:1788540951.649229:0:8969:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a6705aef000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.156@tcp at head 00010000:00010000:0.0:1788540951.650627:0:8969:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000001:00100000:0.0:1788540951.664658:0:8426:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00010000:00080000:0.0:1788540951.665149:0:8967:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68355b4380 x1875420980995968/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788540967 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540951.665172:0:8967:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8967:1875420980995968:0@lo:700: 00000100:00100000:3.0:1788540951.665544:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8967:x1875420980995968:12345-0@lo:700: Request processed in 59038us (60771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540951.665568:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:01000000:0.0:1788540951.666748:0:8969:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788540951.666775:0:8969:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788540951.667654:0:8969:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788540951.677527:0:8969:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788540951.677694:0:8969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1788540951.678566:0:8969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000004:00080000:3.0:1788540951.680960:0:8967:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000040:00080000:0.0:1788540951.680999:0:8970:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788540951.681005:0:8970:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000100:00100000:3.0:1788540951.681007:0:8967:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8967:1875420980997760:0@lo:7: 00000100:00100000:3.0:1788540951.681093:0:8967:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540951.681127:0:8967:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683549a480 going to sleep for 11 seconds 00000100:00100000:3.0:1788540951.681155:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420980997632:0@lo:13: 00000100:00100000:0.0:1788540951.681179:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980997760 00000100:00100000:0.0:1788540951.681188:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980997760 00000100:00100000:0.0:1788540951.681271:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788540951.681455:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540951.681505:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8967:x1875420980997760:12345-0@lo:7: 00000100:00100000:3.0:1788540951.681531:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980997632 00000100:00100000:3.0:1788540951.681536:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980997632 00000100:00100000:3.0:1788540951.681571:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788540951.681579:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875420980997632:12345-0@lo:13: 00002000:00000024:3.0:1788540951.681598:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:3.0:1788540951.681641:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875420980997632:12345-0@lo:13: Request processed in 64us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540951.681649:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788540951.681688:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6705aa4e00 x1875420980997632/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788540967 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540951.681707:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420980997632:0@lo:13: 00002000:00080000:0.0:1788540951.697529:0:8432:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1788540951.697540:0:8432:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788540951.697742:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8967:x1875420980997760:12345-0@lo:7: Request processed in 16239us (16657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540951.697753:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:00000080:0.0:1788540951.698260:0:8969:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788540951.698288:0:8969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788540951.698335:0:8969:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788540951.698360:0:8969:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2aac941e5f4a751a 00000100:00080000:0.0:1788540951.698369:0:8969:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788540951.698375:0:8969:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a6705aef000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:0.0:1788540951.698409:0:8969:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a68355b4380 x1875420980997888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788540951.698425:0:8969:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788540951.698484:0:8969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788540951.698492:0:8969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788540951.698494:0:8969:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788540951.698497:0:8969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788540951.698502:0:8969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788540951.698504:0:8969:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788540951.698506:0:8969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788540951.698508:0:8969:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788540951.698553:0:8969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:8969:1875420980998016:0@lo:502: 00000100:00100000:0.0:1788540951.698759:0:8969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540951.699382:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420980997888:0@lo:8: 00000100:00100000:1.0:1788540951.699430:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540951.699585:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980997888 00000100:00100000:1.0:1788540951.699592:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980997888 00000100:00100000:1.0:1788540951.699626:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788540951.699633:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1875420980997888:12345-0@lo:8: 00010000:00080000:1.0:1788540951.699655:0:8431:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 232 last 0 00000020:00000080:1.0:1788540951.699683:0:8431:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2aac941e5f4a7521 00002000:00100000:1.0:1788540951.699696:0:8431:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9a67067e6800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788540951.699699:0:8431:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788540951.699702:0:8431:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788540951.699768:0:8431:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788540951.699791:0:8431:0:(import.c:65:import_set_state_nolock()) ffff9a67067e4800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788540951.699839:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1875420980997888:12345-0@lo:8: Request processed in 205us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540951.699856:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788540951.699973:0:8969:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6809f7d3c0 going to sleep for 11 seconds 00010000:00080000:1.0:1788540951.700237:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68355b4380 x1875420980997888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788540961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540951.700248:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788540951.700256:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788540951.700273:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788540951.700287:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788540951.700290:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a6705aef000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788540951.700313:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788540951.700318:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420980997888:0@lo:8: 00000004:00080000:0.0:1788540951.700459:0:8970:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788540951.700537:0:8970:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 232618665227ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788540951.700544:0:8970:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1788540951.701833:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980998016 00000100:00100000:2.0:1788540951.701847:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980998016 00000100:00100000:2.0:1788540951.701929:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788540951.701947:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+20:8969:x1875420980998016:12345-0@lo:502: 00010000:00080000:3.0:1788540951.702704:0:8967:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6705aa5c00 x1875420980997760/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788540967 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540951.702720:0:8967:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8967:1875420980997760:0@lo:7: 00000004:00080000:3.0:1788540951.702732:0:8967:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000004:00080000:1.0:1788540951.704615:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1788540951.704772:0:8971:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788540951.705072:0:8971:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8971:1875420980998272:0@lo:7: 00000100:00100000:1.0:1788540951.705147:0:8971:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540951.705193:0:8971:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a682e6dd3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788540951.705215:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980998272 00000100:00100000:1.0:1788540951.705229:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980998272 00000100:00080000:1.0:1788540951.705263:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788540951.705444:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788540951.705454:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8971:x1875420980998272:12345-0@lo:7: 00000100:00100000:2.0:1788540951.706110:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+20:8969:x1875420980998016:12345-0@lo:502: Request processed in 4169us (7348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540951.706121:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788540951.706949:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788540951.706965:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420980998144:0@lo:13: 00000100:00100000:2.0:1788540951.707052:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540951.707224:0:8969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:8969:1875420980998016:0@lo:502: 00000020:01000000:0.0:1788540951.707354:0:8969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788540951.707363:0:8969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788540951.707366:0:8969:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788540951.707378:0:8969:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1788540951.707466:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1788540951.707487:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788540951.707498:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a74fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7505 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540951.707516:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a74fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7505 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788540951.707526:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788540951.707529:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9a682e74b380 from 1 10000000:01000000:0.0:1788540951.707537:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788540951.707566:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75e000/0x2aac941e5f4a7528 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540951.707610:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a682e75e000/0x2aac941e5f4a7528 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540951.707620:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a682e75e000/0x2aac941e5f4a7528 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540951.707636:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980998400:0@lo:101: 00000100:00100000:0.0:1788540951.707690:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540951.707715:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6809f7d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788540951.707740:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980998400 00000100:00100000:0.0:1788540951.707745:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980998400 00000100:00100000:0.0:1788540951.707844:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788540951.707858:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+20:6514:x1875420980998400:12345-0@lo:101: 00010000:00010000:0.0:1788540951.707893:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788540951.707922:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a682e75f400/0x2aac941e5f4a752f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a7528 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540951.707943:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a682e75f400/0x2aac941e5f4a752f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a7528 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540951.707968:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a682e75f400/0x2aac941e5f4a752f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a7528 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540951.707976:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75f400, rc 0) 00000100:00100000:0.0:1788540951.708025:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+21:6514:x1875420980998400:12345-0@lo:101: Request processed in 172us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540951.708031:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788540951.711450:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980998144 00000100:00100000:3.0:1788540951.711463:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980998144 00000100:00100000:3.0:1788540951.711531:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788540951.711542:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1875420980998144:12345-0@lo:13: 00002000:00000024:3.0:1788540951.711573:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:3.0:1788540951.711680:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1875420980998144:12345-0@lo:13: Request processed in 140us (4628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540951.711688:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788540951.711771:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68045f5500 x1875420980998144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788540967 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540951.711799:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420980998144:0@lo:13: 00000100:00100000:2.0:1788540951.720008:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980998400:0@lo:101: 00010000:00010000:2.0:1788540951.720046:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a682e75e000/0x2aac941e5f4a7528 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a752f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540951.720062:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a682e75e000/0x2aac941e5f4a7528 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a752f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540951.720153:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706918700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980998528:0@lo:501: 00000100:00100000:2.0:1788540951.720222:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540951.720260:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a682fdb2480 going to sleep for 11 seconds 00000100:00100000:2.0:1788540951.720301:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980998528 00000100:00100000:2.0:1788540951.720307:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980998528 00000100:00100000:2.0:1788540951.720346:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788540951.720354:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807636c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+21:6514:x1875420980998528:12345-0@lo:501: 00000100:00100000:2.0:1788540951.720467:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807636c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+21:6514:x1875420980998528:12345-0@lo:501: Request processed in 112us (244us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788540951.720475:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788540951.720555:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706918700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420980998528:0@lo:501: 10000000:01000000:2.0:1788540951.720584:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788540951.720606:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75e000/0x2aac941e5f4a7528 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a752f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540951.720620:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a682e75e000/0x2aac941e5f4a7528 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a752f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540951.720668:0:8967:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706918700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8967:1875420980998656:0@lo:5: 00000100:00100000:2.0:1788540951.720711:0:8967:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540951.720756:0:8430:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788540951.720763:0:8430:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788540951.720932:0:8967:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a682fdb2480 going to sleep for 11 seconds 00000100:00100000:2.0:1788540951.727959:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980998656 00000100:00100000:2.0:1788540951.727973:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980998656 00000100:00100000:2.0:1788540951.728207:0:8973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788540951.728219:0:8973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670691aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8967:x1875420980998656:12345-0@lo:5: 00002000:00080000:2.0:1788540951.728253:0:8973:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1788540951.728339:0:8973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670691aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8967:x1875420980998656:12345-0@lo:5: Request processed in 123us (7628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540951.728347:0:8973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788540951.728391:0:8967:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6706918700 x1875420980998656/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788540967 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788540951.728406:0:8967:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706918700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8967:1875420980998656:0@lo:5: 00000004:00080000:2.0:1788540951.728420:0:8967:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788540951.728461:0:8967:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706918700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8967:1875420980998784:0@lo:5: 00000100:00100000:2.0:1788540951.728493:0:8967:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540951.728513:0:8967:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a680b02ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1788540951.728524:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980998784 00000100:00100000:2.0:1788540951.728533:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980998784 00000100:00100000:2.0:1788540951.728551:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788540951.728556:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8967:x1875420980998784:12345-0@lo:5: 00002000:00080000:2.0:1788540951.728578:0:8430:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00002000:00080000:1.0:1788540951.731181:0:8432:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1788540951.731192:0:8432:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788540951.735661:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8971:x1875420980998272:12345-0@lo:7: Request processed in 30188us (30492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540951.735676:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788540951.735811:0:8971:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68045f6d80 x1875420980998272/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788540967 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540951.735963:0:8971:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8971:1875420980998272:0@lo:7: 00000004:00080000:1.0:1788540951.736030:0:8971:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788540951.736118:0:8971:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8971:1875420980998912:0@lo:5: 00000100:00100000:1.0:1788540951.736229:0:8971:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540951.737533:0:8971:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6809a93900 going to sleep for 11 seconds 00000100:00100000:1.0:1788540951.737748:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980998912 00000100:00100000:1.0:1788540951.737756:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980998912 00000100:00100000:2.0:1788540951.738549:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:8967:x1875420980998784:12345-0@lo:5: Request processed in 9988us (10051us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788540951.738560:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788540951.738606:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788540951.738620:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8971:x1875420980998912:12345-0@lo:5: 00002000:00080000:2.0:1788540951.738669:0:8430:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788540951.738689:0:8430:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00010000:00080000:3.0:1788540951.744215:0:8967:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6706918700 x1875420980998784/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788540967 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540951.744241:0:8967:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706918700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8967:1875420980998784:0@lo:5: 00000004:00080000:3.0:1788540951.744263:0:8967:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:3.0:1788540951.744497:0:8967:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8967:1875420980999040:0@lo:900: 00000100:00100000:3.0:1788540951.744589:0:8967:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540951.744632:0:8967:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683549a480 going to sleep for 11 seconds 00000100:00100000:1.0:1788540951.745187:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980999040 00000100:00100000:1.0:1788540951.745203:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980999040 00000100:00100000:1.0:1788540951.745263:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788540951.745417:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8967:x1875420980999040:12345-0@lo:900: 00000100:00100000:1.0:1788540951.745526:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8967:x1875420980999040:12345-0@lo:900: Request processed in 254us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540951.745534:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788540951.745618:0:8967:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6705aa5c00 x1875420980999040/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788540967 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788540951.745636:0:8967:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8967:1875420980999040:0@lo:900: 00000001:00080000:1.0:1788540951.761600:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:1.0:1788540951.761624:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1788540951.761630:0:8426:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788540951.764135:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8971:x1875420980998912:12345-0@lo:5: Request processed in 25509us (27895us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788540951.764157:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788540951.764590:0:8971:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68045f6d80 x1875420980998912/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788540967 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540951.764603:0:8971:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788540951.764610:0:8971:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8971:1875420980998912:0@lo:5: 00000004:00080000:1.0:1788540951.764629:0:8971:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788540951.764681:0:8971:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8971:1875420980999168:0@lo:700: 00000100:00100000:1.0:1788540951.764724:0:8971:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540951.764762:0:8971:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6809a93900 going to sleep for 11 seconds 00000100:00100000:0.0:1788540951.766777:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980999168 00000100:00100000:0.0:1788540951.766802:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980999168 00000100:00100000:0.0:1788540951.766861:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788540951.766895:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6811424000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8971:x1875420980999168:12345-0@lo:700: 00000100:00100000:0.0:1788540951.781783:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6811424000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8971:x1875420980999168:12345-0@lo:700: Request processed in 14906us (17051us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540951.781800:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788540951.782105:0:8971:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68045f6d80 x1875420980999168/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788540967 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540951.782122:0:8971:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8971:1875420980999168:0@lo:700: 00000004:02000040:1.0:1788540951.796846:0:8971:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:1.0:1788540951.806096:0:8971:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8971:1875420980999296:0@lo:5: 00000100:00100000:1.0:1788540951.806183:0:8971:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540951.806223:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980999296 00000100:00100000:1.0:1788540951.806231:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980999296 00000100:00100000:1.0:1788540951.806295:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788540951.806304:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f0fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8971:x1875420980999296:12345-0@lo:5: 00000100:00100000:3.0:1788540951.811349:0:8971:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6809a93900 going to sleep for 11 seconds 00002000:00080000:1.0:1788540951.812702:0:8431:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1788540951.812723:0:8431:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:1.0:1788540951.816641:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f0fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8971:x1875420980999296:12345-0@lo:5: Request processed in 10331us (10452us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788540951.816654:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788540951.817332:0:8971:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68045f6d80 x1875420980999296/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788540967 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788540951.817349:0:8971:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8971:1875420980999296:0@lo:5: 00000004:00080000:2.0:1788540951.817366:0:8971:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:2.0:1788540952.009964:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788540952.019373:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788540952.019399:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420980999424:0@lo:41: 00000100:00100000:2.0:1788540952.019466:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540952.019526:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980999424 00000100:00100000:1.0:1788540952.019534:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980999424 00000100:00100000:1.0:1788540952.019588:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788540952.019598:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670691bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420980999424:12345-0@lo:41: 00000004:00000024:1.0:1788540952.019630:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788540952.019681:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670691bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420980999424:12345-0@lo:41: Request processed in 85us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540952.019688:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788540952.019730:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420980999424:0@lo:41: 00000100:00100000:2.0:1788540952.529475:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670691b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420980999552:0@lo:41: 00000100:00100000:2.0:1788540952.529537:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540952.529604:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980999552 00000100:00100000:2.0:1788540952.529610:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980999552 00000100:00100000:2.0:1788540952.529658:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788540952.529666:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670691ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420980999552:12345-0@lo:41: 00000004:00000024:2.0:1788540952.529708:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1788540952.529751:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670691ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420980999552:12345-0@lo:41: Request processed in 86us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540952.529758:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788540952.529803:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670691b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420980999552:0@lo:41: 00000020:00000004:0.0:1788540952.601302:0:9009:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788540952.601315:0:9009:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:2.0:1788540953.034043:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540954.060622:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540955.084994:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788540956.106522:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788540957.130346:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788540957.130372:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420980999808:0@lo:13: 00000100:00100000:0.0:1788540957.130451:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540957.130519:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980999808 00000100:00100000:0.0:1788540957.130527:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980999808 00000100:00100000:0.0:1788540957.130593:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788540957.130603:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420980999808:12345-0@lo:13: 00002000:00000024:0.0:1788540957.130630:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788540957.130676:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420980999808:12345-0@lo:13: Request processed in 76us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540957.130683:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788540957.130705:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788540957.130748:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68355b5500 x1875420980999808/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788540973 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540957.130759:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788540957.130779:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420980999808:0@lo:13: 00000100:00100000:2.0:1788540957.130908:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420980999680:0@lo:13: 00000100:00100000:2.0:1788540957.130957:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788540957.131027:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788540957.131039:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980999680 00000100:00100000:2.0:1788540957.131043:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980999680 00000100:00100000:2.0:1788540957.131073:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788540957.131079:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670691b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875420980999680:12345-0@lo:13: 00002000:00000024:2.0:1788540957.131089:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788540957.131181:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875420981000064:0@lo:400: 00000100:00100000:2.0:1788540957.131187:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670691b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875420980999680:12345-0@lo:13: Request processed in 108us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540957.131193:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788540957.131210:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788540957.131211:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788540957.131219:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981000192:0@lo:400: 00000100:00100000:0.0:1788540957.131228:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875420981000576:0@lo:400: 00000100:00100000:2.0:1788540957.131244:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540957.131260:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540957.131261:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875420981000704:0@lo:400: 00000100:00100000:2.0:1788540957.131278:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540957.131288:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981000064 00000100:00100000:0.0:1788540957.131291:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981000064 00010000:00080000:2.0:1788540957.131297:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6705aa4a80 x1875420980999680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788540973 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788540957.131315:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420980999680:0@lo:13: 00000100:00100000:0.0:1788540957.131322:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981000576 00000100:00100000:0.0:1788540957.131324:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981000576 00000100:00100000:2.0:1788540957.131340:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981000192 00000100:00100000:0.0:1788540957.131342:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981000704 00000100:00100000:2.0:1788540957.131343:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981000192 00000100:00100000:0.0:1788540957.131344:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981000704 00000100:00100000:0.0:1788540957.131356:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788540957.131362:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875420981000064:12345-0@lo:400: 00000100:00100000:2.0:1788540957.131363:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788540957.131369:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670691a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981000192:12345-0@lo:400: 00000100:00100000:2.0:1788540957.131396:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670691a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981000192:12345-0@lo:400: Request processed in 27us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540957.131396:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875420981000064:12345-0@lo:400: Request processed in 34us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540957.131403:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788540957.131403:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788540957.131415:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788540957.131421:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875420981000576:12345-0@lo:400: 00000100:00100000:2.0:1788540957.131428:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981000192:0@lo:400: 00000100:00100000:0.0:1788540957.131512:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875420981000576:12345-0@lo:400: Request processed in 90us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540957.131518:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788540957.131530:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788540957.131536:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875420981000704:12345-0@lo:400: 00000100:00100000:0.0:1788540957.131849:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875420981000704:12345-0@lo:400: Request processed in 313us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540957.131856:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1788540957.132035:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788540957.132039:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788540957.132059:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68355b6a00 x1875420981000064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540957.132069:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875420981000064:0@lo:400: 00010000:00080000:0.0:1788540957.132091:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68355b7800 x1875420981000576/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540957.132098:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875420981000576:0@lo:400: 00010000:00080000:0.0:1788540957.132122:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68355b6d80 x1875420981000704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540957.132130:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875420981000704:0@lo:400: 00000100:00100000:0.0:1788540957.132145:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420980999936:0@lo:400: 00000100:00100000:0.0:1788540957.132174:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540957.132197:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981000448:0@lo:400: 00000100:00100000:0.0:1788540957.132218:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540957.132239:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788540957.132244:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875420981000320:0@lo:400: 00000100:00100000:0.0:1788540957.132264:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540957.132284:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981000448 00000100:00100000:0.0:1788540957.132288:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981000448 00000100:00100000:0.0:1788540957.132310:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788540957.132316:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981000448:12345-0@lo:400: 00000100:00100000:0.0:1788540957.132347:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981000448:12345-0@lo:400: Request processed in 31us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540957.132352:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788540957.132367:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981000320 00000100:00100000:0.0:1788540957.132370:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981000320 00000100:00100000:0.0:1788540957.132388:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788540957.132393:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875420981000320:12345-0@lo:400: 00000100:00100000:0.0:1788540957.132418:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875420981000320:12345-0@lo:400: Request processed in 24us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540957.132430:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788540957.136090:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420980999936 00000100:00100000:2.0:1788540957.136103:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420980999936 00000100:00100000:2.0:1788540957.136163:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788540957.136173:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807634450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+21:3642:x1875420980999936:12345-0@lo:400: 00000100:00100000:2.0:1788540957.136247:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807634450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+21:3642:x1875420980999936:12345-0@lo:400: Request processed in 75us (4071us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540957.136254:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788540957.136327:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981000832:0@lo:41: 00000100:00100000:2.0:1788540957.136358:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788540957.149236:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68355b5880 x1875420981000320/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540957.149286:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875420981000320:0@lo:400: 00000100:00100000:1.0:1788540957.149302:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420980999936:0@lo:400: 00000100:00100000:1.0:1788540957.149315:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981000448:0@lo:400: 00000100:00100000:0.0:1788540957.169433:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981000832 00000100:00100000:0.0:1788540957.169451:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981000832 00000100:00100000:0.0:1788540957.169517:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788540957.169527:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670691b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981000832:12345-0@lo:41: 00000004:00000024:0.0:1788540957.169572:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788540957.169665:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670691b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981000832:12345-0@lo:41: Request processed in 139us (33305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540957.169672:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788540957.169773:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981000832:0@lo:41: 00000100:00100000:0.0:1788540957.642486:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f0fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981000960:0@lo:41: 00000100:00100000:0.0:1788540957.642560:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540957.643276:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981000960 00000100:00100000:1.0:1788540957.643285:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981000960 00000100:00100000:1.0:1788540957.643328:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788540957.643337:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981000960:12345-0@lo:41: 00000004:00000024:1.0:1788540957.643376:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1788540957.643438:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981000960:12345-0@lo:41: Request processed in 101us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540957.643445:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788540957.643621:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f0fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981000960:0@lo:41: 00010000:00010000:2.0:1788540958.154956:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788540958.162972:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:1.0:1788540959.180791:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540960.203925:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540961.228588:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788540962.257989:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981001216:0@lo:13: 00000100:00100000:3.0:1788540962.258062:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540962.258132:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788540962.258139:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670691a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981001088:0@lo:41: 00000100:00100000:3.0:1788540962.258164:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540962.258221:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981001216 00000100:00100000:2.0:1788540962.258228:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981001216 00000100:00100000:2.0:1788540962.258286:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788540962.258297:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981001216:12345-0@lo:13: 00002000:00000024:2.0:1788540962.258337:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788540962.258383:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981001216:12345-0@lo:13: Request processed in 88us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540962.258390:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788540962.258431:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6706919c00 x1875420981001216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788540978 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788540962.258442:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1788540962.258464:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981001216:0@lo:13: 00000100:00080000:3.0:1788540962.258508:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788540962.258982:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788540962.258995:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981001088 00000100:00100000:1.0:1788540962.258999:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981001088 00000100:00100000:1.0:1788540962.259031:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788540962.259039:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981001088:12345-0@lo:41: 00000004:00000024:1.0:1788540962.259063:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788540962.259105:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981001088:12345-0@lo:41: Request processed in 68us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540962.259112:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788540962.260748:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670691a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981001088:0@lo:41: 00000100:00100000:3.0:1788540962.274084:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981001344:0@lo:13: 00000100:00100000:3.0:1788540962.274167:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540962.274215:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981001344 00000100:00100000:0.0:1788540962.274224:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981001344 00000100:00100000:0.0:1788540962.274294:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788540962.274303:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981001344:12345-0@lo:13: 00002000:00000024:0.0:1788540962.274327:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788540962.274355:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875420981001600:0@lo:400: 00000100:00100000:0.0:1788540962.274368:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981001344:12345-0@lo:13: Request processed in 66us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540962.274374:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788540962.274384:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540962.274402:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875420981002112:0@lo:400: 00000100:00100000:2.0:1788540962.274443:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540962.274474:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788540962.274481:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706919180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981001728:0@lo:400: 00000100:00100000:0.0:1788540962.274494:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981001600 00000100:00100000:0.0:1788540962.274498:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981001600 00000100:00100000:2.0:1788540962.274505:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540962.274520:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981002112 00000100:00100000:0.0:1788540962.274523:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981002112 00000100:00100000:2.0:1788540962.274533:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1788540962.274564:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788540962.274568:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788540962.274589:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875420981001600:12345-0@lo:400: 00000100:00100000:2.0:1788540962.274637:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875420981001600:12345-0@lo:400: Request processed in 97us (251us total) trans 0 rc 0/0 00010000:00080000:3.0:1788540962.274688:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6706919c00 x1875420981001600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540962.274702:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875420981001600:0@lo:400: 00000100:00100000:3.0:1788540962.274996:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670691a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420981001472:0@lo:400: 00000100:00100000:3.0:1788540962.275029:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540962.275053:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706919f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875420981001984:0@lo:400: 00000100:00100000:3.0:1788540962.275073:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540962.275086:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788540962.275091:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706918a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875420981001856:0@lo:400: 00000100:00100000:3.0:1788540962.275112:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788540962.275138:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6705aa6d80 x1875420981001344/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788540978 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540962.275168:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981001344:0@lo:13: 00000100:00100000:3.0:1788540962.281741:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981001728 00000100:00100000:3.0:1788540962.281759:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981001728 00000100:00100000:3.0:1788540962.281822:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788540962.281833:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981001728:12345-0@lo:400: 00000100:00100000:3.0:1788540962.281967:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981001728:12345-0@lo:400: Request processed in 135us (7459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540962.281974:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788540962.282032:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706919180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981001728:0@lo:400: 00000100:00100000:0.0:1788540962.285905:0:6518:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788540962.285926:0:6518:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788540962.285960:0:6519:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788540962.285969:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981001984 00000100:00100000:0.0:1788540962.285978:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981001984 00000100:00100000:0.0:1788540962.286042:0:6519:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00080000:3.0:1788540962.286044:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788540962.286049:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981001856 00000100:00100000:0.0:1788540962.286052:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981001856 00000100:00100000:0.0:1788540962.286063:0:6519:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788540962.286074:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788540962.286083:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875420981002112:12345-0@lo:400: 00000100:00100000:0.0:1788540962.286184:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875420981002112:12345-0@lo:400: Request processed in 103us (11740us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540962.286191:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788540962.286207:0:6519:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788540962.286213:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788540962.286218:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875420981001984:12345-0@lo:400: 00000100:00100000:0.0:1788540962.286261:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875420981001984:12345-0@lo:400: Request processed in 43us (11187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540962.286268:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788540962.286277:0:6519:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00010000:00080000:3.0:1788540962.286279:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6706919880 x1875420981002112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540962.286282:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788540962.286287:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875420981001856:12345-0@lo:400: 00000100:00100000:3.0:1788540962.286295:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875420981002112:0@lo:400: 00000100:00100000:0.0:1788540962.286312:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875420981001856:12345-0@lo:400: Request processed in 25us (11200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540962.286318:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788540962.286336:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981001472 00000100:00100000:0.0:1788540962.286339:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981001472 00010000:00080000:1.0:1788540962.286368:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6706918a80 x1875420981001856/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540962.286374:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788540962.286379:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706918a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875420981001856:0@lo:400: 00000100:00100000:0.0:1788540962.286381:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807634050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+21:3642:x1875420981001472:12345-0@lo:400: 00010000:00080000:1.0:1788540962.286391:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6706919f80 x1875420981001984/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540962.286406:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706919f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875420981001984:0@lo:400: 00000100:00100000:0.0:1788540962.286422:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807634050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+21:3642:x1875420981001472:12345-0@lo:400: Request processed in 42us (11393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540962.286424:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670691a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420981001472:0@lo:400: 00000100:00100000:0.0:1788540962.286428:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788540962.292551:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788540962.762274:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788540962.762312:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f0fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981002240:0@lo:41: 00000100:00100000:0.0:1788540962.762385:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540962.762539:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981002240 00000100:00100000:1.0:1788540962.762548:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981002240 00000100:00100000:1.0:1788540962.762609:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788540962.762619:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981002240:12345-0@lo:41: 00000004:00000024:1.0:1788540962.762652:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1788540962.762699:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981002240:12345-0@lo:41: Request processed in 81us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540962.762717:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788540962.762853:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f0fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981002240:0@lo:41: 00010000:00010000:2.0:1788540963.275010:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788540964.300918:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788540965.322250:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788540966.282232:0:9509:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788540966.282237:0:9509:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788540966.282238:0:9509:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788540966.282363:0:9509:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a67067e3800 00000020:01000004:1.0:1788540966.282380:0:9509:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788540966.282393:0:9509:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788540966.282418:0:9509:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9a670695b380) 00000020:00000080:1.0:1788540966.282436:0:9509:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788540966.338995:0:9509:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1788540966.339055:0:9509:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00010000:00010000:2.0:1788540966.353590:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:01000000:1.0:1788540966.399925:0:9509:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788540966.400740:0:9509:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788540966.400756:0:9509:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788540966.400767:0:9509:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2aac941e5f4a753d 00000020:01000004:1.0:1788540966.400775:0:9509:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788540966.400796:0:9509:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.156@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788540966.400800:0:9509:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.156@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788540966.400812:0:9509:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788540966.400843:0:9509:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1788540966.400860:0:9509:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.156@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788540966.435865:0:9509:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.156@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788540966.435926:0:9509:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.156@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1788540966.435930:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788540966.435932:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788540966.435933:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788540966.435935:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788540966.435936:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788540966.435937:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788540966.435939:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788540966.435940:0:9509:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788540966.435942:0:9509:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788540966.435944:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788540966.435945:0:9509:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788540966.435949:0:9509:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1788540966.435952:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788540966.435953:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788540966.435954:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788540966.435955:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788540966.435956:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788540966.435957:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788540966.435958:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788540966.435959:0:9509:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788540966.435959:0:9509:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788540966.435960:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788540966.435961:0:9509:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788540966.435996:0:9509:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788540966.436015:0:9509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f0fce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:9509:1875420981002368:0@lo:253: 00000100:00100000:1.0:1788540966.436082:0:9509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540966.436128:0:9509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6811488f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788540966.438014:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981002368 00000100:00100000:3.0:1788540966.438026:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981002368 00000100:00100000:3.0:1788540966.438098:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788540966.438109:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807635c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+21:9509:x1875420981002368:12345-0@lo:253: 20000000:01000000:3.0:1788540966.438146:0:6512:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788540966.438151:0:6512:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1788540966.438156:0:6512:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1788540966.438160:0:6512:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1788540966.438449:0:6512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788540966.438620:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:3.0:1788540966.438641:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1788540966.438659:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:3.0:1788540966.438673:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1788540966.438690:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:3.0:1788540966.438705:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:3.0:1788540966.438789:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:3.0:1788540966.438806:0:6512:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.156@tcp 20000000:01000000:3.0:1788540966.438808:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.156@tcp (null) (null) (null) 00000040:00080000:3.0:1788540966.438824:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:3.0:1788540966.438829:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788540966.438841:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:3.0:1788540966.438855:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.156@tcp (null) (null) 00000040:00080000:3.0:1788540966.438890:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:3.0:1788540966.438898:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788540966.438912:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:3.0:1788540966.438925:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:3.0:1788540966.438985:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:3.0:1788540966.438995:0:6512:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.156@tcp 20000000:01000000:3.0:1788540966.438996:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.156@tcp (null) (null) (null) 00000040:00080000:3.0:1788540966.439007:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:3.0:1788540966.439011:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788540966.439023:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:3.0:1788540966.439027:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.202.156@tcp (null) (null) 00000040:00080000:3.0:1788540966.439039:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:3.0:1788540966.439044:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788540966.439055:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:3.0:1788540966.439070:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:3.0:1788540966.439472:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:3.0:1788540966.439483:0:6512:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.156@tcp 20000000:01000000:3.0:1788540966.439485:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.156@tcp (null) (null) (null) 00000040:00080000:3.0:1788540966.439495:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:3.0:1788540966.439499:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788540966.439511:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:3.0:1788540966.439525:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.156@tcp (null) (null) 00000040:00080000:3.0:1788540966.439540:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:3.0:1788540966.439545:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788540966.439558:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:3.0:1788540966.439574:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:3.0:1788540966.439587:0:6512:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788540966.439589:0:6512:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788540966.439593:0:6512:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788540966.439637:0:6512:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788540966.439639:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788540966.441785:0:9515:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 25 1->4: lustre sys.timeout 20000000:01000000:0.0:1788540966.441830:0:9515:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 25 2->4: lustre sys.timeout 00000040:00080000:0.0:1788540966.441868:0:9515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1788540966.442039:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1788540966.442075:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:3.0:1788540966.442196:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:3.0:1788540966.442219:0:6512:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788540966.442222:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788540966.443373:0:9516:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 26 1->4: lustre sys.timeout 20000000:01000000:3.0:1788540966.443547:0:9516:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 26 2->4: lustre sys.timeout 00000040:00080000:3.0:1788540966.443564:0:9516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:2.0:1788540966.445264:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:2.0:1788540966.445295:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:2.0:1788540966.445326:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:2.0:1788540966.445337:0:6512:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788540966.445340:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788540966.447613:0:9517:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:0.0:1788540966.447656:0:9517:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:0.0:1788540966.447669:0:9517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:2.0:1788540966.447799:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:2.0:1788540966.447823:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:2.0:1788540966.447840:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:2.0:1788540966.447860:0:6512:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788540966.447862:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788540966.455523:0:9518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:3.0:1788540966.456061:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:3.0:1788540966.456166:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:3.0:1788540966.456184:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:3.0:1788540966.456198:0:6512:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788540966.456200:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788540966.456778:0:9519:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:0.0:1788540966.456802:0:9519:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:0.0:1788540966.456815:0:9519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:3.0:1788540966.457172:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:3.0:1788540966.457191:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:3.0:1788540966.457203:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 10000000:01000000:3.0:1788540966.457215:0:6512:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788540966.457235:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a6842172a00/0x2aac941e5f4a7544 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540966.457253:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a68354db200/0x2aac941e5f4a743a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a7433 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540966.457272:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a682e75ea00/0x2aac941e5f4a7464 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a745d expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540966.457280:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6842048800/0x2aac941e5f4a74a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a749c expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540966.457286:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a682e75f200/0x2aac941e5f4a74bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a74b8 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540966.457293:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a682e75e800/0x2aac941e5f4a74e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a74e2 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540966.457300:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a682e75ec00/0x2aac941e5f4a7505 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a74fe expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540966.457306:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a682e75f400/0x2aac941e5f4a752f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a7528 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540966.457313:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a6842172a00/0x2aac941e5f4a7544 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540966.457351:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a682e75f400/0x2aac941e5f4a752f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a7528 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540966.457365:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a682e75f400/0x2aac941e5f4a752f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a7528 expref: 21 pid: 6509 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540966.457486:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa6d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6512:1875420981002496:0@lo:104: 00000100:00100000:3.0:1788540966.457550:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788540966.457635:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a682e75ec00/0x2aac941e5f4a7505 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a74fe expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540966.457644:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a682e75ec00/0x2aac941e5f4a7505 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a74fe expref: 21 pid: 6512 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540966.457652:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa7100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6512:1875420981002624:0@lo:104: 00000100:00100000:3.0:1788540966.457728:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788540966.457794:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a682e75e800/0x2aac941e5f4a74e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a74e2 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540966.457802:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a682e75e800/0x2aac941e5f4a74e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a74e2 expref: 21 pid: 6509 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540966.457811:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670691a680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6512:1875420981002752:0@lo:104: 00000100:00100000:3.0:1788540966.457828:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540966.457945:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981002496 00000100:00100000:2.0:1788540966.457953:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981002496 00000100:00100000:2.0:1788540966.457986:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981002624 00000100:00100000:2.0:1788540966.457988:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981002624 00000100:00100000:2.0:1788540966.458000:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788540966.458007:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+4:6512:x1875420981002496:12345-0@lo:104: 00010000:00010000:2.0:1788540966.458020:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a682e75e000/0x2aac941e5f4a7528 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a752f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.458104:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788540966.458110:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+4:6512:x1875420981002496:12345-0@lo:104: Request processed in 104us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540966.458117:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788540966.458132:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788540966.458137:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+3:6512:x1875420981002624:12345-0@lo:104: 00010000:00010000:2.0:1788540966.458144:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a74fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a7505 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540966.458188:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788540966.458195:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a682e75e000/0x2aac941e5f4a7528 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a752f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540966.458203:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75e000 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:0.0:1788540966.458207:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a682e75e000/0x2aac941e5f4a7528 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a752f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540966.458216:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a682e75e000/0x2aac941e5f4a7528 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a752f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788540966.458223:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a682e75e000/0x2aac941e5f4a7528 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a752f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788540966.458229:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788540966.458255:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a682e75e000/0x2aac941e5f4a7528 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a752f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540966.458271:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788540966.458288:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a682e75e000/0x2aac941e5f4a7528 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a752f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540966.458295:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a682e75e000/0x2aac941e5f4a7528 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a752f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540966.458306:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788540966.458309:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a74fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a7505 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540966.458314:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75e200 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:0.0:1788540966.458317:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a74fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a7505 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540966.458324:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a74fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a7505 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788540966.458330:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a74fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a7505 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788540966.458334:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788540966.458344:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a74fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7505 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540966.458349:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788540966.458353:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a74fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7505 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540966.458358:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a74fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7505 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540966.458371:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788540966.458373:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788540966.458375:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788540966.458551:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a682e75f200/0x2aac941e5f4a74bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a74b8 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540966.458560:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a682e75f200/0x2aac941e5f4a74bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a74b8 expref: 21 pid: 6511 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540966.458568:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706918a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6512:1875420981003136:0@lo:104: 00000100:00100000:3.0:1788540966.458587:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788540966.458600:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6842048800/0x2aac941e5f4a74a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a749c expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540966.458608:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6842048800/0x2aac941e5f4a74a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a749c expref: 21 pid: 6509 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540966.458616:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706919180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6512:1875420981003264:0@lo:104: 00000100:00100000:3.0:1788540966.458646:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788540966.458660:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a682e75ea00/0x2aac941e5f4a7464 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a745d expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540966.458678:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a682e75ea00/0x2aac941e5f4a7464 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a745d expref: 21 pid: 6511 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540966.458686:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e2300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6512:1875420981003392:0@lo:104: 00000100:00100000:3.0:1788540966.458706:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788540966.458718:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a68354db200/0x2aac941e5f4a743a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a7433 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540966.458726:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a68354db200/0x2aac941e5f4a743a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a7433 expref: 21 pid: 6512 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540966.458733:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e3b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6512:1875420981003520:0@lo:104: 00000100:00100000:3.0:1788540966.458746:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683f241900 going to sleep for 11 seconds 00000100:00100000:3.0:1788540966.458764:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa6d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6512:1875420981002496:0@lo:104: 00000100:00100000:3.0:1788540966.458771:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa7100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6512:1875420981002624:0@lo:104: 00000100:00100000:3.0:1788540966.458788:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420981002880:0@lo:103: 00000100:00100000:3.0:1788540966.458807:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540966.458825:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788540966.458830:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420981003008:0@lo:103: 00000100:00100000:3.0:1788540966.458843:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540966.458894:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981002880 00000100:00100000:3.0:1788540966.458898:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981002880 00010000:00010000:3.0:1788540966.458914:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a682e75f400/0x2aac941e5f4a752f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a7528 expref: 22 pid: 6509 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540966.458941:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981003008 00000100:00100000:3.0:1788540966.458944:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981003008 00010000:00010000:3.0:1788540966.458953:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a682e75ec00/0x2aac941e5f4a7505 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a74fe expref: 23 pid: 6512 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540966.458963:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788540966.458968:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+23:3641:x1875420981002880:12345-0@lo:103: 00010000:00010000:3.0:1788540966.458976:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788540966.458981:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a682e75f400/0x2aac941e5f4a752f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a7528 expref: 23 pid: 6509 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540966.458990:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a682e75f400/0x2aac941e5f4a752f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a7528 expref: 23 pid: 6509 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540966.459002:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a682e75f400/0x2aac941e5f4a752f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a7528 expref: 23 pid: 6509 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540966.459013:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788540966.459035:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+22:3641:x1875420981002880:12345-0@lo:103: Request processed in 67us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540966.459041:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788540966.459052:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788540966.459057:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+21:3641:x1875420981003008:12345-0@lo:103: 00010000:00010000:3.0:1788540966.459063:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788540966.459067:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a682e75ec00/0x2aac941e5f4a7505 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a74fe expref: 21 pid: 6512 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540966.459074:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a682e75ec00/0x2aac941e5f4a7505 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a74fe expref: 21 pid: 6512 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540966.459187:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a682e75ec00/0x2aac941e5f4a7505 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a74fe expref: 21 pid: 6512 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540966.459195:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788540966.459215:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+20:3641:x1875420981003008:12345-0@lo:103: Request processed in 158us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540966.459221:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788540966.459244:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420981003008:0@lo:103: 00000100:00100000:3.0:1788540966.459250:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420981002880:0@lo:103: 00010000:00010000:2.0:1788540966.459498:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1788540966.459505:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+3:6512:x1875420981002624:12345-0@lo:104: Request processed in 1368us (1776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540966.459512:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788540966.459536:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788540966.459551:0:6501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540966.459558:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981002752 00000100:00100000:2.0:1788540966.459561:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981002752 00000100:00100000:2.0:1788540966.459574:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981003136 00000100:00100000:2.0:1788540966.459576:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981003136 00000100:00100000:2.0:1788540966.459583:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981003264 00000100:00100000:2.0:1788540966.459584:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981003264 00000100:00100000:2.0:1788540966.459591:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981003392 00000100:00100000:2.0:1788540966.459593:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981003392 00000100:00100000:2.0:1788540966.459600:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981003520 00000100:00100000:2.0:1788540966.459602:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981003520 00000100:00100000:2.0:1788540966.459611:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788540966.459616:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706919f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+7:6512:x1875420981002752:12345-0@lo:104: 00010000:00010000:2.0:1788540966.459623:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a6842172c00/0x2aac941e5f4a74e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a74e9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.459698:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788540966.459703:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706919f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+7:6512:x1875420981002752:12345-0@lo:104: Request processed in 88us (1874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540966.459709:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788540966.459720:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788540966.459725:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706919880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+6:6512:x1875420981003136:12345-0@lo:104: 00010000:00010000:2.0:1788540966.459732:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a6842173400/0x2aac941e5f4a74b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a74bf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.459757:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788540966.459761:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706919880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+6:6512:x1875420981003136:12345-0@lo:104: Request processed in 37us (1174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540966.459766:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788540966.459781:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788540966.459786:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706919c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+5:6512:x1875420981003264:12345-0@lo:104: 00010000:00010000:2.0:1788540966.459793:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a68354da200/0x2aac941e5f4a749c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a74a3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.459814:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788540966.459818:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706919c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+5:6512:x1875420981003264:12345-0@lo:104: Request processed in 33us (1172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540966.459823:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788540966.459831:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788540966.459835:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f2e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+4:6512:x1875420981003392:12345-0@lo:104: 00010000:00010000:2.0:1788540966.459842:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a68354da000/0x2aac941e5f4a745d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a7464 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.459895:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788540966.459900:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f2e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+4:6512:x1875420981003392:12345-0@lo:104: Request processed in 64us (1193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540966.459905:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788540966.459940:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788540966.459946:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706833100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+3:6512:x1875420981003520:12345-0@lo:104: 00010000:00010000:2.0:1788540966.459953:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a6842049e00/0x2aac941e5f4a7433 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a743a expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.459976:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788540966.459980:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706833100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+3:6512:x1875420981003520:12345-0@lo:104: Request processed in 36us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540966.459985:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1788540966.460007:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788540966.460013:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a6842172c00/0x2aac941e5f4a74e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a74e9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.460020:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842172c00 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:2.0:1788540966.460023:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a6842172c00/0x2aac941e5f4a74e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a74e9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.460030:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a6842172c00/0x2aac941e5f4a74e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a74e9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788540966.460038:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a6842172c00/0x2aac941e5f4a74e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a74e9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788540966.460044:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788540966.460066:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a6842172c00/0x2aac941e5f4a74e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a74e9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.460071:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788540966.460215:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788540966.460221:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a6842173400/0x2aac941e5f4a74b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a74bf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540966.460227:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842173400 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:0.0:1788540966.460229:0:8446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a6842173400/0x2aac941e5f4a74b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a74bf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540966.460236:0:8446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a6842173400/0x2aac941e5f4a74b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a74bf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788540966.460242:0:8446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a6842173400/0x2aac941e5f4a74b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a74bf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788540966.460247:0:8446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788540966.460262:0:8446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a6842173400/0x2aac941e5f4a74b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a74bf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540966.460267:0:8446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788540966.460300:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a6842172c00/0x2aac941e5f4a74e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a74e9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.460307:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a6842172c00/0x2aac941e5f4a74e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a74e9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.460318:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788540966.460321:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a68354da200/0x2aac941e5f4a749c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a74a3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.460326:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68354da200 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:2.0:1788540966.460330:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a68354da200/0x2aac941e5f4a749c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a74a3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.460341:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a68354da200/0x2aac941e5f4a749c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a74a3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788540966.460347:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a68354da200/0x2aac941e5f4a749c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a74a3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788540966.460351:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788540966.460364:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a68354da200/0x2aac941e5f4a749c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a74a3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.460370:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788540966.460396:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a68354da200/0x2aac941e5f4a749c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a74a3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.460402:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a68354da200/0x2aac941e5f4a749c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a74a3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.460411:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788540966.460414:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a68354da000/0x2aac941e5f4a745d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a7464 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.460418:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68354da000 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:2.0:1788540966.460421:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a68354da000/0x2aac941e5f4a745d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a7464 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.460428:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a68354da000/0x2aac941e5f4a745d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a7464 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788540966.460434:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a68354da000/0x2aac941e5f4a745d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a7464 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788540966.460444:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788540966.460458:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a68354da000/0x2aac941e5f4a745d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7464 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.460464:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788540966.460469:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a68354da000/0x2aac941e5f4a745d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7464 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.460475:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a68354da000/0x2aac941e5f4a745d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7464 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.460482:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788540966.460485:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a6842049e00/0x2aac941e5f4a7433 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a743a expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.460491:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842049e00 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:2.0:1788540966.460493:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a6842049e00/0x2aac941e5f4a7433 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a743a expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.460499:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a6842049e00/0x2aac941e5f4a7433 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a743a expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788540966.460505:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a6842049e00/0x2aac941e5f4a7433 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a743a expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788540966.460511:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788540966.460522:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a6842049e00/0x2aac941e5f4a7433 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a743a expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.460527:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788540966.460537:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a6842049e00/0x2aac941e5f4a7433 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a743a expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.460544:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a6842049e00/0x2aac941e5f4a7433 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a743a expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.460554:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540966.460556:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540966.460558:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788540966.460569:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420981003648:0@lo:103: 00000100:00100000:2.0:1788540966.460599:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540966.460629:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420981004160:0@lo:103: 00000100:00100000:2.0:1788540966.460651:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540966.460829:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420981004032:0@lo:103: 00000100:00100000:1.0:1788540966.460866:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540966.460904:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788540966.460909:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420981003904:0@lo:103: 00000100:00100000:1.0:1788540966.460937:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540966.461073:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670691a680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6512:1875420981002752:0@lo:104: 00000100:00100000:3.0:1788540966.461151:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706918a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6512:1875420981003136:0@lo:104: 00000100:00100000:3.0:1788540966.461160:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706919180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6512:1875420981003264:0@lo:104: 00000100:00100000:3.0:1788540966.461167:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e2300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6512:1875420981003392:0@lo:104: 00000100:00100000:3.0:1788540966.461175:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e3b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6512:1875420981003520:0@lo:104: 00010000:00010000:3.0:1788540966.461204:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a6842172a00/0x2aac941e5f4a7544 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540966.461226:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:425687b6-1d99-41d2-88d8-2fb230997596:3644:1875420981003776:0@lo:103: 00000100:00100000:3.0:1788540966.461250:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788540966.461311:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a6842173400/0x2aac941e5f4a74b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a74bf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540966.461319:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a6842173400/0x2aac941e5f4a74b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a74bf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540966.461333:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788540966.461341:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788540966.461342:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788540966.461500:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981003648 00000100:00100000:2.0:1788540966.461506:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981003648 00010000:00010000:2.0:1788540966.461527:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a682e75e800/0x2aac941e5f4a74e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a74e2 expref: 20 pid: 6509 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540966.461543:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981004160 00000100:00100000:2.0:1788540966.461546:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981004160 00010000:00010000:2.0:1788540966.461570:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a68354db200/0x2aac941e5f4a743a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a7433 expref: 21 pid: 6512 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540966.461582:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981004032 00000100:00100000:2.0:1788540966.461585:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981004032 00010000:00010000:2.0:1788540966.461595:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a682e75ea00/0x2aac941e5f4a7464 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a745d expref: 22 pid: 6511 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540966.461604:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981003904 00000100:00100000:2.0:1788540966.461606:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981003904 00010000:00010000:2.0:1788540966.461615:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6842048800/0x2aac941e5f4a74a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a749c expref: 23 pid: 6509 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540966.461633:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981003776 00000100:00100000:2.0:1788540966.461636:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981003776 00010000:00010000:2.0:1788540966.461648:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a682e75f200/0x2aac941e5f4a74bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a74b8 expref: 24 pid: 6511 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540966.461660:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788540966.461733:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706830380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:425687b6-1d99-41d2-88d8-2fb230997596+24:3643:x1875420981003648:12345-0@lo:103: 00010000:00010000:2.0:1788540966.461746:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788540966.461751:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a682e75e800/0x2aac941e5f4a74e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a74e2 expref: 24 pid: 6509 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.461762:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a682e75e800/0x2aac941e5f4a74e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a74e2 expref: 24 pid: 6509 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.461776:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a682e75e800/0x2aac941e5f4a74e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a74e2 expref: 24 pid: 6509 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.461788:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788540966.461833:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706830380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:425687b6-1d99-41d2-88d8-2fb230997596+23:3643:x1875420981003648:12345-0@lo:103: Request processed in 165us (1232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540966.461840:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788540966.461866:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1788540966.461935:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788540966.462094:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680763e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:425687b6-1d99-41d2-88d8-2fb230997596+22:3643:x1875420981004160:12345-0@lo:103: 00010000:00010000:2.0:1788540966.462103:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788540966.462108:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a68354db200/0x2aac941e5f4a743a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a7433 expref: 22 pid: 6512 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.462116:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a68354db200/0x2aac941e5f4a743a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a7433 expref: 22 pid: 6512 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.462134:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a68354db200/0x2aac941e5f4a743a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a7433 expref: 22 pid: 6512 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.462144:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788540966.462169:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680763e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:425687b6-1d99-41d2-88d8-2fb230997596+21:3643:x1875420981004160:12345-0@lo:103: Request processed in 79us (1517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540966.462275:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420981003648:0@lo:103: 00000100:00100000:0.0:1788540966.462283:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420981004160:0@lo:103: 00000100:00100000:3.0:1788540966.462842:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788540966.462862:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f0ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+21:3642:x1875420981004032:12345-0@lo:103: 00010000:00010000:3.0:1788540966.462909:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788540966.462914:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a682e75ea00/0x2aac941e5f4a7464 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a745d expref: 21 pid: 6511 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540966.462934:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a682e75ea00/0x2aac941e5f4a7464 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a745d expref: 21 pid: 6511 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540966.462945:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a682e75ea00/0x2aac941e5f4a7464 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a745d expref: 21 pid: 6511 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540966.462954:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788540966.462988:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f0ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+20:3642:x1875420981004032:12345-0@lo:103: Request processed in 129us (2121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540966.462994:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788540966.463009:0:6502:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788540966.463015:0:6502:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1788540966.463124:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788540966.463130:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f0fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+19:3642:x1875420981003904:12345-0@lo:103: 00010000:00010000:3.0:1788540966.463138:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788540966.463142:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6842048800/0x2aac941e5f4a74a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a749c expref: 19 pid: 6509 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540966.463150:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6842048800/0x2aac941e5f4a74a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a749c expref: 19 pid: 6509 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540966.463160:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6842048800/0x2aac941e5f4a74a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a749c expref: 19 pid: 6509 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540966.463169:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788540966.463188:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f0fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+18:3642:x1875420981003904:12345-0@lo:103: Request processed in 58us (2250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540966.463193:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788540966.463203:0:6502:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788540966.463213:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788540966.463219:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+17:3644:x1875420981003776:12345-0@lo:103: 00010000:00010000:3.0:1788540966.463226:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788540966.463230:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a682e75f200/0x2aac941e5f4a74bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a74b8 expref: 17 pid: 6511 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540966.463238:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a682e75f200/0x2aac941e5f4a74bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a74b8 expref: 17 pid: 6511 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540966.463247:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a682e75f200/0x2aac941e5f4a74bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a74b8 expref: 17 pid: 6511 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540966.463257:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a6842172a00/0x2aac941e5f4a7544 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540966.463266:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6842172a00/0x2aac941e5f4a7544 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540966.463279:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6842172a00/0x2aac941e5f4a7544 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540966.463286:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6842172a00/0x2aac941e5f4a7544 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540966.463294:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a6842172a00/0x2aac941e5f4a7544 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540966.463300:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a6842172a00/0x2aac941e5f4a7544 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540966.463306:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842172a00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:3.0:1788540966.463311:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a6842172a00/0x2aac941e5f4a7544 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540966.463323:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a6842172a00/0x2aac941e5f4a7544 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540966.463336:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a6842172a00/0x2aac941e5f4a7544 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540966.463346:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788540966.463370:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+16:3644:x1875420981003776:12345-0@lo:103: Request processed in 151us (2119us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540966.463388:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788540966.463604:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420981003904:0@lo:103: 00000100:00100000:1.0:1788540966.463613:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420981004032:0@lo:103: 00010000:00010000:3.0:1788540966.463796:0:6512:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a6842172a00/0x2aac941e5f4a7544 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540966.463805:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a6842172a00/0x2aac941e5f4a7544 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540966.463812:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6842172a00/0x2aac941e5f4a7544 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788540966.463826:0:6512:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788540966.463897:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:425687b6-1d99-41d2-88d8-2fb230997596:3644:1875420981003776:0@lo:103: 00000100:00100000:3.0:1788540966.466339:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807635c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+15:9509:x1875420981002368:12345-0@lo:253: Request processed in 28225us (30249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540966.466352:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788540966.466544:0:9509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f0fce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:9509:1875420981002368:0@lo:253: 10000000:01000000:1.0:1788540966.466560:0:9509:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788540966.466564:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788540966.466566:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788540966.466567:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788540966.466568:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1788540966.466570:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788540966.466571:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788540966.466572:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788540966.466574:0:9509:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788540966.466575:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788540966.466577:0:9509:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788540966.466599:0:9509:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a67067e3800 from lustre-OST0001 10000000:01000000:1.0:1788540966.466629:0:9509:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788540966.466632:0:9509:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788540966.466640:0:9509:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a682e74b380 local copy 10000000:01000000:1.0:1788540966.466644:0:9509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788540966.466687:0:9509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68354dbe00/0x2aac941e5f4a754b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540966.466698:0:9509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.156@tcp lock: ffff9a68354dbe00/0x2aac941e5f4a754b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540966.466707:0:9509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a68354dbe00/0x2aac941e5f4a754b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540966.466724:0:9509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f0fce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:9509:1875420981004288:0@lo:101: 00000100:00100000:1.0:1788540966.466763:0:9509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540966.466796:0:9509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6811488240 going to sleep for 11 seconds 00000100:00100000:3.0:1788540966.466842:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981004288 00000100:00100000:3.0:1788540966.466856:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981004288 00000100:00100000:3.0:1788540966.466917:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788540966.466925:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+15:9509:x1875420981004288:12345-0@lo:101: 00010000:00010000:3.0:1788540966.466945:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788540966.466957:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6842172000/0x2aac941e5f4a7552 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a754b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540966.466979:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6842172000/0x2aac941e5f4a7552 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a754b expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540966.466990:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6842172000/0x2aac941e5f4a7552 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a754b expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540966.466999:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6842172000, rc 0) 00000100:00100000:3.0:1788540966.467033:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+16:9509:x1875420981004288:12345-0@lo:101: Request processed in 109us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540966.467038:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788540966.467209:0:9509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f0fce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:9509:1875420981004288:0@lo:101: 00010000:00010000:1.0:1788540966.467221:0:9509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a68354dbe00/0x2aac941e5f4a754b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x2aac941e5f4a7552 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540966.467229:0:9509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a68354dbe00/0x2aac941e5f4a754b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2aac941e5f4a7552 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540966.467316:0:9509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f0fce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:9509:1875420981004416:0@lo:501: 00000100:00100000:1.0:1788540966.467340:0:9509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540966.467367:0:9509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6811488240 going to sleep for 11 seconds 00000100:00100000:3.0:1788540966.467649:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981004416 00000100:00100000:3.0:1788540966.467654:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981004416 00000100:00100000:3.0:1788540966.467689:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788540966.467696:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+16:9509:x1875420981004416:12345-0@lo:501: 00000100:00100000:3.0:1788540966.467757:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+16:9509:x1875420981004416:12345-0@lo:501: Request processed in 62us (416us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788540966.467763:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788540966.467982:0:9509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f0fce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:9509:1875420981004416:0@lo:501: 10000000:01000000:1.0:1788540966.467998:0:9509:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.156@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788540966.468013:0:9509:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.156@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788540966.468018:0:9509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68354dbe00/0x2aac941e5f4a754b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2aac941e5f4a7552 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540966.468026:0:9509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68354dbe00/0x2aac941e5f4a754b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2aac941e5f4a7552 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540966.468033:0:9509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.156@tcp lock: ffff9a68354dbe00/0x2aac941e5f4a754b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2aac941e5f4a7552 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540966.468052:0:9509:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788540966.468071:0:9509:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a67067e3800 10000000:01000000:1.0:1788540966.468076:0:9509:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788540966.468142:0:9509:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788540966.468153:0:9509:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788540966.468157:0:9509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788540966.468159:0:9509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788540966.468175:0:9509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68354da800/0x2aac941e5f4a7559 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540966.468183:0:9509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a68354da800/0x2aac941e5f4a7559 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540966.468192:0:9509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a68354da800/0x2aac941e5f4a7559 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540966.468204:0:9509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f0fce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:9509:1875420981004544:0@lo:101: 00000100:00100000:1.0:1788540966.468227:0:9509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540966.468250:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981004544 00000100:00100000:1.0:1788540966.468253:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981004544 00000100:00100000:1.0:1788540966.468278:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788540966.468284:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807636850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+16:9509:x1875420981004544:12345-0@lo:101: 00010000:00010000:1.0:1788540966.468291:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788540966.468299:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a68354db600/0x2aac941e5f4a7560 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a7559 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540966.468314:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68354db600/0x2aac941e5f4a7560 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a7559 expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540966.468322:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a68354db600/0x2aac941e5f4a7560 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a7559 expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540966.468329:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68354db600, rc 0) 00000100:00100000:1.0:1788540966.468350:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807636850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+17:9509:x1875420981004544:12345-0@lo:101: Request processed in 67us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540966.468361:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788540966.468502:0:9509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6811488c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788540966.468516:0:9509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f0fce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:9509:1875420981004544:0@lo:101: 00010000:00010000:1.0:1788540966.468526:0:9509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a68354da800/0x2aac941e5f4a7559 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7560 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540966.468533:0:9509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a68354da800/0x2aac941e5f4a7559 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a7560 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540966.468581:0:9509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f0fce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:9509:1875420981004672:0@lo:501: 00000100:00100000:1.0:1788540966.468605:0:9509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540966.468623:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981004672 00000100:00100000:1.0:1788540966.468627:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981004672 00000100:00100000:1.0:1788540966.468649:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788540966.468655:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e78bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+17:9509:x1875420981004672:12345-0@lo:501: 00000100:00100000:1.0:1788540966.468737:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e78bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+17:9509:x1875420981004672:12345-0@lo:501: Request processed in 81us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540966.468743:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788540966.468764:0:9509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6811488c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788540966.468774:0:9509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f0fce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:9509:1875420981004672:0@lo:501: 00000100:00100000:1.0:1788540966.468796:0:9509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f0fce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:9509:1875420981004800:0@lo:503: 00010000:00010000:3.0:1788540966.470069:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788540966.470089:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a68354dbe00/0x2aac941e5f4a754b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x2aac941e5f4a7552 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540966.470101:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68354dbe00 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:3.0:1788540966.470106:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a68354dbe00/0x2aac941e5f4a754b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x2aac941e5f4a7552 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540966.470131:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a68354dbe00/0x2aac941e5f4a754b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x2aac941e5f4a7552 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788540966.470139:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a68354dbe00/0x2aac941e5f4a754b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x2aac941e5f4a7552 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788540966.470145:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788540966.470170:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a68354dbe00/0x2aac941e5f4a754b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2aac941e5f4a7552 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540966.470175:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788540966.470203:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a68354dbe00/0x2aac941e5f4a754b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2aac941e5f4a7552 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540966.470212:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a68354dbe00/0x2aac941e5f4a754b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2aac941e5f4a7552 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540966.470231:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788540966.470233:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788540966.470234:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788540966.470243:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788540966.470259:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420981004928:0@lo:103: 00000100:00100000:3.0:1788540966.470321:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540966.470622:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981004928 00000100:00100000:3.0:1788540966.470631:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981004928 00000100:00100000:3.0:1788540966.470696:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788540966.470706:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+17:3643:x1875420981004928:12345-0@lo:103: 00010000:00010000:3.0:1788540966.470721:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788540966.470735:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6842172000/0x2aac941e5f4a7552 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2aac941e5f4a754b expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540966.470758:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788540966.470791:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+16:3643:x1875420981004928:12345-0@lo:103: Request processed in 86us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540966.470799:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788540966.470832:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420981004928:0@lo:103: 00000100:00100000:1.0:1788540966.471152:0:9509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540966.471206:0:9509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6807d1d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788540966.471273:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788540966.471480:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981004800 00000100:00100000:0.0:1788540966.471485:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981004800 00000100:00100000:0.0:1788540966.471554:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788540966.471562:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e78a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+15:9509:x1875420981004800:12345-0@lo:503: 00000100:00100000:0.0:1788540966.471682:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e78a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+15:9509:x1875420981004800:12345-0@lo:503: Request processed in 121us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540966.471689:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788540966.471753:0:9509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f0fce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:9509:1875420981004800:0@lo:503: 00000040:00080000:2.0:1788540966.472101:0:9509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788540966.472169:0:9509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706830380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:9509:1875420981005056:0@lo:502: 00000100:00100000:2.0:1788540966.472218:0:9509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540966.472691:0:9509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6807619480 going to sleep for 11 seconds 00000100:00100000:1.0:1788540966.472807:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981005056 00000100:00100000:1.0:1788540966.472812:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981005056 00000100:00100000:1.0:1788540966.472837:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788540966.472867:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e78a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+15:9509:x1875420981005056:12345-0@lo:502: 00000100:00100000:1.0:1788540966.473019:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e78a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+15:9509:x1875420981005056:12345-0@lo:502: Request processed in 153us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540966.473026:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788540966.473148:0:9509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706830380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:9509:1875420981005056:0@lo:502: 00000040:00080000:2.0:1788540966.473571:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788540966.473598:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788540966.473611:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788540966.473625:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788540966.473637:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788540966.473726:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788540966.473754:0:9509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706830380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:9509:1875420981005184:0@lo:502: 00000100:00100000:2.0:1788540966.473791:0:9509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540966.473818:0:9509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6807619480 going to sleep for 11 seconds 00000100:00100000:1.0:1788540966.473988:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981005184 00000100:00100000:1.0:1788540966.473992:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981005184 00000100:00100000:1.0:1788540966.474013:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788540966.474020:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e78a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+15:9509:x1875420981005184:12345-0@lo:502: 00000100:00100000:1.0:1788540966.474104:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e78a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+15:9509:x1875420981005184:12345-0@lo:502: Request processed in 83us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540966.474112:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788540966.474359:0:9509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706830380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:9509:1875420981005184:0@lo:502: 00000040:00080000:1.0:1788540966.474590:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788540966.474599:0:9509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:2.0:1788540966.475599:0:9521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788540966.475608:0:9521:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1788540966.475614:0:9521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788540966.475621:0:9521:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788540966.475629:0:9521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788540966.475644:0:9521:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9a683f3699c0) 00000020:00000080:2.0:1788540966.475952:0:9521:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788540966.475963:0:9521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788540966.476038:0:9521:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a67067e3800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788540966.476047:0:9521:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788540966.476054:0:9521:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2aac941e5f4a756e 00010000:00010000:3.0:1788540966.481188:0:9521:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:3.0:1788540966.481834:0:9521:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1788540966.484926:0:9521:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788540966.485300:0:9521:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1788540966.490630:0:9521:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1788540966.491043:0:9521:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1788540966.496798:0:9521:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1788540966.498113:0:9521:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788540966.498126:0:9521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788540966.498133:0:9521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788540966.498135:0:9521:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788540966.498144:0:9521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788540966.498148:0:9521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788540966.498150:0:9521:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788540966.498154:0:9521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788540966.498156:0:9521:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788540966.498176:0:9521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788540966.498179:0:9521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788540966.498180:0:9521:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788540966.498183:0:9521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788540966.498468:0:9509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1788540966.498503:0:9509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788540966.498526:0:9509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68354da800/0x2aac941e5f4a7559 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7560 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540966.498539:0:9509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a68354da800/0x2aac941e5f4a7559 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7560 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788540966.498548:0:9509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a67067e3800 from 1 10000000:01000000:1.0:1788540966.498550:0:9509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788540966.498588:0:9509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68354daa00/0x2aac941e5f4a7575 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540966.498597:0:9509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a68354daa00/0x2aac941e5f4a7575 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540966.498624:0:9509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a68354daa00/0x2aac941e5f4a7575 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540966.498648:0:9509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f0fc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:9509:1875420981005312:0@lo:101: 00000100:00100000:1.0:1788540966.498735:0:9509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540966.498779:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981005312 00000100:00100000:1.0:1788540966.498787:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981005312 00000100:00100000:1.0:1788540966.498831:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788540966.498840:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e788c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+15:9509:x1875420981005312:12345-0@lo:101: 00010000:00010000:1.0:1788540966.498864:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788540966.498901:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a68354dbe00/0x2aac941e5f4a757c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a7575 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540966.498926:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68354dbe00/0x2aac941e5f4a757c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a7575 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540966.498935:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a68354dbe00/0x2aac941e5f4a757c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a7575 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540966.498944:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68354dbe00, rc 0) 00000100:00100000:1.0:1788540966.498975:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e788c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+16:9509:x1875420981005312:12345-0@lo:101: Request processed in 137us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540966.498982:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788540966.499029:0:9509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6807d1d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788540966.499052:0:9509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f0fc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:9509:1875420981005312:0@lo:101: 00010000:00010000:1.0:1788540966.499067:0:9509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a68354daa00/0x2aac941e5f4a7575 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a757c expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540966.500180:0:9509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a68354daa00/0x2aac941e5f4a7575 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a757c expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540966.500269:0:9509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f0fc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:9509:1875420981005440:0@lo:501: 00000100:00100000:1.0:1788540966.500308:0:9509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540966.500336:0:9509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6807d1d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788540966.500925:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981005440 00000100:00100000:0.0:1788540966.500933:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981005440 00000100:00100000:0.0:1788540966.500975:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788540966.500983:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e78b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+16:9509:x1875420981005440:12345-0@lo:501: 00000100:00100000:0.0:1788540966.501474:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e78b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+16:9509:x1875420981005440:12345-0@lo:501: Request processed in 490us (1163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540966.501488:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788540966.501649:0:9509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f0fc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:9509:1875420981005440:0@lo:501: 00000100:00100000:1.0:1788540966.501755:0:9509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f0fc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:9509:1875420981005568:0@lo:503: 00000100:00100000:1.0:1788540966.501801:0:9509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540966.501829:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981005568 00000100:00100000:1.0:1788540966.501835:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981005568 00000100:00100000:1.0:1788540966.501894:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788540966.501902:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e78b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+16:9509:x1875420981005568:12345-0@lo:503: 00000100:00100000:1.0:1788540966.501983:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e78b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+16:9509:x1875420981005568:12345-0@lo:503: Request processed in 81us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540966.501990:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788540966.502034:0:9509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6807d1d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788540966.502046:0:9509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f0fc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:9509:1875420981005568:0@lo:503: 00000040:00080000:1.0:1788540966.505654:0:9509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788540966.506638:0:9509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f0fc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:9509:1875420981005696:0@lo:502: 00000100:00100000:1.0:1788540966.506739:0:9509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540966.506787:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981005696 00000100:00100000:1.0:1788540966.506793:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981005696 00000100:00100000:1.0:1788540966.506834:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788540966.506889:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e789450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+16:9509:x1875420981005696:12345-0@lo:502: 00000100:00100000:1.0:1788540966.507006:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e789450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+16:9509:x1875420981005696:12345-0@lo:502: Request processed in 163us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540966.507014:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788540966.507068:0:9509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6807d1d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788540966.507101:0:9509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f0fc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:9509:1875420981005696:0@lo:502: 00000040:00080000:1.0:1788540966.507300:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788540966.507326:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788540966.507345:0:9509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f0fc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:9509:1875420981005824:0@lo:502: 00000100:00100000:1.0:1788540966.507377:0:9509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540966.507411:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981005824 00000100:00100000:1.0:1788540966.507415:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981005824 00000100:00100000:1.0:1788540966.507440:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788540966.507447:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e789c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+16:9509:x1875420981005824:12345-0@lo:502: 00000100:00100000:1.0:1788540966.507503:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e789c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+16:9509:x1875420981005824:12345-0@lo:502: Request processed in 56us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540966.507509:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788540966.507537:0:9509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6807d1d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788540966.507547:0:9509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f0fc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:9509:1875420981005824:0@lo:502: 00000040:00080000:1.0:1788540966.507578:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788540966.507585:0:9509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788540966.510619:0:9525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788540966.510633:0:9525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788540966.510636:0:9525:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788540966.510647:0:9525:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a67067e3800 00000020:00000080:2.0:1788540966.510651:0:9525:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788540966.510663:0:9525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788540966.510665:0:9525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788540966.510678:0:9525:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788540966.510682:0:9525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788540966.511539:0:9509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788540966.511579:0:9509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788540966.511613:0:9509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68354daa00/0x2aac941e5f4a7575 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a757c expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540966.511628:0:9509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a68354daa00/0x2aac941e5f4a7575 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a757c expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788540966.511717:0:9509:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788540966.511721:0:9509:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a67067e3800 10000000:01000000:1.0:1788540966.511725:0:9509:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a67067e3800 10000000:01000000:1.0:1788540966.511730:0:9509:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788540966.511738:0:9509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a67067e3800 from 1 10000000:01000000:1.0:1788540966.511741:0:9509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788540966.511780:0:9509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68354db200/0x2aac941e5f4a7583 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540966.511788:0:9509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a68354db200/0x2aac941e5f4a7583 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540966.511800:0:9509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a68354db200/0x2aac941e5f4a7583 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540966.511823:0:9509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f0fc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:9509:1875420981005952:0@lo:101: 00000100:00100000:1.0:1788540966.512457:0:9509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540966.512503:0:9509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6807d1db40 going to sleep for 11 seconds 00000100:00100000:2.0:1788540966.512622:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981005952 00000100:00100000:2.0:1788540966.512630:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981005952 00000100:00100000:2.0:1788540966.512688:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788540966.512698:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+16:9509:x1875420981005952:12345-0@lo:101: 00010000:00010000:2.0:1788540966.512722:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788540966.512736:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a683551b400/0x2aac941e5f4a758a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a7583 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.512762:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a683551b400/0x2aac941e5f4a758a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a7583 expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.512774:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a683551b400/0x2aac941e5f4a758a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a7583 expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.512784:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a683551b400, rc 0) 00000100:00100000:2.0:1788540966.512860:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+17:9509:x1875420981005952:12345-0@lo:101: Request processed in 163us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540966.512866:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788540966.513047:0:9509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f0fc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:9509:1875420981005952:0@lo:101: 00010000:00010000:3.0:1788540966.513063:0:9509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a68354db200/0x2aac941e5f4a7583 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a758a expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540966.513072:0:9509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a68354db200/0x2aac941e5f4a7583 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a758a expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540966.513189:0:9509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:9509:1875420981006080:0@lo:501: 00000100:00100000:3.0:1788540966.513217:0:9509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540966.513246:0:9509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683543c300 going to sleep for 11 seconds 00000100:00100000:2.0:1788540966.514060:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981006080 00000100:00100000:2.0:1788540966.514067:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981006080 00000100:00100000:2.0:1788540966.514112:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788540966.514120:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+17:9509:x1875420981006080:12345-0@lo:501: 00000100:00100000:2.0:1788540966.514256:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+17:9509:x1875420981006080:12345-0@lo:501: Request processed in 136us (1036us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540966.514263:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788540966.514308:0:9509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:9509:1875420981006080:0@lo:501: 00000100:00100000:2.0:1788540966.514350:0:9509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706830380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:9509:1875420981006208:0@lo:503: 00000100:00100000:2.0:1788540966.514509:0:9509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540966.514532:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981006208 00000100:00100000:2.0:1788540966.514536:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981006208 00000100:00100000:2.0:1788540966.514552:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788540966.514557:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+17:9509:x1875420981006208:12345-0@lo:503: 00000100:00100000:2.0:1788540966.514627:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+17:9509:x1875420981006208:12345-0@lo:503: Request processed in 69us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540966.514634:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788540966.514748:0:9509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6807619cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788540966.514764:0:9509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706830380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:9509:1875420981006208:0@lo:503: 00000040:00080000:2.0:1788540966.515048:0:9509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788540966.515484:0:9509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706830380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:9509:1875420981006336:0@lo:502: 00000100:00100000:2.0:1788540966.515537:0:9509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540966.515602:0:9509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6807619cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788540966.522557:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981006336 00000100:00100000:3.0:1788540966.522575:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981006336 00000100:00100000:3.0:1788540966.522700:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788540966.522711:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+17:9509:x1875420981006336:12345-0@lo:502: 00000100:00100000:3.0:1788540966.522968:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+17:9509:x1875420981006336:12345-0@lo:502: Request processed in 259us (7430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540966.522976:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788540966.526026:0:9509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706830380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:9509:1875420981006336:0@lo:502: 00000040:00080000:2.0:1788540966.527074:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788540966.527167:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788540966.527183:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788540966.527196:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788540966.527208:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788540966.527234:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788540966.527248:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788540966.527261:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788540966.527273:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788540966.527284:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788540966.527295:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788540966.527306:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788540966.527315:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788540966.527326:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788540966.527336:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788540966.527346:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788540966.527356:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788540966.527366:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788540966.527553:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788540966.527576:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788540966.527590:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788540966.527615:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788540966.527628:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788540966.527640:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788540966.527653:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1788540966.527666:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1788540966.527754:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1788540966.527767:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1788540966.527779:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1788540966.527791:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1788540966.527805:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1788540966.527827:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1788540966.527838:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1788540966.528182:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1788540966.528201:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1788540966.528213:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1788540966.528225:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:2.0:1788540966.528253:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1788540966.528269:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:2.0:1788540966.528281:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:2.0:1788540966.528295:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:2.0:1788540966.528307:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:2.0:1788540966.528321:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:2.0:1788540966.528334:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:2.0:1788540966.528347:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:2.0:1788540966.528358:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:2.0:1788540966.529263:0:9509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706830380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:9509:1875420981006464:0@lo:502: 00000100:00100000:2.0:1788540966.529342:0:9509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540966.529501:0:9509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6807619cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788540966.529596:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981006464 00000100:00100000:1.0:1788540966.529604:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981006464 00000100:00100000:1.0:1788540966.529684:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788540966.529694:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+17:9509:x1875420981006464:12345-0@lo:502: 00000100:00100000:1.0:1788540966.529818:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+17:9509:x1875420981006464:12345-0@lo:502: Request processed in 125us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540966.529826:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788540966.529945:0:9509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706830380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:9509:1875420981006464:0@lo:502: 00000040:00080000:3.0:1788540966.530008:0:9509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:3.0:1788540966.530029:0:9509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:0.0:1788540966.531256:0:9526:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788540966.531271:0:9526:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9a6835310000) 00000020:00000080:0.0:1788540966.531293:0:9526:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:0.0:1788540966.531395:0:9526:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a67067e3800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788540966.531400:0:9526:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a67067e3800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788540966.531402:0:9526:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a67067e3800 3 00010000:00080000:0.0:1788540966.531430:0:9526:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a6705ae9800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.156@tcp at head 00010000:00010000:0.0:1788540966.537191:0:9526:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:0.0:1788540966.537448:0:9526:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788540966.537489:0:9526:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788540966.537501:0:9526:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x2aac941e5f4a7598 00000100:00080000:0.0:1788540966.537511:0:9526:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788540966.537517:0:9526:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a6705ae9800 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:0.0:1788540966.537549:0:9526:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a68355b6680 x1875420981006592/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788540966.537574:0:9526:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788540966.537938:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875420981006976:0@lo:400: 00000100:00100000:3.0:1788540966.538000:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540966.538038:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707729c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981007488:0@lo:400: 00000100:00100000:3.0:1788540966.538060:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540966.538301:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788540966.538309:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981007104:0@lo:400: 00000100:00100000:3.0:1788540966.538334:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540966.538350:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981007616:0@lo:400: 00000100:00100000:3.0:1788540966.538367:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540966.538458:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981006976 00000100:00100000:3.0:1788540966.538465:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981006976 00000100:00100000:3.0:1788540966.538504:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788540966.538512:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707728a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875420981006976:12345-0@lo:400: 00000100:00100000:3.0:1788540966.538558:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707728a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875420981006976:12345-0@lo:400: Request processed in 46us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540966.538565:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788540966.538583:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981007488 00000100:00100000:3.0:1788540966.538586:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981007488 00000100:00100000:3.0:1788540966.538609:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981007616 00000100:00100000:3.0:1788540966.538611:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981007616 00000100:00100000:3.0:1788540966.538636:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788540966.538642:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670772a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981007488:12345-0@lo:400: 00000100:00100000:3.0:1788540966.538728:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670772a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981007488:12345-0@lo:400: Request processed in 28us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540966.538734:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788540966.538745:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788540966.538751:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707728e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981007616:12345-0@lo:400: 00000100:00100000:3.0:1788540966.538776:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707728e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981007616:12345-0@lo:400: Request processed in 26us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540966.538782:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788540966.538798:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788540966.538821:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6707729180 x1875420981007616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788540982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540966.538834:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981007616:0@lo:400: 00010000:00080000:3.0:1788540966.538853:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68045e2d80 x1875420981006976/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540966.538863:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875420981006976:0@lo:400: 00010000:00080000:3.0:1788540966.538890:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6707729c00 x1875420981007488/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788540982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540966.538898:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707729c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981007488:0@lo:400: 00000100:00100000:1.0:1788540966.539106:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875420981006592:0@lo:38: 00000100:00100000:1.0:1788540966.539138:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540966.539187:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981006848:0@lo:400: 00000100:00100000:1.0:1788540966.539210:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540966.539225:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875420981007360:0@lo:400: 00000100:00100000:1.0:1788540966.539247:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540966.539264:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788540966.539270:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875420981006720:0@lo:400: 00000100:00100000:1.0:1788540966.539288:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540966.539301:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875420981007232:0@lo:400: 00000100:00100000:1.0:1788540966.539316:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540966.539333:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981007104 00000100:00100000:1.0:1788540966.539337:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981007104 00000100:00100000:1.0:1788540966.539354:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981006848 00000100:00100000:1.0:1788540966.539357:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981006848 00000100:00100000:1.0:1788540966.539368:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788540966.539373:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707728380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981007104:12345-0@lo:400: 00000100:00100000:1.0:1788540966.539419:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707728380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981007104:12345-0@lo:400: Request processed in 45us (1083us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540966.539425:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788540966.539440:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788540966.539446:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f0fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981006848:12345-0@lo:400: 00000100:00100000:1.0:1788540966.539471:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f0fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981006848:12345-0@lo:400: Request processed in 25us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540966.539476:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788540966.539496:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981006592 00000100:00100000:1.0:1788540966.539499:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981006592 00000100:00100000:1.0:1788540966.539508:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981007360 00000100:00100000:1.0:1788540966.539510:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981007360 00000100:00100000:1.0:1788540966.539526:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981006720 00000100:00100000:1.0:1788540966.539534:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981006720 00000100:00100000:1.0:1788540966.539549:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981007232 00000100:00100000:1.0:1788540966.539551:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981007232 00000100:00100000:1.0:1788540966.539564:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788540966.539569:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f0fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875420981007360:12345-0@lo:400: 00000100:00100000:1.0:1788540966.539596:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f0fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875420981007360:12345-0@lo:400: Request processed in 27us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540966.539601:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788540966.539612:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788540966.539618:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f0ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875420981006720:12345-0@lo:400: 00000100:00100000:1.0:1788540966.539640:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f0ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875420981006720:12345-0@lo:400: Request processed in 23us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540966.539645:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788540966.539655:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788540966.539660:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f0ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875420981007232:12345-0@lo:400: 00000100:00100000:1.0:1788540966.539697:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f0ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875420981007232:12345-0@lo:400: Request processed in 37us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540966.539702:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788540966.539712:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788540966.539716:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f0fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875420981006592:12345-0@lo:38: 00010000:00080000:1.0:1788540966.539738:0:9339:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 247 last 0 00000020:00000080:1.0:1788540966.539774:0:9339:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x2aac941e5f4a759f 00000004:00100000:1.0:1788540966.539790:0:9339:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788540966.539822:0:9339:0:(import.c:65:import_set_state_nolock()) ffff9a6705af9800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788540966.539891:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f0fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875420981006592:12345-0@lo:38: Request processed in 153us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540966.539897:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788540966.539917:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788540966.539920:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788540966.539939:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68355b6680 x1875420981006592/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788540976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540966.539948:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788540966.539954:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1788540966.539961:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788540966.539965:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788540966.539968:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a6705ae9800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788540966.539973:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875420981006592:0@lo:38: 00010000:00080000:1.0:1788540966.539999:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68045e0700 x1875420981006720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540966.540007:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875420981006720:0@lo:400: 00010000:00080000:1.0:1788540966.540029:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68045e2a00 x1875420981007232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540966.540036:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875420981007232:0@lo:400: 00000100:00100000:1.0:1788540966.540045:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981006848:0@lo:400: 00010000:00080000:1.0:1788540966.540052:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68045e0e00 x1875420981007360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540966.540059:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875420981007360:0@lo:400: 00000100:00100000:1.0:1788540966.540084:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981007104:0@lo:400: 00000020:01000004:1.0:1788540966.541652:0:9526:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788540966.541677:0:9526:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9a6706958000) 00000020:00000080:1.0:1788540966.541700:0:9526:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:1.0:1788540966.541787:0:9526:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a67067e3800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788540966.541791:0:9526:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a67067e3800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788540966.541794:0:9526:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a67067e3800 3 00010000:00080000:1.0:1788540966.541835:0:9526:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a6705aff000@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.156@tcp at head 00000100:00100000:0.0:1788540966.542608:0:9527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b6680 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9527:1875420981007744:0@lo:901: 00000100:00100000:0.0:1788540966.542702:0:9527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540966.542739:0:9527:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67069b20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788540966.542866:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981007744 00000100:00100000:3.0:1788540966.542899:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981007744 00000100:00100000:3.0:1788540966.542948:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788540966.542957:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9527:x1875420981007744:12345-0@lo:901: 00000100:00100000:3.0:1788540966.543064:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9527:x1875420981007744:12345-0@lo:901: Request processed in 107us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540966.543202:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788540966.543249:0:9527:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a68355b6680 x1875420981007744/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788540982 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540966.543262:0:9527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b6680 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9527:1875420981007744:0@lo:901: 00000100:00080000:0.0:1788540966.544716:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788540966.554036:0:9526:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:1.0:1788540966.554260:0:9526:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1788540966.554304:0:9526:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788540966.554316:0:9526:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x2aac941e5f4a75ad 00000100:00080000:1.0:1788540966.554327:0:9526:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788540966.554333:0:9526:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9a6705aff000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:1.0:1788540966.555682:0:9526:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a683f0fed80 x1875420981007872/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788540966.555716:0:9526:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788540966.555755:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f0fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875420981007872:0@lo:38: 00000100:00100000:3.0:1788540966.555826:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540966.555936:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981007872 00000100:00100000:1.0:1788540966.555945:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981007872 00000100:00100000:1.0:1788540966.555990:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788540966.555998:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707729c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875420981007872:12345-0@lo:38: 00010000:00080000:1.0:1788540966.556024:0:9339:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 247 last 0 00000020:00000080:1.0:1788540966.556075:0:9339:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x2aac941e5f4a75b4 00000004:00100000:1.0:1788540966.556091:0:9339:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788540966.556122:0:9339:0:(import.c:65:import_set_state_nolock()) ffff9a6705aec000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788540966.556176:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707729c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875420981007872:12345-0@lo:38: Request processed in 177us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540966.556184:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788540966.556224:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a683f0fed80 x1875420981007872/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788540976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540966.556234:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788540966.557186:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1788540966.557196:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788540966.557201:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788540966.557204:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a6705aff000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788540966.557211:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f0fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875420981007872:0@lo:38: 00000040:00080000:0.0:1788540966.558564:0:9526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:2.0:1788540966.560959:0:9509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:2.0:1788540966.561001:0:9509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788540966.561020:0:9509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68354db200/0x2aac941e5f4a7583 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a758a expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.561033:0:9509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a68354db200/0x2aac941e5f4a7583 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a758a expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788540966.561085:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788540966.561087:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788540966.561089:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788540966.561090:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788540966.561091:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788540966.561092:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788540966.561098:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788540966.561099:0:9509:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788540966.561100:0:9509:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788540966.561102:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788540966.561103:0:9509:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788540966.561107:0:9509:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1788540966.561109:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788540966.561110:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788540966.561111:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788540966.561112:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788540966.561113:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788540966.561114:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788540966.561115:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788540966.561116:0:9509:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788540966.561117:0:9509:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788540966.561118:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788540966.561119:0:9509:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788540966.561145:0:9509:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788540966.561163:0:9509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706830e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:9509:1875420981008000:0@lo:253: 00000100:00100000:2.0:1788540966.561226:0:9509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540966.561648:0:9509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6807619a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788540966.561676:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981008000 00000100:00100000:2.0:1788540966.561682:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981008000 00000100:00100000:2.0:1788540966.561731:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788540966.561741:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+17:9509:x1875420981008000:12345-0@lo:253: 20000000:01000000:2.0:1788540966.561766:0:6512:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788540966.561780:0:6512:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788540966.569492:0:6512:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788540966.569572:0:6512:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788540966.569693:0:6533:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788540966.569699:0:6533:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788540966.569720:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a75bb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540966.569740:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6842048e00/0x2aac941e5f4a74b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a74aa expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540966.569758:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a682e75f600/0x2aac941e5f4a74f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a74f0 expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540966.569765:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a75bb lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540966.569799:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a682e75f600/0x2aac941e5f4a74f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a74f0 expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540966.569814:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a682e75f600/0x2aac941e5f4a74f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a74f0 expref: 17 pid: 6509 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540966.569829:0:6533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b5c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1875420981008128:0@lo:104: 00000100:00100000:3.0:1788540966.569841:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+17:9509:x1875420981008000:12345-0@lo:253: Request processed in 8102us (8614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540966.569864:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788540966.570192:0:6533:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788540966.570242:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6842048e00/0x2aac941e5f4a74b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a74aa expref: 16 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540966.570251:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6842048e00/0x2aac941e5f4a74b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a74aa expref: 16 pid: 6509 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540966.570257:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981008128 00000100:00100000:0.0:1788540966.570258:0:6533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b7b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1875420981008256:0@lo:104: 00000100:00100000:2.0:1788540966.570264:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981008128 00000100:00100000:0.0:1788540966.570279:0:6533:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540966.570292:0:6533:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67069b29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788540966.570294:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981008256 00000100:00100000:2.0:1788540966.570297:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981008256 00000100:00100000:2.0:1788540966.570310:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788540966.570319:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+4:6533:x1875420981008128:12345-0@lo:104: 00010000:00010000:2.0:1788540966.570332:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a682e75fe00/0x2aac941e5f4a74f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a74f7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.570391:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788540966.570397:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+4:6533:x1875420981008128:12345-0@lo:104: Request processed in 80us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540966.570404:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788540966.570417:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788540966.570423:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+3:6533:x1875420981008256:12345-0@lo:104: 00010000:00010000:2.0:1788540966.570431:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a682e75fc00/0x2aac941e5f4a74aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a74b1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.570465:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788540966.570470:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+3:6533:x1875420981008256:12345-0@lo:104: Request processed in 47us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540966.570476:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1788540966.570492:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788540966.570566:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a682e75fe00/0x2aac941e5f4a74f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a74f7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.570574:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75fe00 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:2.0:1788540966.570578:0:8446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a682e75fe00/0x2aac941e5f4a74f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a74f7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.570585:0:8446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a682e75fe00/0x2aac941e5f4a74f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a74f7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788540966.570591:0:8446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a682e75fe00/0x2aac941e5f4a74f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a74f7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788540966.570596:0:8446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788540966.570632:0:8446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a682e75fe00/0x2aac941e5f4a74f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a74f7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.570638:0:8446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788540966.570654:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a682e75fe00/0x2aac941e5f4a74f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a74f7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.570660:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a682e75fe00/0x2aac941e5f4a74f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a74f7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.570767:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788540966.570771:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a682e75fc00/0x2aac941e5f4a74aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a74b1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.570777:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75fc00 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:2.0:1788540966.570780:0:8446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a682e75fc00/0x2aac941e5f4a74aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a74b1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.570786:0:8446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a682e75fc00/0x2aac941e5f4a74aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a74b1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788540966.570792:0:8446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a682e75fc00/0x2aac941e5f4a74aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a74b1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788540966.570797:0:8446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788540966.570810:0:8446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a682e75fc00/0x2aac941e5f4a74aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a74b1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.570816:0:8446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788540966.570819:0:9509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706830e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:425687b6-1d99-41d2-88d8-2fb230997596:9509:1875420981008000:0@lo:253: 00010000:00010000:2.0:1788540966.570821:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a682e75fc00/0x2aac941e5f4a74aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a74b1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788540966.570832:0:9509:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788540966.570836:0:9509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00010000:00010000:2.0:1788540966.570837:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a682e75fc00/0x2aac941e5f4a74aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a74b1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788540966.570837:0:9509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788540966.570839:0:9509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788540966.570840:0:9509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788540966.570842:0:9509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788540966.570843:0:9509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788540966.570855:0:9509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788540966.570856:0:9509:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788540966.570858:0:9509:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788540966.570859:0:9509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00010000:00010000:2.0:1788540966.570860:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540966.570861:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788540966.570861:0:9509:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:2.0:1788540966.570863:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540966.570882:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:02000000:1.0:1788540966.570890:0:9509:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788540966.570895:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420981008384:0@lo:103: 00000100:00100000:2.0:1788540966.570920:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540966.570942:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788540966.570948:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706831500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420981008512:0@lo:103: 00000100:00100000:2.0:1788540966.570967:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540966.570996:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981008384 00000100:00100000:2.0:1788540966.570999:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981008384 00010000:00010000:2.0:1788540966.571016:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a682e75f600/0x2aac941e5f4a74f7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a74f0 expref: 17 pid: 6509 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540966.571035:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981008512 00000100:00100000:2.0:1788540966.571038:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981008512 00010000:00010000:2.0:1788540966.571049:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6842048e00/0x2aac941e5f4a74b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a74aa expref: 18 pid: 6509 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540966.571067:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788540966.571074:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706830700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:425687b6-1d99-41d2-88d8-2fb230997596+18:3641:x1875420981008384:12345-0@lo:103: 00010000:00010000:2.0:1788540966.571084:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788540966.571089:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a682e75f600/0x2aac941e5f4a74f7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a74f0 expref: 18 pid: 6509 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.571109:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a682e75f600/0x2aac941e5f4a74f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a74f0 expref: 18 pid: 6509 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.571124:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788540966.571151:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706830700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:425687b6-1d99-41d2-88d8-2fb230997596+18:3641:x1875420981008384:12345-0@lo:103: Request processed in 78us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540966.571158:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788540966.571172:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788540966.571178:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706832a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:425687b6-1d99-41d2-88d8-2fb230997596+17:3641:x1875420981008512:12345-0@lo:103: 00010000:00010000:0.0:1788540966.571182:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a682e75f600/0x2aac941e5f4a74f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a74f0 expref: 17 pid: 6509 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.571185:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788540966.571189:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6842048e00/0x2aac941e5f4a74b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a74aa expref: 17 pid: 6509 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540966.571192:0:6533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b5c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1875420981008128:0@lo:104: 00010000:00010000:2.0:1788540966.571197:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6842048e00/0x2aac941e5f4a74b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a74aa expref: 16 pid: 6509 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540966.571200:0:6533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b7b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1875420981008256:0@lo:104: 00010000:00010000:2.0:1788540966.571208:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6842048e00/0x2aac941e5f4a74b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a74aa expref: 16 pid: 6509 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.571218:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a75bb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.571226:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a75bb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540966.571513:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a75bb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788540966.571563:0:6503:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006601408s 00010000:00010000:2.0:1788540966.571569:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a75bb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.571587:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a75bb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.571594:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a75bb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.571600:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a75bb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.571606:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75e200 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:2.0:1788540966.571611:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a75bb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.571619:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a75bb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.571639:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a75bb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540966.571649:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788540966.571652:0:6533:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a75bb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540966.571659:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a75bb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540966.571666:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a75bb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540966.571737:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706832a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:425687b6-1d99-41d2-88d8-2fb230997596+15:3641:x1875420981008512:12345-0@lo:103: Request processed in 559us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540966.571743:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788540966.571786:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706831500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420981008512:0@lo:103: 00000100:00100000:2.0:1788540966.571793:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420981008384:0@lo:103: 00080000:10000000:1.0:1788540966.576969:0:9509:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1788540966.577126:0:9509:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1788540966.577311:0:9509:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1788540966.577458:0:9509:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1788540966.577660:0:9509:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1788540966.585978:0:9509:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1788540966.590934:0:9509:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788540966.618838:0:9509:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788540966.618859:0:9509:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788540966.618927:0:9509:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788540966.618970:0:9509:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.156@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788540966.618990:0:9509:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1788540966.619029:0:9509:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1788540966.619787:0:9509:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788540966.620017:0:9509:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:3.0:1788540967.371024:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788540967.371054:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981008640:0@lo:13: 00000100:00100000:3.0:1788540967.371142:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540967.371217:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981008640 00000100:00100000:3.0:1788540967.371224:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981008640 00000100:00100000:3.0:1788540967.371289:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788540967.371306:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670772b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981008640:12345-0@lo:13: 00002000:00000024:3.0:1788540967.371347:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788540967.371392:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670772b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981008640:12345-0@lo:13: Request processed in 88us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540967.371407:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788540967.371450:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6707729180 x1875420981008640/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788540983 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540967.371470:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981008640:0@lo:13: 00000100:00100000:1.0:1788540967.372680:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981008768:0@lo:41: 00000100:00100000:1.0:1788540967.372750:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540967.372928:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981008768 00000100:00100000:1.0:1788540967.372943:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981008768 00000100:00100000:1.0:1788540967.373015:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788540967.373026:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f0fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981008768:12345-0@lo:41: 00010000:00010000:3.0:1788540967.373061:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000024:1.0:1788540967.373070:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788540967.373073:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981008896:0@lo:13: 00000100:00100000:3.0:1788540967.373114:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540967.373119:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f0fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981008768:12345-0@lo:41: Request processed in 94us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540967.373126:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788540967.373258:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981008768:0@lo:41: 00000100:00100000:3.0:1788540967.373418:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981008896 00000100:00100000:3.0:1788540967.373422:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981008896 00000100:00100000:3.0:1788540967.373454:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788540967.373461:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707729500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981008896:12345-0@lo:13: 00002000:00000024:3.0:1788540967.373476:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788540967.373513:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707729500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981008896:12345-0@lo:13: Request processed in 53us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540967.373520:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788540967.373546:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707729180 x1875420981008896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788540983 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540967.373563:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981008896:0@lo:13: 00000020:00000004:2.0:1788540967.639274:0:9583:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788540967.639518:0:9583:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788540967.883776:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788540967.883804:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f0fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981009024:0@lo:41: 00000100:00100000:0.0:1788540967.883909:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540967.884020:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981009024 00000100:00100000:1.0:1788540967.884029:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981009024 00000100:00100000:1.0:1788540967.884082:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788540967.884092:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981009024:12345-0@lo:41: 00000004:00000024:1.0:1788540967.884131:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:1.0:1788540967.884183:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981009024:12345-0@lo:41: Request processed in 92us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540967.884190:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788540967.884239:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f0fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981009024:0@lo:41: 00010000:00010000:2.0:1788540968.398543:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540969.420146:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788540970.442779:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788540971.472625:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788540971.979288:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981009408:0@lo:400: 00000100:00100000:0.0:1788540971.979361:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540971.979414:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6805674e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875420981009920:0@lo:400: 00000100:00100000:0.0:1788540971.979438:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540971.979461:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875420981010432:0@lo:400: 00000100:00100000:0.0:1788540971.979483:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540971.979504:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788540971.979509:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875420981009536:0@lo:400: 00000100:00100000:0.0:1788540971.979538:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540971.979557:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981010048:0@lo:400: 00000100:00100000:0.0:1788540971.979577:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540971.979612:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981009408 00000100:00100000:0.0:1788540971.979619:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981009408 00000100:00100000:0.0:1788540971.979670:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788540971.979679:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981009408:12345-0@lo:400: 00000100:00100000:0.0:1788540971.979732:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981009408:12345-0@lo:400: Request processed in 53us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540971.979740:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788540971.979761:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981009920 00000100:00100000:0.0:1788540971.979765:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981009920 00000100:00100000:0.0:1788540971.979812:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981010432 00000100:00100000:0.0:1788540971.979818:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981010432 00000100:00100000:0.0:1788540971.979832:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981009536 00000100:00100000:0.0:1788540971.979835:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981009536 00000100:00100000:0.0:1788540971.979846:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788540971.979852:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875420981009920:12345-0@lo:400: 00000100:00100000:0.0:1788540971.979919:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875420981009920:12345-0@lo:400: Request processed in 56us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540971.979925:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788540971.979936:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788540971.979942:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875420981010432:12345-0@lo:400: 00000100:00100000:0.0:1788540971.979967:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875420981010432:12345-0@lo:400: Request processed in 25us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540971.979972:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788540971.979982:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788540971.979988:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875420981009536:12345-0@lo:400: 00000100:00100000:0.0:1788540971.980021:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875420981009536:12345-0@lo:400: Request processed in 33us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540971.980027:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788540971.980049:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981010048 00000100:00100000:0.0:1788540971.980053:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981010048 00000100:00100000:0.0:1788540971.980079:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788540971.980086:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981010048:12345-0@lo:400: 00000100:00100000:0.0:1788540971.980114:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981010048:12345-0@lo:400: Request processed in 29us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540971.980120:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788540971.980138:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788540971.980142:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788540971.980173:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68355b4380 x1875420981009536/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540971.980186:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875420981009536:0@lo:400: 00010000:00080000:0.0:1788540971.980196:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707a31f80 x1875420981010048/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788540987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540971.980204:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981010048:0@lo:400: 00000100:00100000:0.0:1788540971.980213:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981009408:0@lo:400: 00010000:00080000:0.0:1788540971.980221:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6805674e00 x1875420981009920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540971.980229:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6805674e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875420981009920:0@lo:400: 00010000:00080000:0.0:1788540971.980237:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707a31180 x1875420981010432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540971.980245:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875420981010432:0@lo:400: 00000100:00100000:1.0:1788540971.980601:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420981009152:0@lo:400: 00000100:00100000:1.0:1788540971.980637:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540971.980670:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981009664:0@lo:400: 00000100:00100000:1.0:1788540971.980690:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540971.980708:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981010176:0@lo:400: 00000100:00100000:1.0:1788540971.980728:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540971.980747:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788540971.980753:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875420981009280:0@lo:400: 00000100:00100000:1.0:1788540971.980774:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540971.980790:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875420981009792:0@lo:400: 00000100:00100000:1.0:1788540971.980822:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540971.980848:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875420981010304:0@lo:400: 00000100:00100000:1.0:1788540971.980891:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540971.980930:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981009280 00000100:00100000:1.0:1788540971.980934:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981009280 00000100:00100000:1.0:1788540971.980956:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981009792 00000100:00100000:1.0:1788540971.980959:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981009792 00000100:00100000:1.0:1788540971.980977:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981010304 00000100:00100000:1.0:1788540971.980980:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981010304 00000100:00100000:1.0:1788540971.980994:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788540971.980999:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f0ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875420981009280:12345-0@lo:400: 00000100:00100000:1.0:1788540971.981035:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f0ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875420981009280:12345-0@lo:400: Request processed in 36us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540971.981042:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788540971.981057:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788540971.981062:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f0fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875420981009792:12345-0@lo:400: 00000100:00100000:1.0:1788540971.981100:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f0fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875420981009792:12345-0@lo:400: Request processed in 39us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540971.981106:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788540971.981116:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788540971.981121:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f0fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875420981010304:12345-0@lo:400: 00000100:00100000:1.0:1788540971.981156:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f0fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875420981010304:12345-0@lo:400: Request processed in 35us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540971.981161:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788540971.981178:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981010176 00000100:00100000:1.0:1788540971.981182:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981010176 00000100:00100000:1.0:1788540971.981208:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788540971.981214:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f0fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981010176:12345-0@lo:400: 00000100:00100000:1.0:1788540971.981249:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f0fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981010176:12345-0@lo:400: Request processed in 35us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540971.981262:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788540971.981284:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788540971.981287:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788540971.981295:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981009664 00000100:00100000:1.0:1788540971.981298:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981009664 00000100:00100000:1.0:1788540971.981321:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788540971.981327:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f0fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981009664:12345-0@lo:400: 00000100:00100000:1.0:1788540971.981357:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f0fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981009664:12345-0@lo:400: Request processed in 30us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540971.981363:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1788540971.981394:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68355b4000 x1875420981009280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540971.981404:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875420981009280:0@lo:400: 00010000:00080000:1.0:1788540971.981415:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68355b6680 x1875420981009792/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540971.981423:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875420981009792:0@lo:400: 00010000:00080000:1.0:1788540971.981432:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707a31c00 x1875420981010304/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540971.981440:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875420981010304:0@lo:400: 00000100:00100000:1.0:1788540971.981450:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981009664:0@lo:400: 00010000:00080000:1.0:1788540971.981459:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707a33100 x1875420981010176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788540987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540971.981468:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981010176:0@lo:400: 00000100:00100000:0.0:1788540971.982712:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981009152 00000100:00100000:0.0:1788540971.982722:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981009152 00000100:00100000:0.0:1788540971.982773:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788540971.982782:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+15:3643:x1875420981009152:12345-0@lo:400: 00000100:00100000:0.0:1788540971.982859:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+15:3643:x1875420981009152:12345-0@lo:400: Request processed in 79us (2221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540971.982866:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788540971.988508:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420981009152:0@lo:400: 00000100:00100000:3.0:1788540972.498015:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707728700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981010560:0@lo:13: 00000100:00100000:3.0:1788540972.498123:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540972.498183:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981010688:0@lo:13: 00000100:00100000:3.0:1788540972.498204:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540972.498266:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981010560 00000100:00100000:3.0:1788540972.498279:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981010560 00000100:00100000:3.0:1788540972.498325:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981010688 00000100:00100000:3.0:1788540972.498329:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981010688 00000100:00100000:3.0:1788540972.498347:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788540972.498357:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670772aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981010560:12345-0@lo:13: 00002000:00000024:3.0:1788540972.498406:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788540972.498457:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670772aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981010560:12345-0@lo:13: Request processed in 101us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540972.498466:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788540972.498485:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788540972.498491:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707728000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981010688:12345-0@lo:13: 00002000:00000024:3.0:1788540972.498500:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788540972.498520:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707728000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981010688:12345-0@lo:13: Request processed in 30us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540972.498526:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788540972.498563:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707728700 x1875420981010560/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788540988 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540972.498582:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707728700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981010560:0@lo:13: 00010000:00080000:3.0:1788540972.498594:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707a31180 x1875420981010688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788540988 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540972.498604:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981010688:0@lo:13: 00010000:00010000:2.0:1788540972.499035:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788540972.505558:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981010816:0@lo:41: 00000100:00100000:1.0:1788540972.505641:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540972.505735:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981010816 00000100:00100000:0.0:1788540972.505743:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981010816 00000100:00100000:0.0:1788540972.505801:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788540972.505810:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f0fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981010816:12345-0@lo:41: 00000004:00000024:0.0:1788540972.505841:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788540972.505907:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f0fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981010816:12345-0@lo:41: Request processed in 97us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540972.505914:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788540972.506133:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981010816:0@lo:41: 00000100:00100000:1.0:1788540973.004521:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788540973.004549:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981010944:0@lo:41: 00000100:00100000:1.0:1788540973.004631:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540973.004864:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981010944 00000100:00100000:2.0:1788540973.004910:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981010944 00000100:00100000:2.0:1788540973.004955:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788540973.004964:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f0fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981010944:12345-0@lo:41: 00000004:00000024:2.0:1788540973.005003:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:2.0:1788540973.005059:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f0fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981010944:12345-0@lo:41: Request processed in 95us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540973.005065:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788540973.005193:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981010944:0@lo:41: 00010000:00010000:3.0:1788540973.521668:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788540974.034559:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788540974.034565:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a683533b800 from 39 10000000:01000000:3.0:1788540974.034570:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788540974.034613:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6842172000/0x2aac941e5f4a75c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540974.034626:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a6842172000/0x2aac941e5f4a75c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540974.034647:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a6842172000/0x2aac941e5f4a75c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540974.034670:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707728700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981011072:0@lo:101: 00000100:00100000:3.0:1788540974.034736:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540974.034801:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707570300 going to sleep for 11 seconds 00000100:00100000:0.0:1788540974.036482:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981011072 00000100:00100000:0.0:1788540974.036490:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981011072 00000100:00100000:0.0:1788540974.036543:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788540974.036564:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+15:6514:x1875420981011072:12345-0@lo:101: 00010000:00010000:0.0:1788540974.036578:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788540974.036593:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a75c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a75c2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540974.036618:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a75c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a75c2 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540974.036629:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a75c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a75c2 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540974.036648:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75e200, rc 0) 00000100:00100000:0.0:1788540974.036706:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+16:6514:x1875420981011072:12345-0@lo:101: Request processed in 155us (1970us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540974.036713:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788540974.036761:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707728700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981011072:0@lo:101: 00010000:00010000:0.0:1788540974.036794:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a6842172000/0x2aac941e5f4a75c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a75c9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540974.036805:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a6842172000/0x2aac941e5f4a75c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a75c9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540974.036888:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981011200:0@lo:501: 00000100:00100000:0.0:1788540974.036919:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540974.036947:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683f241cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788540974.036958:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981011200 00000100:00100000:0.0:1788540974.036962:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981011200 00000100:00100000:0.0:1788540974.036984:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788540974.036990:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+16:6514:x1875420981011200:12345-0@lo:501: 00000100:00100000:0.0:1788540974.037100:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+16:6514:x1875420981011200:12345-0@lo:501: Request processed in 109us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540974.037107:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788540974.037134:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981011200:0@lo:501: 00000100:00100000:0.0:1788540974.037157:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981011328:0@lo:503: 00000100:00100000:0.0:1788540974.037192:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540974.037204:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683f241cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788540974.037220:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981011328 00000100:00100000:0.0:1788540974.037224:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981011328 00000100:00100000:0.0:1788540974.037239:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788540974.037245:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+16:6514:x1875420981011328:12345-0@lo:503: 00000100:00100000:0.0:1788540974.037313:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+16:6514:x1875420981011328:12345-0@lo:503: Request processed in 68us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540974.037319:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788540974.037355:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981011328:0@lo:503: 00000100:00100000:0.0:1788540974.037504:0:9829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a31500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:9829:1875420981011456:0@lo:502: 00000100:00100000:0.0:1788540974.037535:0:9829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540974.037553:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981011456 00000100:00100000:0.0:1788540974.037556:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981011456 00000100:00100000:0.0:1788540974.037576:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788540974.037582:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+16:9829:x1875420981011456:12345-0@lo:502: 00000100:00100000:0.0:1788540974.037690:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+16:9829:x1875420981011456:12345-0@lo:502: Request processed in 107us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540974.037717:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788540974.037747:0:9829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683f241540 going to sleep for 11 seconds 00000100:00100000:0.0:1788540974.037759:0:9829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a31500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:9829:1875420981011456:0@lo:502: 00000100:00100000:0.0:1788540974.037807:0:9829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a31500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:9829:1875420981011584:0@lo:502: 00000100:00100000:0.0:1788540974.037836:0:9829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540974.037853:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981011584 00000100:00100000:0.0:1788540974.037856:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981011584 00000100:00100000:0.0:1788540974.037898:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788540974.037904:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+16:9829:x1875420981011584:12345-0@lo:502: 00000100:00100000:0.0:1788540974.037957:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+16:9829:x1875420981011584:12345-0@lo:502: Request processed in 53us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540974.037970:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788540974.038003:0:9829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683f241540 going to sleep for 11 seconds 00000100:00100000:0.0:1788540974.038015:0:9829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a31500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:9829:1875420981011584:0@lo:502: 00000040:00080000:0.0:1788540974.038034:0:9829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1788540974.038084:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1788540974.038099:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788540974.038107:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6842172000/0x2aac941e5f4a75c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a75c9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540974.038116:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a6842172000/0x2aac941e5f4a75c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a75c9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788540974.038125:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788540974.038127:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1788540974.038130:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788540974.038148:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75fc00/0x2aac941e5f4a75d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540974.038156:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a682e75fc00/0x2aac941e5f4a75d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540974.038164:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a682e75fc00/0x2aac941e5f4a75d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540974.038174:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981011712:0@lo:101: 00000100:00100000:0.0:1788540974.038197:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540974.038210:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683f241540 going to sleep for 11 seconds 00000100:00100000:0.0:1788540974.038219:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981011712 00000100:00100000:0.0:1788540974.038222:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981011712 00000100:00100000:0.0:1788540974.038244:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788540974.038249:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+16:6514:x1875420981011712:12345-0@lo:101: 00010000:00010000:0.0:1788540974.038256:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788540974.038263:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a682e75fe00/0x2aac941e5f4a75d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a75d0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540974.038280:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a682e75fe00/0x2aac941e5f4a75d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a75d0 expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540974.038289:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a682e75fe00/0x2aac941e5f4a75d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a75d0 expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540974.038297:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75fe00, rc 0) 00000100:00100000:0.0:1788540974.038320:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+17:6514:x1875420981011712:12345-0@lo:101: Request processed in 70us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540974.038325:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788540974.038349:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981011712:0@lo:101: 00010000:00010000:0.0:1788540974.038358:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a682e75fc00/0x2aac941e5f4a75d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a75d7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540974.038365:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a682e75fc00/0x2aac941e5f4a75d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a75d7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540974.038396:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981011840:0@lo:501: 00000100:00100000:0.0:1788540974.038415:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540974.038425:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683f241540 going to sleep for 11 seconds 00000100:00100000:0.0:1788540974.038434:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981011840 00000100:00100000:0.0:1788540974.038437:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981011840 00000100:00100000:0.0:1788540974.038451:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788540974.038461:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+17:6514:x1875420981011840:12345-0@lo:501: 00000100:00100000:0.0:1788540974.038536:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+17:6514:x1875420981011840:12345-0@lo:501: Request processed in 74us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540974.038562:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788540974.038587:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981011840:0@lo:501: 00000100:00100000:0.0:1788540974.038605:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981011968:0@lo:503: 00000100:00100000:0.0:1788540974.038638:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540974.038654:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683f241540 going to sleep for 11 seconds 00000100:00100000:0.0:1788540974.038663:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981011968 00000100:00100000:0.0:1788540974.038681:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981011968 00000100:00100000:0.0:1788540974.038699:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788540974.038704:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+17:6514:x1875420981011968:12345-0@lo:503: 00000100:00100000:0.0:1788540974.038758:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+17:6514:x1875420981011968:12345-0@lo:503: Request processed in 52us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540974.038764:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788540974.038831:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981011968:0@lo:503: 00000100:00100000:2.0:1788540974.043262:0:9830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706831500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:9830:1875420981012096:0@lo:502: 00000100:00100000:2.0:1788540974.043383:0:9830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540974.043423:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981012096 00000100:00100000:2.0:1788540974.043430:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981012096 00000100:00100000:2.0:1788540974.043472:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788540974.043482:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+17:9830:x1875420981012096:12345-0@lo:502: 00000100:00100000:2.0:1788540974.043618:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+17:9830:x1875420981012096:12345-0@lo:502: Request processed in 136us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540974.043626:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788540974.043679:0:9830:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68076190c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788540974.043702:0:9830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706831500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:9830:1875420981012096:0@lo:502: 00000020:01000000:2.0:1788540974.043733:0:9830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788540974.043742:0:9830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788540974.043745:0:9830:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788540974.043750:0:9830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788540974.043753:0:9830:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788540974.043768:0:9830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706831500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:9830:1875420981012224:0@lo:502: 00000100:00100000:2.0:1788540974.043825:0:9830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540974.043839:0:9830:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68076190c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788540974.044393:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981012224 00000100:00100000:3.0:1788540974.044400:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981012224 00000100:00100000:3.0:1788540974.044467:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788540974.044476:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e778050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+17:9830:x1875420981012224:12345-0@lo:502: 00000100:00100000:3.0:1788540974.044582:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e778050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+17:9830:x1875420981012224:12345-0@lo:502: Request processed in 107us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540974.044589:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788540974.055166:0:9830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706831500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:9830:1875420981012224:0@lo:502: 00000020:01000000:0.0:1788540974.055221:0:9830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788540974.055233:0:9830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788540974.055235:0:9830:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788540974.055239:0:9830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1788540974.056391:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1788540974.056416:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788540974.056427:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75fc00/0x2aac941e5f4a75d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a75d7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540974.056438:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a682e75fc00/0x2aac941e5f4a75d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a75d7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788540974.056450:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788540974.056454:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a6839117000 from 39 10000000:01000000:2.0:1788540974.056457:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788540974.056490:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551a600/0x2aac941e5f4a75de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540974.056498:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a683551a600/0x2aac941e5f4a75de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540974.056508:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a683551a600/0x2aac941e5f4a75de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540974.056528:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706830000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981012352:0@lo:101: 00000100:00100000:2.0:1788540974.056598:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540974.056643:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6807619a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788540974.056748:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981012352 00000100:00100000:0.0:1788540974.056756:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981012352 00000100:00100000:0.0:1788540974.056841:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788540974.056851:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e778850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+17:6514:x1875420981012352:12345-0@lo:101: 00010000:00010000:0.0:1788540974.056863:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788540974.056920:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a682e75f200/0x2aac941e5f4a75e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a75de expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540974.056943:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a682e75f200/0x2aac941e5f4a75e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a75de expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540974.056954:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a682e75f200/0x2aac941e5f4a75e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a75de expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540974.056962:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75f200, rc 0) 00000100:00100000:0.0:1788540974.057019:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e778850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+18:6514:x1875420981012352:12345-0@lo:101: Request processed in 157us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540974.057026:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788540974.057086:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706830000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981012352:0@lo:101: 00010000:00010000:0.0:1788540974.057100:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a683551a600/0x2aac941e5f4a75de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a75e5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540974.057115:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a683551a600/0x2aac941e5f4a75de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a75e5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540974.057180:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981012480:0@lo:501: 00000100:00100000:0.0:1788540974.057216:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540974.057242:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6808989480 going to sleep for 11 seconds 00000100:00100000:0.0:1788540974.057254:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981012480 00000100:00100000:0.0:1788540974.057257:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981012480 00000100:00100000:0.0:1788540974.057282:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788540974.057304:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e77b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+18:6514:x1875420981012480:12345-0@lo:501: 00000100:00100000:0.0:1788540974.057424:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e77b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+18:6514:x1875420981012480:12345-0@lo:501: Request processed in 135us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540974.057440:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788540974.057471:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981012480:0@lo:501: 00000100:00100000:0.0:1788540974.057496:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981012608:0@lo:503: 00000100:00100000:0.0:1788540974.057533:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540974.057547:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683543c000 going to sleep for 11 seconds 00000100:00100000:0.0:1788540974.057571:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981012608 00000100:00100000:0.0:1788540974.057575:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981012608 00000100:00100000:0.0:1788540974.057593:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788540974.057598:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e77bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+18:6514:x1875420981012608:12345-0@lo:503: 00000100:00100000:0.0:1788540974.057670:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e77bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+18:6514:x1875420981012608:12345-0@lo:503: Request processed in 70us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540974.057676:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788540974.057715:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981012608:0@lo:503: 00000100:00100000:0.0:1788540974.057921:0:9831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a31500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:9831:1875420981012736:0@lo:502: 00000100:00100000:0.0:1788540974.057952:0:9831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540974.057970:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981012736 00000100:00100000:0.0:1788540974.057973:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981012736 00000100:00100000:0.0:1788540974.057990:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788540974.057995:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e77a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+18:9831:x1875420981012736:12345-0@lo:502: 00000100:00100000:0.0:1788540974.058061:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e77a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+18:9831:x1875420981012736:12345-0@lo:502: Request processed in 65us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540974.058068:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788540974.058096:0:9831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683543c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788540974.058107:0:9831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a31500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:9831:1875420981012736:0@lo:502: 00000100:00100000:0.0:1788540974.058151:0:9831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a31500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:9831:1875420981012864:0@lo:502: 00000100:00100000:0.0:1788540974.058183:0:9831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540974.058200:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981012864 00000100:00100000:0.0:1788540974.058203:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981012864 00000100:00100000:0.0:1788540974.058220:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788540974.058225:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e77a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+18:9831:x1875420981012864:12345-0@lo:502: 00000100:00100000:0.0:1788540974.058275:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e77a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+18:9831:x1875420981012864:12345-0@lo:502: Request processed in 50us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540974.058282:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788540974.058308:0:9831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683543c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788540974.058318:0:9831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a31500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:9831:1875420981012864:0@lo:502: 00000040:00080000:0.0:1788540974.058335:0:9831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1788540974.058375:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1788540974.058388:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788540974.058395:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551a600/0x2aac941e5f4a75de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a75e5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540974.058404:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a683551a600/0x2aac941e5f4a75de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a75e5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788540974.058413:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788540974.058415:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a6839117000 from 6 10000000:01000000:0.0:1788540974.058418:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788540974.058439:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75ea00/0x2aac941e5f4a75ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540974.058446:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a682e75ea00/0x2aac941e5f4a75ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540974.058462:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a682e75ea00/0x2aac941e5f4a75ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540974.058473:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981012992:0@lo:101: 00000100:00100000:0.0:1788540974.058495:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540974.058507:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683543c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788540974.058518:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981012992 00000100:00100000:0.0:1788540974.058521:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981012992 00000100:00100000:0.0:1788540974.058536:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788540974.058541:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e77a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+18:6514:x1875420981012992:12345-0@lo:101: 00010000:00010000:0.0:1788540974.058548:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788540974.058559:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a682e75e800/0x2aac941e5f4a75f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a75ec expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540974.058579:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a682e75e800/0x2aac941e5f4a75f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a75ec expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540974.058588:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a682e75e800/0x2aac941e5f4a75f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a75ec expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540974.058597:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75e800, rc 0) 00000100:00100000:0.0:1788540974.058622:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e77a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+19:6514:x1875420981012992:12345-0@lo:101: Request processed in 80us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540974.058628:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788540974.058654:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981012992:0@lo:101: 00010000:00010000:0.0:1788540974.058664:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a682e75ea00/0x2aac941e5f4a75ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a75f3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540974.058681:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a682e75ea00/0x2aac941e5f4a75ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a75f3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540974.058718:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981013120:0@lo:256: 00000100:00100000:0.0:1788540974.058745:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540974.058757:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683543c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788540974.058767:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981013120 00000100:00100000:0.0:1788540974.058770:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981013120 00000100:00100000:0.0:1788540974.058804:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788540974.058809:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e778c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+19:6514:x1875420981013120:12345-0@lo:256: 20000000:01000000:0.0:1788540974.058822:0:6512:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788540974.058838:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788540974.058841:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1788540974.058951:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e778c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+19:6514:x1875420981013120:12345-0@lo:256: Request processed in 141us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540974.058958:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788540974.059011:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981013120:0@lo:256: 10000000:01000000:0.0:1788540974.059067:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788540974.059072:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75ea00/0x2aac941e5f4a75ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a75f3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540974.059109:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a682e75ea00/0x2aac941e5f4a75ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a75f3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788540974.059117:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788540974.059119:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:0.0:1788540974.059122:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788540974.059141:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75ec00/0x2aac941e5f4a75fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540974.059148:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a682e75ec00/0x2aac941e5f4a75fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540974.059155:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a682e75ec00/0x2aac941e5f4a75fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540974.059165:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981013248:0@lo:101: 00000100:00100000:0.0:1788540974.059209:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540974.059228:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683543c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788540974.059239:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981013248 00000100:00100000:0.0:1788540974.059242:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981013248 00000100:00100000:0.0:1788540974.059259:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788540974.059264:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e77b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+19:6514:x1875420981013248:12345-0@lo:101: 00010000:00010000:0.0:1788540974.059270:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788540974.059277:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a682e75f400/0x2aac941e5f4a7601 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a75fa expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540974.059291:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a682e75f400/0x2aac941e5f4a7601 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a75fa expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540974.059299:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a682e75f400/0x2aac941e5f4a7601 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a75fa expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540974.059305:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75f400, rc 0) 00000100:00100000:0.0:1788540974.059332:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e77b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+20:6514:x1875420981013248:12345-0@lo:101: Request processed in 67us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540974.059337:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788540974.059376:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981013248:0@lo:101: 00010000:00010000:0.0:1788540974.059385:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a682e75ec00/0x2aac941e5f4a75fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7601 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540974.059393:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a682e75ec00/0x2aac941e5f4a75fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a7601 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540974.059432:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981013376:0@lo:501: 00000100:00100000:0.0:1788540974.059454:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540974.059466:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683543c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788540974.059476:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981013376 00000100:00100000:0.0:1788540974.059480:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981013376 00000100:00100000:0.0:1788540974.059495:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788540974.059500:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e77b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+20:6514:x1875420981013376:12345-0@lo:501: 00000100:00100000:0.0:1788540974.059589:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e77b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+20:6514:x1875420981013376:12345-0@lo:501: Request processed in 88us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540974.059595:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788540974.059619:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981013376:0@lo:501: 00000100:00100000:0.0:1788540974.059640:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981013504:0@lo:503: 00000100:00100000:0.0:1788540974.059672:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540974.059685:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683543c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788540974.059696:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981013504 00000100:00100000:0.0:1788540974.059699:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981013504 00000100:00100000:0.0:1788540974.059716:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788540974.059721:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e779450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+20:6514:x1875420981013504:12345-0@lo:503: 00000100:00100000:0.0:1788540974.073270:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e779450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+20:6514:x1875420981013504:12345-0@lo:503: Request processed in 13538us (13587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540974.073312:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788540974.090487:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a31500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981013504:0@lo:503: 00000100:00100000:1.0:1788540974.095018:0:9832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f0fc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:9832:1875420981013632:0@lo:502: 00000100:00100000:1.0:1788540974.095117:0:9832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540974.095157:0:9832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683549ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788540974.096611:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981013632 00000100:00100000:0.0:1788540974.096622:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981013632 00000100:00100000:0.0:1788540974.097342:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788540974.097355:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e779c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+20:9832:x1875420981013632:12345-0@lo:502: 00000100:00100000:0.0:1788540974.097533:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e779c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+20:9832:x1875420981013632:12345-0@lo:502: Request processed in 181us (2428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540974.097542:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788540974.106617:0:9832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f0fc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:9832:1875420981013632:0@lo:502: 00000020:01000000:2.0:1788540974.106673:0:9832:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788540974.106681:0:9832:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788540974.106691:0:9832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788540974.106704:0:9832:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788540974.106711:0:9832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788540974.106715:0:9832:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.156@tcp to nid 0x20000c0a8ca9c (192.168.202.156@tcp) 00000020:01000000:2.0:1788540974.106740:0:9832:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788540974.106743:0:9832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788540974.106786:0:9832:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9a6707910000) 00000020:00000080:2.0:1788540974.106818:0:9832:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1788540974.106826:0:9832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788540974.106959:0:9832:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1788540974.106967:0:9832:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788540974.106974:0:9832:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2aac941e5f4a760f 00010000:00080000:2.0:1788540974.107006:0:9832:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a68379b3000@lustre-OST0001-osc-MDT0001: add connection 192.168.202.156@tcp at head 00010000:00010000:2.0:1788540974.107329:0:9832:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:2.0:1788540974.107477:0:9832:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1788540974.107492:0:9832:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1788540974.107657:0:9832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788540974.107770:0:9832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788540974.107941:0:9832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1788540974.108032:0:9832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1788540974.111284:0:9835:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788540974.111292:0:9835:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788540974.121618:0:9832:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788540974.121634:0:9832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788540974.121680:0:9832:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788540974.121705:0:9832:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2aac941e5f4a7616 00000100:00080000:3.0:1788540974.121714:0:9832:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788540974.121720:0:9832:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a68379b3000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:3.0:1788540974.121753:0:9832:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6707729880 x1875420981013760/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788540974.121795:0:9832:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1788540974.121941:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670772bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875420981013888:0@lo:400: 00000100:00100000:3.0:1788540974.122004:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540974.122036:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707729f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875420981014400:0@lo:400: 00000100:00100000:3.0:1788540974.122066:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540974.122083:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875420981014912:0@lo:400: 00000100:00100000:3.0:1788540974.122103:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540974.122123:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788540974.122129:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670772b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981014016:0@lo:400: 00000100:00100000:3.0:1788540974.122152:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540974.122169:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670772b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875420981014528:0@lo:400: 00000100:00100000:3.0:1788540974.122199:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540974.122218:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875420981015040:0@lo:400: 00000100:00100000:3.0:1788540974.122238:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540974.122259:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670772ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875420981014144:0@lo:400: 00000100:00100000:3.0:1788540974.122280:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540974.122290:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707728700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981014656:0@lo:400: 00000100:00100000:3.0:1788540974.122311:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540974.122364:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981013760:0@lo:8: 00000100:00100000:2.0:1788540974.122404:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981014016 00000100:00100000:2.0:1788540974.122410:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981014016 00000100:00100000:2.0:1788540974.122450:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788540974.122459:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981014016:12345-0@lo:400: 00000100:00100000:2.0:1788540974.122512:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981014016:12345-0@lo:400: Request processed in 54us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540974.122518:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788540974.122552:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670772b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981014016:0@lo:400: 00000020:01000000:2.0:1788540974.123144:0:9832:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788540974.123156:0:9832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788540974.123158:0:9832:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788540974.123162:0:9832:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788540974.123166:0:9832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788540974.123167:0:9832:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788540974.123170:0:9832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788540974.123172:0:9832:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788540974.123199:0:9832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706831880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:9832:1875420981015168:0@lo:502: 00000100:00100000:2.0:1788540974.123243:0:9832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540974.125818:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981013888 00000100:00100000:1.0:1788540974.125831:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981013888 00000100:00100000:1.0:1788540974.125904:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981014400 00000100:00100000:1.0:1788540974.125907:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981014400 00000100:00100000:1.0:1788540974.125932:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981014912 00000100:00100000:1.0:1788540974.125935:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981014912 00000100:00100000:1.0:1788540974.125948:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981014528 00000100:00100000:1.0:1788540974.125950:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981014528 00000100:00100000:1.0:1788540974.125963:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981015040 00000100:00100000:1.0:1788540974.125965:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981015040 00000100:00100000:1.0:1788540974.125976:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981014144 00000100:00100000:1.0:1788540974.125979:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981014144 00000100:00100000:1.0:1788540974.125995:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788540974.126004:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875420981013888:12345-0@lo:400: 00000100:00100000:1.0:1788540974.126090:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875420981013888:12345-0@lo:400: Request processed in 87us (4085us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540974.126097:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788540974.126127:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788540974.126143:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875420981014400:12345-0@lo:400: 00000100:00100000:1.0:1788540974.126174:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875420981014400:12345-0@lo:400: Request processed in 32us (4107us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540974.126181:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788540974.126194:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788540974.126201:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875420981014912:12345-0@lo:400: 00000100:00100000:1.0:1788540974.126244:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875420981014912:12345-0@lo:400: Request processed in 43us (4139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540974.126250:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788540974.126262:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788540974.126269:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875420981014528:12345-0@lo:400: 00000100:00100000:1.0:1788540974.126307:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875420981014528:12345-0@lo:400: Request processed in 28us (4097us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540974.126314:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788540974.126327:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788540974.126333:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875420981015040:12345-0@lo:400: 00000100:00100000:1.0:1788540974.126360:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875420981015040:12345-0@lo:400: Request processed in 28us (4121us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540974.126365:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788540974.126376:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788540974.126381:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875420981014144:12345-0@lo:400: 00000100:00100000:1.0:1788540974.126406:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875420981014144:12345-0@lo:400: Request processed in 25us (4126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540974.126412:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1788540974.126459:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788540974.126463:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788540974.126514:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670772b100 x1875420981014528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540974.126529:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670772b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875420981014528:0@lo:400: 00010000:00080000:1.0:1788540974.126543:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68045e0e00 x1875420981015040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540974.126551:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875420981015040:0@lo:400: 00010000:00080000:1.0:1788540974.126574:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670772bb80 x1875420981013888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540974.126582:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670772bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875420981013888:0@lo:400: 00010000:00080000:1.0:1788540974.126591:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707729f80 x1875420981014400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540974.126599:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707729f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875420981014400:0@lo:400: 00010000:00080000:1.0:1788540974.126608:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68045e2300 x1875420981014912/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540974.126614:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875420981014912:0@lo:400: 00010000:00080000:3.0:1788540974.128754:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670772ad80 x1875420981014144/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540974.128771:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670772ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875420981014144:0@lo:400: 00000100:00100000:3.0:1788540974.128802:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788540974.128814:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670772a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981014272:0@lo:400: 00000100:00100000:3.0:1788540974.128866:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540974.128917:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981014784:0@lo:400: 00000100:00100000:3.0:1788540974.128941:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540974.128985:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981014656 00000100:00100000:3.0:1788540974.128994:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981014656 00000100:00100000:3.0:1788540974.129052:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981014784 00000100:00100000:3.0:1788540974.129064:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981014784 00000100:00100000:3.0:1788540974.129092:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788540974.129101:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981014656:12345-0@lo:400: 00000100:00100000:3.0:1788540974.129150:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981014656:12345-0@lo:400: Request processed in 50us (6837us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540974.129156:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788540974.129171:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788540974.129177:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981014784:12345-0@lo:400: 00000100:00100000:3.0:1788540974.129202:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981014784:12345-0@lo:400: Request processed in 25us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540974.129207:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788540974.129222:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788540974.129245:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707729180 x1875420981014784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788540990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540974.129255:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981014784:0@lo:400: 00010000:00080000:3.0:1788540974.129264:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707728700 x1875420981014656/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788540990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540974.129272:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707728700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981014656:0@lo:400: 00000100:00100000:3.0:1788540974.129289:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981014272 00000100:00100000:3.0:1788540974.129293:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981014272 00000100:00100000:3.0:1788540974.129316:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788540974.129322:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981014272:12345-0@lo:400: 00000100:00100000:3.0:1788540974.129355:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981014272:12345-0@lo:400: Request processed in 33us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540974.129361:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788540974.129384:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670772a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981014272:0@lo:400: 00000100:00100000:0.0:1788540974.131003:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981015168 00000100:00100000:0.0:1788540974.131013:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981015168 00000100:00100000:0.0:1788540974.131048:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788540974.131055:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e77ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+20:9832:x1875420981015168:12345-0@lo:502: 00000100:00100000:0.0:1788540974.131181:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e77ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+20:9832:x1875420981015168:12345-0@lo:502: Request processed in 126us (7937us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540974.131188:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788540974.131881:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540974.131949:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981013760 00000100:00100000:1.0:1788540974.131955:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981013760 00000100:00100000:1.0:1788540974.131978:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788540974.131984:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f0fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3640:x1875420981013760:12345-0@lo:8: 00010000:00080000:1.0:1788540974.132010:0:8432:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 255 last 0 00000020:00000080:1.0:1788540974.132039:0:8432:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2aac941e5f4a761d 00002000:00100000:1.0:1788540974.132053:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9a67078de000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1788540974.132066:0:8432:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:1.0:1788540974.132070:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788540974.132138:0:8432:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788540974.132390:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1788540974.132415:0:8432:0:(import.c:65:import_set_state_nolock()) ffff9a67078db800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788540974.132470:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f0fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3640:x1875420981013760:12345-0@lo:8: Request processed in 485us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540974.132478:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788540974.132527:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707729880 x1875420981013760/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788540984 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540974.132538:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788540974.132546:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788540974.132565:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788540974.132570:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788540974.132572:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a68379b3000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788540974.132585:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788540974.132590:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981013760:0@lo:8: 00000100:00100000:3.0:1788540974.132978:0:9836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079b3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9836:1875420981015296:0@lo:700: 00000100:00100000:3.0:1788540974.133022:0:9836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540974.133047:0:9836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707570e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788540974.133082:0:9832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6807619900 going to sleep for 11 seconds 00000100:00100000:3.0:1788540974.133097:0:9832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706831880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:9832:1875420981015168:0@lo:502: 00000020:01000000:3.0:1788540974.133127:0:9832:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788540974.133134:0:9832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788540974.133137:0:9832:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788540974.133141:0:9832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:0.0:1788540974.133461:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:0.0:1788540974.133483:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788540974.133491:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75ec00/0x2aac941e5f4a75fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7601 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540974.133501:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a682e75ec00/0x2aac941e5f4a75fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7601 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788540974.133511:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788540974.133514:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a68112dc000 from 39 10000000:01000000:0.0:1788540974.133525:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788540974.133548:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75e600/0x2aac941e5f4a7624 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540974.134031:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a682e75e600/0x2aac941e5f4a7624 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540974.134042:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a682e75e600/0x2aac941e5f4a7624 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540974.134057:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a30700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981015424:0@lo:101: 00000100:00100000:0.0:1788540974.134093:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540974.134914:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981015296 00000100:00100000:1.0:1788540974.134924:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981015296 00000100:00100000:1.0:1788540974.134981:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788540974.134989:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9836:x1875420981015296:12345-0@lo:700: 00000100:00100000:1.0:1788540974.135032:0:8439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f0fc380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8439:1875420981015552:0@lo:700: 00000100:00100000:1.0:1788540974.135072:0:8439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540974.135097:0:8439:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683549a540 going to sleep for 11 seconds 00000100:00080000:1.0:1788540974.135115:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788540974.135127:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981015552 00000100:00100000:1.0:1788540974.135130:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981015552 00000100:00100000:1.0:1788540974.135164:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788540974.135170:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8439:x1875420981015552:12345-0@lo:700: 00000100:00100000:0.0:1788540974.135395:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683543c000 going to sleep for 11 seconds 00000100:00100000:0.0:1788540974.135415:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981015424 00000100:00100000:0.0:1788540974.135418:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981015424 00000100:00100000:0.0:1788540974.135456:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788540974.135464:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e779050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+20:6514:x1875420981015424:12345-0@lo:101: 00010000:00010000:0.0:1788540974.135475:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788540974.135492:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a682e75e400/0x2aac941e5f4a762b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a7624 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540974.135516:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a682e75e400/0x2aac941e5f4a762b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a7624 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540974.135528:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a682e75e400/0x2aac941e5f4a762b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a7624 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540974.135537:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75e400, rc 0) 00000100:00100000:0.0:1788540974.137448:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e779050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+21:6514:x1875420981015424:12345-0@lo:101: Request processed in 1978us (3348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540974.137470:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788540974.137524:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a30700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981015424:0@lo:101: 00010000:00010000:0.0:1788540974.137544:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a682e75e600/0x2aac941e5f4a7624 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a762b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540974.138723:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a682e75e600/0x2aac941e5f4a7624 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a762b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540974.138833:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a30700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981015680:0@lo:501: 00000100:00100000:0.0:1788540974.139221:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540974.139267:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683543c000 going to sleep for 11 seconds 00000100:00100000:0.0:1788540974.139421:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981015680 00000100:00100000:0.0:1788540974.139428:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981015680 00000100:00100000:0.0:1788540974.139480:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788540974.139489:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e779850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+21:6514:x1875420981015680:12345-0@lo:501: 00000100:00100000:0.0:1788540974.139697:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e779850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+21:6514:x1875420981015680:12345-0@lo:501: Request processed in 209us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540974.139704:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788540974.139743:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a30700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981015680:0@lo:501: 00000100:00100000:0.0:1788540974.139789:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a30700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981015808:0@lo:503: 00000100:00100000:0.0:1788540974.139835:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540974.139848:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683543c000 going to sleep for 11 seconds 00000100:00100000:0.0:1788540974.139859:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981015808 00000100:00100000:0.0:1788540974.139862:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981015808 00000100:00100000:0.0:1788540974.141489:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788540974.141501:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e778450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+21:6514:x1875420981015808:12345-0@lo:503: 00000100:00100000:0.0:1788540974.142683:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e778450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+21:6514:x1875420981015808:12345-0@lo:503: Request processed in 1180us (2842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540974.142693:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000004:00080000:0.0:1788540974.142754:0:9835:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1788540974.143215:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a30700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981015808:0@lo:503: 00000004:00080000:0.0:1788540974.143463:0:9835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 255061592209ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788540974.143470:0:9835:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788540974.146928:0:9838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:9838:1875420981015936:0@lo:502: 00000100:00100000:1.0:1788540974.147012:0:9838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540974.147058:0:9838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683549a180 going to sleep for 11 seconds 40000000:02000000:1.0:1788540974.147374:0:6524:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:0.0:1788540974.149035:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981015936 00000100:00100000:0.0:1788540974.149046:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981015936 00000100:00100000:0.0:1788540974.149099:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788540974.149985:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680cee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+21:9838:x1875420981015936:12345-0@lo:502: 00000100:00100000:0.0:1788540974.150366:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680cee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+21:9838:x1875420981015936:12345-0@lo:502: Request processed in 387us (3353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540974.150374:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000004:00080000:2.0:1788540974.150800:0:7448:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:1.0:1788540974.168444:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8439:x1875420981015552:12345-0@lo:700: Request processed in 33265us (33362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540974.168461:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788540974.168531:0:9838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:9838:1875420981015936:0@lo:502: 00010000:00080000:2.0:1788540974.168889:0:8439:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a683f0fc380 x1875420981015552/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788540990 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788540974.168903:0:8439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f0fc380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8439:1875420981015552:0@lo:700: 40000000:02000000:2.0:1788540974.168922:0:8439:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:1.0:1788540974.173747:0:9838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:9838:1875420981016064:0@lo:502: 00000100:00100000:1.0:1788540974.173843:0:9838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540974.176530:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981016064 00000100:00100000:1.0:1788540974.176545:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981016064 00000100:00100000:1.0:1788540974.176622:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788540974.176632:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680cee4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+21:9838:x1875420981016064:12345-0@lo:502: 00000100:00100000:1.0:1788540974.176795:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680cee4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+21:9838:x1875420981016064:12345-0@lo:502: Request processed in 163us (2951us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540974.176802:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788540974.176856:0:9838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a681084bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788540974.176892:0:9838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:9838:1875420981016064:0@lo:502: 00000040:00080000:1.0:1788540974.176924:0:9838:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1788540974.177601:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1788540974.177625:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788540974.177634:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75e600/0x2aac941e5f4a7624 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a762b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540974.177646:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a682e75e600/0x2aac941e5f4a7624 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a762b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788540974.177656:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788540974.177659:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a68112dc000 from 6 10000000:01000000:3.0:1788540974.177661:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788540974.177688:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6842172a00/0x2aac941e5f4a7632 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540974.177696:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a6842172a00/0x2aac941e5f4a7632 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540974.177705:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a6842172a00/0x2aac941e5f4a7632 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540974.177721:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981016192:0@lo:101: 00000100:00100000:3.0:1788540974.177764:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540974.177801:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707570900 going to sleep for 11 seconds 00000100:00100000:3.0:1788540974.177820:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981016192 00000100:00100000:3.0:1788540974.177824:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981016192 00000100:00100000:3.0:1788540974.177856:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788540974.177863:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680cee5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+21:6514:x1875420981016192:12345-0@lo:101: 00010000:00010000:3.0:1788540974.178035:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788540974.178047:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6842173a00/0x2aac941e5f4a7639 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a7632 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540974.178068:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6842173a00/0x2aac941e5f4a7639 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a7632 expref: 22 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540974.178077:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6842173a00/0x2aac941e5f4a7639 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a7632 expref: 22 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540974.178086:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6842173a00, rc 0) 00000100:00100000:3.0:1788540974.178116:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680cee5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+22:6514:x1875420981016192:12345-0@lo:101: Request processed in 253us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540974.178122:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788540974.178157:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981016192:0@lo:101: 00010000:00010000:3.0:1788540974.178170:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a6842172a00/0x2aac941e5f4a7632 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7639 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540974.178178:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a6842172a00/0x2aac941e5f4a7632 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a7639 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540974.178223:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981016320:0@lo:256: 00000100:00100000:3.0:1788540974.178258:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540974.178275:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707570900 going to sleep for 11 seconds 00000100:00100000:1.0:1788540974.182316:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981016320 00000100:00100000:1.0:1788540974.182331:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981016320 00000100:00100000:1.0:1788540974.182391:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788540974.182401:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680cee7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+22:6514:x1875420981016320:12345-0@lo:256: 20000000:01000000:1.0:1788540974.182431:0:6512:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788540974.182447:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788540974.182450:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1788540974.182744:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680cee7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+22:6514:x1875420981016320:12345-0@lo:256: Request processed in 344us (4484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540974.182752:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000001:00100000:2.0:1788540974.187145:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1788540974.187426:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981016320:0@lo:256: 10000000:01000000:3.0:1788540974.187497:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788540974.187508:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6842172a00/0x2aac941e5f4a7632 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7639 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540974.187521:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a6842172a00/0x2aac941e5f4a7632 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7639 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788540974.187530:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788540974.187533:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1788540974.187536:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788540974.189153:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6842173800/0x2aac941e5f4a7640 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540974.189170:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a6842173800/0x2aac941e5f4a7640 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540974.189181:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a6842173800/0x2aac941e5f4a7640 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540974.189205:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981016448:0@lo:101: 00000100:00100000:3.0:1788540974.189278:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540974.189319:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707570900 going to sleep for 11 seconds 00000100:00100000:3.0:1788540974.189357:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981016448 00000100:00100000:3.0:1788540974.189364:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981016448 00000100:00100000:3.0:1788540974.189418:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788540974.189428:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680cee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+22:6514:x1875420981016448:12345-0@lo:101: 00010000:00010000:3.0:1788540974.189453:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788540974.189467:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6842173400/0x2aac941e5f4a7647 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a7640 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540974.189491:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6842173400/0x2aac941e5f4a7647 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a7640 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540974.189502:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6842173400/0x2aac941e5f4a7647 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a7640 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540974.189511:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6842173400, rc 0) 00000100:00100000:3.0:1788540974.189559:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680cee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+23:6514:x1875420981016448:12345-0@lo:101: Request processed in 125us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540974.189566:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788540974.189863:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981016448:0@lo:101: 00010000:00010000:0.0:1788540974.189950:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a6842173800/0x2aac941e5f4a7640 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7647 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540974.189959:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a6842173800/0x2aac941e5f4a7640 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a7647 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540974.190029:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a32a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981016576:0@lo:501: 00000100:00100000:0.0:1788540974.190060:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540974.190080:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6808953a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788540974.191628:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981016576 00000100:00100000:3.0:1788540974.191640:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981016576 00000100:00100000:3.0:1788540974.191677:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788540974.191684:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6805288050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+23:6514:x1875420981016576:12345-0@lo:501: 00000100:00100000:3.0:1788540974.191831:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6805288050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+23:6514:x1875420981016576:12345-0@lo:501: Request processed in 146us (1769us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540974.191839:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788540974.191972:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a32a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981016576:0@lo:501: 00000100:00100000:0.0:1788540974.192020:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a32a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981016704:0@lo:503: 00000100:00100000:0.0:1788540974.192060:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540974.192094:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6808953a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788540974.192107:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981016704 00000100:00100000:0.0:1788540974.192111:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981016704 00000100:00100000:0.0:1788540974.192138:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788540974.192545:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680528a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+23:6514:x1875420981016704:12345-0@lo:503: 00000100:00100000:0.0:1788540974.192629:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680528a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+23:6514:x1875420981016704:12345-0@lo:503: Request processed in 87us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540974.192635:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788540974.192678:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a32a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981016704:0@lo:503: 00000100:00100000:0.0:1788540974.194808:0:9839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a32a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:9839:1875420981016832:0@lo:502: 00000100:00100000:0.0:1788540974.194899:0:9839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540974.194934:0:9839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6808953540 going to sleep for 11 seconds 00000100:00100000:0.0:1788540974.194985:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9836:x1875420981015296:12345-0@lo:700: Request processed in 59996us (61961us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540974.194995:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788540974.196200:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981016832 00000100:00100000:1.0:1788540974.196210:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981016832 00000100:00100000:1.0:1788540974.196264:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788540974.196274:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6805289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+23:9839:x1875420981016832:12345-0@lo:502: 00000100:00100000:1.0:1788540974.196414:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6805289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+23:9839:x1875420981016832:12345-0@lo:502: Request processed in 141us (1515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540974.196422:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788540974.196453:0:9839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a32a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:9839:1875420981016832:0@lo:502: 00000020:01000000:0.0:1788540974.196484:0:9839:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788540974.196492:0:9839:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788540974.196499:0:9839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788540974.196501:0:9839:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788540974.196506:0:9839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788540974.196510:0:9839:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.156@tcp to nid 0x20000c0a8ca9c (192.168.202.156@tcp) 00010000:00080000:3.0:1788540974.196531:0:9836:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67079b3b80 x1875420981015296/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788540990 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000020:01000000:0.0:1788540974.196532:0:9839:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788540974.196534:0:9839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000100:00100000:3.0:1788540974.196543:0:9836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079b3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9836:1875420981015296:0@lo:700: 00000020:00000080:0.0:1788540974.196549:0:9839:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9a6835314d40) 00000020:00000080:0.0:1788540974.196571:0:9839:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:0.0:1788540974.196577:0:9839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788540974.196671:0:9839:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788540974.196681:0:9839:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:0.0:1788540974.196688:0:9839:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2aac941e5f4a7655 00010000:00080000:0.0:1788540974.196724:0:9839:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a6705afe000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.156@tcp at head 00010000:00010000:0.0:1788540974.196974:0:9839:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:0.0:1788540974.197088:0:9839:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1788540974.197098:0:9839:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788540974.197281:0:9839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788540974.197386:0:9839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788540974.197505:0:9839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1788540974.197584:0:9839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1788540974.202030:0:9840:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788540974.202039:0:9840:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788540974.203435:0:9839:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788540974.203447:0:9839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788540974.203481:0:9839:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788540974.203503:0:9839:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2aac941e5f4a765c 00000100:00080000:2.0:1788540974.203513:0:9839:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788540974.203519:0:9839:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a6705afe000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:2.0:1788540974.203563:0:9839:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6706833b80 x1875420981016960/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788540974.203589:0:9839:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788540974.203641:0:9839:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788540974.203645:0:9839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788540974.203647:0:9839:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788540974.203659:0:9839:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788540974.203664:0:9839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788540974.203665:0:9839:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788540974.203668:0:9839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788540974.203670:0:9839:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788540974.203698:0:9839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706833800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:9839:1875420981017088:0@lo:502: 00000100:00100000:2.0:1788540974.203768:0:9839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540974.203813:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981017088 00000100:00100000:2.0:1788540974.203819:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981017088 00000100:00100000:2.0:1788540974.203859:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788540974.203867:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6805288850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+23:9839:x1875420981017088:12345-0@lo:502: 00000100:00100000:2.0:1788540974.203986:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6805288850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+23:9839:x1875420981017088:12345-0@lo:502: Request processed in 118us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540974.203993:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788540974.204036:0:9839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6807619840 going to sleep for 11 seconds 00000100:00100000:2.0:1788540974.204056:0:9839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706833800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:9839:1875420981017088:0@lo:502: 00000020:01000000:2.0:1788540974.204076:0:9839:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788540974.204080:0:9839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788540974.204081:0:9839:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788540974.204084:0:9839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:2.0:1788540974.204141:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:2.0:1788540974.204158:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788540974.204167:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6842173800/0x2aac941e5f4a7640 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7647 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540974.204177:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a6842173800/0x2aac941e5f4a7640 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7647 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788540974.204187:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788540974.204194:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9a682e74b380 from 1 10000000:01000000:2.0:1788540974.204197:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788540974.204217:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551b800/0x2aac941e5f4a7663 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540974.204225:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a683551b800/0x2aac941e5f4a7663 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540974.204234:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a683551b800/0x2aac941e5f4a7663 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540974.204245:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706833800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981017216:0@lo:101: 00000100:00100000:2.0:1788540974.204277:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540974.204292:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6807619840 going to sleep for 11 seconds 00000100:00100000:2.0:1788540974.204304:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981017216 00000100:00100000:2.0:1788540974.204307:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981017216 00000100:00100000:2.0:1788540974.204330:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788540974.204337:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6809078850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+23:6514:x1875420981017216:12345-0@lo:101: 00010000:00010000:2.0:1788540974.204345:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788540974.204357:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a683551ba00/0x2aac941e5f4a766a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a7663 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540974.204377:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a683551ba00/0x2aac941e5f4a766a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a7663 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540974.204388:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a683551ba00/0x2aac941e5f4a766a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a7663 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540974.204396:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a683551ba00, rc 0) 00000100:00100000:2.0:1788540974.204421:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6809078850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+24:6514:x1875420981017216:12345-0@lo:101: Request processed in 84us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540974.204432:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788540974.204459:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706833800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981017216:0@lo:101: 00010000:00010000:2.0:1788540974.204470:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a683551b800/0x2aac941e5f4a7663 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a766a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540974.204479:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a683551b800/0x2aac941e5f4a7663 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a766a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540974.204513:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706833800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981017344:0@lo:501: 00000100:00100000:2.0:1788540974.204533:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540974.204543:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6807619840 going to sleep for 11 seconds 00000100:00100000:2.0:1788540974.204552:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981017344 00000100:00100000:2.0:1788540974.204555:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981017344 00000100:00100000:2.0:1788540974.204571:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788540974.204576:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680907a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+24:6514:x1875420981017344:12345-0@lo:501: 00000100:00100000:2.0:1788540974.204644:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680907a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+24:6514:x1875420981017344:12345-0@lo:501: Request processed in 67us (110us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788540974.204650:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788540974.204678:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706833800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981017344:0@lo:501: 10000000:01000000:2.0:1788540974.204694:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788540974.204699:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551b800/0x2aac941e5f4a7663 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a766a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540974.204711:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a683551b800/0x2aac941e5f4a7663 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a766a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540974.205117:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981016960:0@lo:8: 00000100:00100000:3.0:1788540974.205152:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540974.205188:0:8973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981016960 00000100:00100000:3.0:1788540974.205197:0:8973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981016960 00000100:00100000:3.0:1788540974.205220:0:8973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788540974.205225:0:8973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3640:x1875420981016960:12345-0@lo:8: 00010000:00080000:3.0:1788540974.205250:0:8973:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 255 last 0 00000020:00000080:3.0:1788540974.205273:0:8973:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2aac941e5f4a7671 00002000:00100000:3.0:1788540974.205286:0:8973:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9a68379b1000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788540974.205290:0:8973:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788540974.205293:0:8973:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788540974.205365:0:8973:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788540974.205385:0:8973:0:(import.c:65:import_set_state_nolock()) ffff9a68379b5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788540974.205418:0:8973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3640:x1875420981016960:12345-0@lo:8: Request processed in 192us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540974.205424:0:8973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788540974.205453:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6706833b80 x1875420981016960/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788540984 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540974.205463:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788540974.205468:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788540974.205474:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788540974.205479:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788540974.205482:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a6705afe000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788540974.205489:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788540974.205492:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981016960:0@lo:8: 00000004:00080000:0.0:1788540974.206207:0:9840:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788540974.207133:0:9840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 255125261369ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788540974.207142:0:9840:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1788540974.209959:0:9836:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788540974.209990:0:9836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079b1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9836:1875420981017600:0@lo:7: 00000100:00100000:3.0:1788540974.210050:0:9836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540974.210076:0:9836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707570600 going to sleep for 11 seconds 00000100:00100000:3.0:1788540974.210114:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788540974.210124:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981017472:0@lo:13: 00000100:00100000:3.0:1788540974.210143:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540974.210164:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981017472 00000100:00100000:3.0:1788540974.210169:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981017472 00000100:00100000:3.0:1788540974.210202:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788540974.210208:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981017472:12345-0@lo:13: 00002000:00000024:3.0:1788540974.210234:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:3.0:1788540974.210280:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981017472:12345-0@lo:13: Request processed in 71us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540974.210288:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1788540974.210328:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67079b2300 x1875420981017472/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788540990 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540974.210347:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981017472:0@lo:13: 00000100:00100000:3.0:1788540974.211861:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981017728:0@lo:13: 00000100:00100000:3.0:1788540974.211933:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540974.211971:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981017728 00000100:00100000:3.0:1788540974.211976:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981017728 00000100:00100000:3.0:1788540974.212008:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788540974.212013:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875420981017728:12345-0@lo:13: 00002000:00000024:3.0:1788540974.212025:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:3.0:1788540974.212050:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875420981017728:12345-0@lo:13: Request processed in 37us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540974.212055:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788540974.212079:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67079b2300 x1875420981017728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788540990 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540974.212091:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981017728:0@lo:13: 00000004:00080000:3.0:1788540974.212350:0:9841:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788540974.212370:0:9841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079b2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9841:1875420981017856:0@lo:7: 00000100:00100000:3.0:1788540974.212397:0:9841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540974.212418:0:9841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707570180 going to sleep for 11 seconds 00000100:00100000:2.0:1788540974.212468:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981017600 00000100:00100000:2.0:1788540974.212471:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981017600 00000100:00100000:2.0:1788540974.212496:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981017856 00000100:00100000:2.0:1788540974.212498:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981017856 00000100:00100000:2.0:1788540974.212510:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788540974.212514:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9836:x1875420981017600:12345-0@lo:7: 00000100:00100000:2.0:1788540974.214913:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788540974.214931:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9841:x1875420981017856:12345-0@lo:7: 00002000:00080000:2.0:1788540974.215593:0:8431:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1788540974.215599:0:8431:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788540974.215680:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9836:x1875420981017600:12345-0@lo:7: Request processed in 3164us (5629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540974.215686:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1788540974.218338:0:9836:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67079b1f80 x1875420981017600/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788540990 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540974.218357:0:9836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079b1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9836:1875420981017600:0@lo:7: 00000004:00080000:3.0:1788540974.218372:0:9836:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788540974.218411:0:9836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079b1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9836:1875420981017984:0@lo:5: 00000100:00100000:3.0:1788540974.218455:0:9836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540974.218479:0:9836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707570600 going to sleep for 11 seconds 00000100:00100000:3.0:1788540974.218496:0:8973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981017984 00000100:00100000:3.0:1788540974.218501:0:8973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981017984 00000100:00100000:3.0:1788540974.218531:0:8973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788540974.218537:0:8973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9836:x1875420981017984:12345-0@lo:5: 00002000:00080000:3.0:1788540974.218569:0:8973:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1788540974.218596:0:8973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9836:x1875420981017984:12345-0@lo:5: Request processed in 59us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540974.218602:0:8973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1788540974.218628:0:9836:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67079b1f80 x1875420981017984/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788540990 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540974.218637:0:9836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079b1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9836:1875420981017984:0@lo:5: 00000004:00080000:3.0:1788540974.218645:0:9836:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788540974.218666:0:9836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079b1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9836:1875420981018112:0@lo:5: 00000100:00100000:3.0:1788540974.218682:0:9836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540974.218705:0:9836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707570600 going to sleep for 11 seconds 00000100:00100000:3.0:1788540974.218712:0:8973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981018112 00000100:00100000:3.0:1788540974.218715:0:8973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981018112 00000100:00100000:3.0:1788540974.218726:0:8973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788540974.218729:0:8973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9836:x1875420981018112:12345-0@lo:5: 00002000:00080000:3.0:1788540974.218749:0:8973:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00080000:1.0:1788540974.220676:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788540974.228794:0:8973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:9836:x1875420981018112:12345-0@lo:5: Request processed in 10045us (10093us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788540974.228808:0:8973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1788540974.228895:0:9836:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67079b1f80 x1875420981018112/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788540990 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540974.228913:0:9836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079b1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9836:1875420981018112:0@lo:5: 00000004:00080000:3.0:1788540974.228929:0:9836:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1788540974.228967:0:9836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079b0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9836:1875420981018240:0@lo:900: 00000100:00100000:3.0:1788540974.228996:0:9836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540974.229013:0:9836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707570600 going to sleep for 11 seconds 00000100:00100000:3.0:1788540974.229068:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981018240 00000100:00100000:3.0:1788540974.229073:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981018240 00000100:00100000:3.0:1788540974.229684:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788540974.229693:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9836:x1875420981018240:12345-0@lo:900: 00000100:00100000:3.0:1788540974.229748:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9836:x1875420981018240:12345-0@lo:900: Request processed in 57us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540974.229753:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788540974.230050:0:9836:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67079b0e00 x1875420981018240/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788540990 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540974.230062:0:9836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079b0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9836:1875420981018240:0@lo:900: 00000004:00080000:3.0:1788540974.238721:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:2.0:1788540974.239543:0:8430:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1788540974.240625:0:8430:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788540974.240729:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9841:x1875420981017856:12345-0@lo:7: Request processed in 25799us (28326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540974.240741:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788540974.240849:0:9841:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67079b2300 x1875420981017856/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788540990 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540974.240866:0:9841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079b2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9841:1875420981017856:0@lo:7: 00000004:00080000:3.0:1788540974.240913:0:9841:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788540974.240952:0:9841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079b2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9841:1875420981018368:0@lo:5: 00000100:00100000:3.0:1788540974.240988:0:9841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540974.241020:0:9841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707570180 going to sleep for 11 seconds 00000100:00100000:0.0:1788540974.241225:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981018368 00000100:00100000:0.0:1788540974.241234:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981018368 00000100:00100000:0.0:1788540974.241279:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788540974.241287:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9841:x1875420981018368:12345-0@lo:5: 00002000:00080000:0.0:1788540974.241308:0:8432:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788540974.241312:0:8432:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000001:00080000:2.0:1788540974.259765:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000001:00080000:2.0:1788540974.259936:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1788540974.259944:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788540974.260947:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9841:x1875420981018368:12345-0@lo:5: Request processed in 19653us (19951us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788540974.260959:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1788540974.261729:0:9841:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67079b2300 x1875420981018368/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788540990 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540974.261741:0:9841:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788540974.261748:0:9841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079b2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9841:1875420981018368:0@lo:5: 00000004:00080000:3.0:1788540974.261762:0:9841:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788540974.262306:0:9841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079b2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9841:1875420981018496:0@lo:700: 00000100:00100000:3.0:1788540974.262375:0:9841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540974.262409:0:9841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707570180 going to sleep for 11 seconds 00000100:00100000:1.0:1788540974.262432:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981018496 00000100:00100000:1.0:1788540974.262439:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981018496 00000100:00100000:1.0:1788540974.262487:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788540974.262496:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9841:x1875420981018496:12345-0@lo:700: 00000100:00100000:2.0:1788540974.279734:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9841:x1875420981018496:12345-0@lo:700: Request processed in 17231us (17352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540974.279753:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788540974.279964:0:9841:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67079b2300 x1875420981018496/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788540990 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540974.279984:0:9841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079b2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9841:1875420981018496:0@lo:700: 00000004:02000040:3.0:1788540974.284296:0:9841:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:3.0:1788540974.296084:0:9841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a72d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9841:1875420981018624:0@lo:5: 00000100:00100000:3.0:1788540974.296488:0:9841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540974.296530:0:8973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981018624 00000100:00100000:3.0:1788540974.296537:0:8973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981018624 00000100:00100000:3.0:1788540974.296597:0:8973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788540974.296606:0:8973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9841:x1875420981018624:12345-0@lo:5: 00000100:00100000:0.0:1788540974.298325:0:9841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707570180 going to sleep for 11 seconds 00002000:00080000:3.0:1788540974.305785:0:8973:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1788540974.305806:0:8973:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:3.0:1788540974.307455:0:8973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9841:x1875420981018624:12345-0@lo:5: Request processed in 10845us (10961us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788540974.307474:0:8973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788540974.307498:0:9841:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707a72d80 x1875420981018624/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788540990 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540974.307516:0:9841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a72d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9841:1875420981018624:0@lo:5: 00000004:00080000:1.0:1788540974.307532:0:9841:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:1.0:1788540974.543157:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788540974.925517:0:9883:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg256-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788540975.562024:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788540976.275660:0:9935:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788540976.277249:0:9935:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788540976.592146:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788540977.495962:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:1.0:1788540977.612139:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981018752:0@lo:13: 00000100:00100000:1.0:1788540977.612209:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540977.612283:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788540977.612316:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981018880:0@lo:13: 00000100:00100000:1.0:1788540977.612361:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540977.612407:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981018752 00000100:00100000:1.0:1788540977.612414:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981018752 00000100:00100000:1.0:1788540977.612469:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981018880 00000100:00100000:1.0:1788540977.612472:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981018880 00000100:00100000:1.0:1788540977.612488:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788540977.612495:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981018752:12345-0@lo:13: 00002000:00000024:1.0:1788540977.612531:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788540977.612586:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981018752:12345-0@lo:13: Request processed in 90us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540977.612593:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788540977.612821:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981019008:0@lo:41: 00000100:00100000:0.0:1788540977.612852:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540977.612911:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981019008 00000100:00100000:0.0:1788540977.612916:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981019008 00000100:00100000:0.0:1788540977.612944:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788540977.612950:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981019008:12345-0@lo:41: 00000004:00000024:0.0:1788540977.612974:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788540977.613018:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981019008:12345-0@lo:41: Request processed in 68us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540977.613023:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788540977.613062:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981019008:0@lo:41: 00000100:00080000:0.0:1788540977.613095:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788540977.613117:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707a71f80 x1875420981018752/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788540993 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540977.613130:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981018752:0@lo:13: 00000100:00100000:1.0:1788540977.613721:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788540977.613733:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706879880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981018880:12345-0@lo:13: 00002000:00000024:1.0:1788540977.613757:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788540977.613795:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706879880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981018880:12345-0@lo:13: Request processed in 66us (1433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540977.613802:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788540977.616475:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707a32a00 x1875420981018880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788540993 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540977.616500:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981018880:0@lo:13: 00010000:00010000:1.0:1788540977.617730:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788540978.122311:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788540978.122342:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706833800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981019136:0@lo:41: 00000100:00100000:3.0:1788540978.122415:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540978.122588:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981019136 00000100:00100000:1.0:1788540978.122605:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981019136 00000100:00100000:1.0:1788540978.122657:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788540978.122666:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981019136:12345-0@lo:41: 00000004:00000024:1.0:1788540978.122698:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788540978.122778:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981019136:12345-0@lo:41: Request processed in 112us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540978.122784:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788540978.123040:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706833800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981019136:0@lo:41: 00010000:00010000:2.0:1788540978.635834:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788540979.469183:0:10036:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788540979.469475:0:10036:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788540979.659022:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875420981019392:0@lo:400: 00000100:00100000:3.0:1788540979.659094:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540979.659142:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875420981019904:0@lo:400: 00000100:00100000:3.0:1788540979.659165:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540979.659187:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875420981020416:0@lo:400: 00000100:00100000:3.0:1788540979.659232:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540979.659263:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1788540979.659282:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420981019264:0@lo:400: 00000100:00100000:3.0:1788540979.659313:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540979.659482:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981019392 00000100:00100000:1.0:1788540979.659495:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981019392 00000100:00100000:1.0:1788540979.659541:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981019904 00000100:00100000:1.0:1788540979.659544:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981019904 00000100:00100000:1.0:1788540979.659570:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981020416 00000100:00100000:1.0:1788540979.659573:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981020416 00000100:00100000:1.0:1788540979.659589:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788540979.659597:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875420981019392:12345-0@lo:400: 00000100:00100000:1.0:1788540979.659650:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875420981019392:12345-0@lo:400: Request processed in 53us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540979.659657:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788540979.659675:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788540979.659682:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875420981019904:12345-0@lo:400: 00000100:00100000:1.0:1788540979.659709:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875420981019904:12345-0@lo:400: Request processed in 28us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540979.659715:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788540979.659737:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788540979.659743:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6837968700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875420981020416:12345-0@lo:400: 00000100:00100000:1.0:1788540979.659770:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6837968700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875420981020416:12345-0@lo:400: Request processed in 28us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540979.659775:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788540979.659795:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788540979.659804:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670687bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981020928:0@lo:13: 00000100:00100000:1.0:1788540979.659832:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788540979.659861:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788540979.659891:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981020928 00000100:00100000:1.0:1788540979.659895:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981020928 00000100:00100000:1.0:1788540979.659928:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788540979.659935:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670687b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981020928:12345-0@lo:13: 00002000:00000024:1.0:1788540979.659964:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788540979.660000:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670687b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981020928:12345-0@lo:13: Request processed in 66us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540979.660006:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788540979.660021:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788540979.660045:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670687bb80 x1875420981020928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788540995 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540979.660055:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1788540979.660074:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670687bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981020928:0@lo:13: 00000100:00100000:3.0:1788540979.660348:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981019776:0@lo:400: 00000100:00100000:3.0:1788540979.660379:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540979.660407:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981020288:0@lo:400: 00000100:00100000:3.0:1788540979.660426:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540979.660443:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981020800:0@lo:400: 00000100:00100000:3.0:1788540979.660456:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788540979.660475:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707a71180 x1875420981019392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540979.660497:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875420981019392:0@lo:400: 00010000:00080000:3.0:1788540979.660508:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707a70e00 x1875420981019904/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540979.660514:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875420981019904:0@lo:400: 00010000:00080000:3.0:1788540979.660522:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707a72a00 x1875420981020416/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540979.660529:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875420981020416:0@lo:400: 00000100:00100000:3.0:1788540979.660558:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981019520:0@lo:400: 00000100:00100000:3.0:1788540979.660581:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540979.660600:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875420981020032:0@lo:400: 00000100:00100000:3.0:1788540979.660622:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540979.660638:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875420981020544:0@lo:400: 00000100:00100000:1.0:1788540979.660787:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981019776 00000100:00100000:1.0:1788540979.660792:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981019776 00000100:00100000:1.0:1788540979.660814:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981019520 00000100:00100000:1.0:1788540979.660818:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981019520 00000100:00100000:1.0:1788540979.660830:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788540979.660837:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683796aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981019776:12345-0@lo:400: 00000100:00100000:1.0:1788540979.660902:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683796aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981019776:12345-0@lo:400: Request processed in 64us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540979.660909:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788540979.660923:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788540979.660928:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683796bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981019520:12345-0@lo:400: 00000100:00100000:1.0:1788540979.660955:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683796bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981019520:12345-0@lo:400: Request processed in 28us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540979.660961:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788540979.660978:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981020032 00000100:00100000:1.0:1788540979.660981:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981020032 00000100:00100000:1.0:1788540979.661006:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788540979.661011:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683796b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875420981020032:12345-0@lo:400: 00000100:00100000:1.0:1788540979.661050:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683796b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875420981020032:12345-0@lo:400: Request processed in 39us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540979.661057:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1788540979.661071:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788540979.661090:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981019776:0@lo:400: 00000100:00100000:3.0:1788540979.661379:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540979.661419:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981019520:0@lo:400: 00010000:00080000:3.0:1788540979.661429:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707a73480 x1875420981020032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540979.661436:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875420981020032:0@lo:400: 00000100:00100000:3.0:1788540979.661446:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788540979.661452:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875420981019648:0@lo:400: 00000100:00100000:3.0:1788540979.661472:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540979.661486:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981020160:0@lo:400: 00000100:00100000:3.0:1788540979.661504:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540979.661536:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981020672:0@lo:400: 00000100:00100000:3.0:1788540979.661556:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540979.661591:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981020288 00000100:00100000:3.0:1788540979.661595:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981020288 00000100:00100000:3.0:1788540979.661619:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981020800 00000100:00100000:3.0:1788540979.661622:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981020800 00000100:00100000:3.0:1788540979.661632:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981020160 00000100:00100000:3.0:1788540979.661635:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981020160 00000100:00100000:1.0:1788540979.661733:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981020544 00000100:00100000:1.0:1788540979.661738:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981020544 00000100:00100000:1.0:1788540979.661763:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981019648 00000100:00100000:1.0:1788540979.661766:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981019648 00000100:00100000:1.0:1788540979.661780:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788540979.661786:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683796ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875420981020544:12345-0@lo:400: 00000100:00100000:1.0:1788540979.661823:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683796ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875420981020544:12345-0@lo:400: Request processed in 36us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540979.661829:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788540979.661842:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788540979.661848:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683796a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875420981019648:12345-0@lo:400: 00000100:00100000:1.0:1788540979.661897:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683796a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875420981019648:12345-0@lo:400: Request processed in 50us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540979.661903:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1788540979.661917:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788540979.661920:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788540979.662364:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981020672 00000100:00100000:3.0:1788540979.662369:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981020672 00000100:00100000:3.0:1788540979.662404:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788540979.662411:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6837968000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981020288:12345-0@lo:400: 00000100:00100000:3.0:1788540979.662448:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6837968000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981020288:12345-0@lo:400: Request processed in 38us (2021us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540979.662454:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788540979.662466:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788540979.662471:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6837969880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981020800:12345-0@lo:400: 00000100:00100000:3.0:1788540979.662493:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6837969880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981020800:12345-0@lo:400: Request processed in 22us (2035us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540979.662498:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788540979.662509:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788540979.662514:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6837969f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981020160:12345-0@lo:400: 00000100:00100000:3.0:1788540979.662537:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6837969f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981020160:12345-0@lo:400: Request processed in 23us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540979.662541:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788540979.662551:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788540979.662557:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683796b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981020672:12345-0@lo:400: 00000100:00100000:3.0:1788540979.662582:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683796b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981020672:12345-0@lo:400: Request processed in 25us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540979.662595:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788540979.662637:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707a72680 x1875420981019648/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788540979.662720:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788540979.662752:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707a70700 x1875420981020288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788540995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540979.662763:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981020288:0@lo:400: 00010000:00080000:1.0:1788540979.662775:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707a73b80 x1875420981020800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788540995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540979.662795:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981020800:0@lo:400: 00000100:00100000:3.0:1788540979.662989:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875420981019648:0@lo:400: 00010000:00080000:3.0:1788540979.663004:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707a71500 x1875420981020160/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788540995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540979.663013:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981020160:0@lo:400: 00010000:00080000:3.0:1788540979.663023:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707a71880 x1875420981020672/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788540995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540979.663030:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788540979.663042:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981020672:0@lo:400: 00010000:00080000:3.0:1788540979.663054:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707a70000 x1875420981020544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788540995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540979.663061:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875420981020544:0@lo:400: 00000100:00100000:3.0:1788540979.663080:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670687bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981021056:0@lo:13: 00000100:00100000:3.0:1788540979.663115:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540979.663193:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981019264 00000100:00100000:3.0:1788540979.663198:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981019264 00000100:00100000:3.0:1788540979.663231:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788540979.663237:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680907ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+24:3642:x1875420981019264:12345-0@lo:400: 00000100:00100000:3.0:1788540979.663349:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680907ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+24:3642:x1875420981019264:12345-0@lo:400: Request processed in 111us (4033us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540979.663356:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788540979.663437:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981021056 00000100:00100000:1.0:1788540979.663441:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981021056 00000100:00100000:1.0:1788540979.663472:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788540979.663479:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6837969c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981021056:12345-0@lo:13: 00002000:00000024:1.0:1788540979.663496:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788540979.663537:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6837969c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981021056:12345-0@lo:13: Request processed in 58us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540979.663544:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788540979.663569:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670687bb80 x1875420981021056/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788540995 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540979.663586:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670687bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981021056:0@lo:13: 00000100:00100000:1.0:1788540979.663611:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420981019264:0@lo:400: 00010000:00010000:2.0:1788540979.665478:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788540980.650273:0:10084:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788540980.650284:0:10084:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:0.0:1788540980.687650:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788540981.149783:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788540981.150039:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955803776 00000100:00100000:2.0:1788540981.150049:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955803776 00000100:00100000:2.0:1788540981.150137:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 181 00000100:00100000:2.0:1788540981.150144:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6809078450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2393:x1875420955803776:12345-192.168.202.56@tcp:250: 00010000:00080000:2.0:1788540981.150173:0:6512:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from de51b185-1fb8-4395-8428-f3d8fb602cc3@192.168.202.56@tcp t0 exp 0000000000000000 cur 262 last 0 00000020:00000080:2.0:1788540981.150201:0:6512:0:(genops.c:1385:class_connect()) connect: client de51b185-1fb8-4395-8428-f3d8fb602cc3, cookie 0x2aac941e5f4a7678 00000100:00080000:2.0:1788540981.150347:0:6512:0:(import.c:65:import_set_state_nolock()) ffff9a6707a3f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788540981.150421:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6809078450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+5:2393:x1875420955803776:12345-192.168.202.56@tcp:250: Request processed in 276us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540981.150429:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 181 00000100:00100000:1.0:1788540981.152176:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788540981.152246:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955803904 00000100:00100000:3.0:1788540981.152253:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955803904 00000100:00100000:3.0:1788540981.152303:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 182 00000100:00100000:3.0:1788540981.152313:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807634850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+5:6154:x1875420955803904:12345-192.168.202.56@tcp:101: 00010000:00010000:3.0:1788540981.152336:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788540981.152354:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6812045400/0x2aac941e5f4a767f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16473202a33107e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540981.152382:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6812045400/0x2aac941e5f4a767f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33107e expref: 6 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540981.152393:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6812045400/0x2aac941e5f4a767f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33107e expref: 6 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540981.152402:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6812045400, rc 0) 00000100:00100000:3.0:1788540981.152453:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807634850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+6:6154:x1875420955803904:12345-192.168.202.56@tcp:101: Request processed in 141us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540981.152461:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 182 00000100:00100000:0.0:1788540981.157596:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788540981.157728:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955804032 00000100:00100000:2.0:1788540981.157738:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955804032 00000100:00100000:2.0:1788540981.157796:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 183 00000100:00100000:2.0:1788540981.157806:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+6:6154:x1875420955804032:12345-192.168.202.56@tcp:501: 00000100:00100000:2.0:1788540981.157950:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+6:6154:x1875420955804032:12345-192.168.202.56@tcp:501: Request processed in 145us (362us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788540981.157958:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 183 00000100:00100000:1.0:1788540981.160621:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788540981.160830:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955804160 00000100:00100000:2.0:1788540981.160841:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955804160 00000100:00100000:2.0:1788540981.160927:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 184 00000100:00100000:2.0:1788540981.160938:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+6:6154:x1875420955804160:12345-192.168.202.56@tcp:101: 00010000:00010000:2.0:1788540981.160955:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788540981.160975:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a683551b000/0x2aac941e5f4a7686 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16473202a331085 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540981.161019:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a683551b000/0x2aac941e5f4a7686 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331085 expref: 7 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540981.161030:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a683551b000/0x2aac941e5f4a7686 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331085 expref: 7 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540981.161040:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a683551b000, rc 0) 00000100:00100000:2.0:1788540981.162722:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+7:6154:x1875420955804160:12345-192.168.202.56@tcp:101: Request processed in 1769us (2092us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540981.162733:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 184 00000100:00100000:0.0:1788540981.168276:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788540981.168372:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955804288 00000100:00100000:3.0:1788540981.168383:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955804288 00000100:00100000:3.0:1788540981.168441:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 185 00000100:00100000:3.0:1788540981.168451:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807636c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+7:6154:x1875420955804288:12345-192.168.202.56@tcp:501: 00000100:00100000:3.0:1788540981.168616:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807636c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+8:6154:x1875420955804288:12345-192.168.202.56@tcp:501: Request processed in 165us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540981.168624:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 185 00000100:00100000:2.0:1788540981.173629:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788540981.174017:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955804416 00000100:00100000:3.0:1788540981.174028:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955804416 00000100:00100000:3.0:1788540981.174086:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 186 00000100:00100000:3.0:1788540981.174110:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807634450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+8:6154:x1875420955804416:12345-192.168.202.56@tcp:503: 00000100:00100000:3.0:1788540981.176798:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807634450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+8:6154:x1875420955804416:12345-192.168.202.56@tcp:503: Request processed in 2677us (3166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540981.176813:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 186 00000100:00100000:1.0:1788540981.188864:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788540981.189129:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955804544 00000100:00100000:0.0:1788540981.189139:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955804544 00000100:00100000:0.0:1788540981.189199:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 187 00000100:00100000:0.0:1788540981.189209:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807634050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+8:6173:x1875420955804544:12345-192.168.202.56@tcp:502: 00000100:00100000:0.0:1788540981.189413:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807634050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+8:6173:x1875420955804544:12345-192.168.202.56@tcp:502: Request processed in 205us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540981.189422:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 187 00000100:00100000:0.0:1788540981.218232:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788540981.218373:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955804672 00000100:00100000:3.0:1788540981.218384:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955804672 00000100:00100000:3.0:1788540981.218444:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 188 00000100:00100000:3.0:1788540981.218456:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807635c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+8:6173:x1875420955804672:12345-192.168.202.56@tcp:502: 00000100:00100000:3.0:1788540981.218624:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807635c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+8:6173:x1875420955804672:12345-192.168.202.56@tcp:502: Request processed in 170us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540981.218631:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 188 00000100:00100000:2.0:1788540981.226426:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788540981.226516:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955804800 00000100:00100000:3.0:1788540981.226527:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955804800 00000100:00100000:3.0:1788540981.226593:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 189 00000100:00100000:3.0:1788540981.226611:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+8:6154:x1875420955804800:12345-192.168.202.56@tcp:101: 00010000:00010000:3.0:1788540981.226627:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788540981.226644:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6812045c00/0x2aac941e5f4a768d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16473202a3310b6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540981.226810:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6812045c00/0x2aac941e5f4a768d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3310b6 expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540981.226823:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6812045c00/0x2aac941e5f4a768d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3310b6 expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540981.226833:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6812045c00, rc 0) 00000100:00100000:3.0:1788540981.228318:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+9:6154:x1875420955804800:12345-192.168.202.56@tcp:101: Request processed in 1700us (1891us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540981.228342:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 189 00000100:00100000:1.0:1788540981.234945:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788540981.235853:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955804928 00000100:00100000:0.0:1788540981.235865:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955804928 00000100:00100000:0.0:1788540981.235957:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 190 00000100:00100000:0.0:1788540981.235968:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+9:6154:x1875420955804928:12345-192.168.202.56@tcp:256: 20000000:01000000:0.0:1788540981.235994:0:6512:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788540981.236020:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788540981.236024:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788540981.236027:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788540981.236030:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788540981.236033:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1788540981.243172:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+9:6154:x1875420955804928:12345-192.168.202.56@tcp:256: Request processed in 7193us (8225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540981.243187:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 190 00000100:00100000:2.0:1788540981.250512:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788540981.250769:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955805056 00000100:00100000:0.0:1788540981.250781:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955805056 00000100:00100000:0.0:1788540981.250927:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 191 00000100:00100000:0.0:1788540981.250940:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807636850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+9:6154:x1875420955805056:12345-192.168.202.56@tcp:101: 00010000:00010000:0.0:1788540981.250962:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788540981.250985:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a682e75fa00/0x2aac941e5f4a7694 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16473202a3310bd expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540981.251023:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a682e75fa00/0x2aac941e5f4a7694 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3310bd expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540981.251038:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a682e75fa00/0x2aac941e5f4a7694 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3310bd expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540981.251070:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75fa00, rc 0) 00000100:00100000:0.0:1788540981.251137:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807636850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+10:6154:x1875420955805056:12345-192.168.202.56@tcp:101: Request processed in 201us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540981.251144:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 191 00000100:00100000:3.0:1788540981.253123:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788540981.259017:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955805184 00000100:00100000:2.0:1788540981.259035:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955805184 00000100:00100000:2.0:1788540981.259093:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 192 00000100:00100000:2.0:1788540981.259103:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e78bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+10:6154:x1875420955805184:12345-192.168.202.56@tcp:501: 00000100:00100000:2.0:1788540981.259288:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e78bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+10:6154:x1875420955805184:12345-192.168.202.56@tcp:501: Request processed in 185us (6174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540981.259296:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 192 00000100:00100000:1.0:1788540981.262846:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788540981.262980:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955805312 00000100:00100000:2.0:1788540981.262990:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955805312 00000100:00100000:2.0:1788540981.263035:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 193 00000100:00100000:2.0:1788540981.263045:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e78a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+10:6154:x1875420955805312:12345-192.168.202.56@tcp:503: 00000100:00100000:2.0:1788540981.263200:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e78a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+10:6154:x1875420955805312:12345-192.168.202.56@tcp:503: Request processed in 156us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540981.263215:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 193 00000100:00100000:0.0:1788540981.266279:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788540981.266859:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955805440 00000100:00100000:1.0:1788540981.266913:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955805440 00000100:00100000:1.0:1788540981.266966:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 194 00000100:00100000:1.0:1788540981.267100:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e78a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+10:6178:x1875420955805440:12345-192.168.202.56@tcp:502: 00000100:00100000:1.0:1788540981.267230:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e78a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+10:6178:x1875420955805440:12345-192.168.202.56@tcp:502: Request processed in 256us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540981.267236:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 194 00000100:00100000:3.0:1788540981.269127:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788540981.269242:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955805568 00000100:00100000:0.0:1788540981.269252:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955805568 00000100:00100000:0.0:1788540981.269304:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 195 00000100:00100000:0.0:1788540981.269314:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e78a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+10:6178:x1875420955805568:12345-192.168.202.56@tcp:502: 00000100:00100000:0.0:1788540981.269476:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e78a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+10:6178:x1875420955805568:12345-192.168.202.56@tcp:502: Request processed in 163us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540981.269484:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 195 00000100:00100000:0.0:1788540981.273219:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788540981.273271:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788540981.273380:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955805696 00000100:00100000:2.0:1788540981.273389:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955805696 00000100:00100000:2.0:1788540981.273434:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955805952 00000100:00100000:2.0:1788540981.273437:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955805952 00000100:00100000:2.0:1788540981.273459:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 8 00000100:00100000:2.0:1788540981.273468:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2393:x1875420955805696:12345-192.168.202.56@tcp:38: 00010000:00080000:2.0:1788540981.273496:0:6518:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 384f52e3-0481-4979-9299-157aff7472d2@192.168.202.56@tcp t0 exp 0000000000000000 cur 262 last 0 00000020:00000080:2.0:1788540981.273561:0:6518:0:(genops.c:1385:class_connect()) connect: client 384f52e3-0481-4979-9299-157aff7472d2, cookie 0x2aac941e5f4a769b 00000004:00100000:2.0:1788540981.273586:0:6518:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1788540981.273704:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 9 00000100:00100000:1.0:1788540981.273719:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2393:x1875420955805952:12345-192.168.202.56@tcp:38: 00010000:00080000:1.0:1788540981.273736:0:6517:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 384f52e3-0481-4979-9299-157aff7472d2@192.168.202.56@tcp t0 exp 0000000000000000 cur 262 last 0 00000020:00000080:1.0:1788540981.273764:0:6517:0:(genops.c:1385:class_connect()) connect: client 384f52e3-0481-4979-9299-157aff7472d2, cookie 0x2aac941e5f4a76a2 00000004:00100000:1.0:1788540981.273777:0:6517:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788540981.274021:0:6517:0:(import.c:65:import_set_state_nolock()) ffff9a67078db000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788540981.274079:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+6:2393:x1875420955805952:12345-192.168.202.56@tcp:38: Request processed in 368us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540981.274086:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 9 00000100:00080000:2.0:1788540981.275065:0:6518:0:(import.c:65:import_set_state_nolock()) ffff9a6707a3b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788540981.275115:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+6:2393:x1875420955805696:12345-192.168.202.56@tcp:38: Request processed in 1647us (1905us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540981.275123:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 8 00010000:00010000:2.0:1788540981.708308:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788540982.291314:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788540982.291357:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788540982.291387:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788540982.291464:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955806080 00000100:00100000:1.0:1788540982.291464:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955806208 00000100:00100000:3.0:1788540982.291465:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955805824 00000100:00100000:3.0:1788540982.291476:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955805824 00000100:00100000:2.0:1788540982.291476:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955806080 00000100:00100000:1.0:1788540982.291476:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955806208 00000100:00100000:2.0:1788540982.291558:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 10 00000100:00100000:2.0:1788540982.291568:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+7:0:x1875420955805824:12345-192.168.202.56@tcp:41: 00000100:00100000:1.0:1788540982.291575:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 11 00000100:00100000:1.0:1788540982.291589:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+7:6154:x1875420955806208:12345-192.168.202.56@tcp:41: 00000100:00080000:0.0:1788540982.291589:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788540982.291596:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:2.0:1788540982.291608:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000004:00000024:1.0:1788540982.291610:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788540982.291686:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+7:6154:x1875420955806208:12345-192.168.202.56@tcp:41: Request processed in 102us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540982.291694:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 11 00000100:00100000:1.0:1788540982.291729:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 12 00000100:00100000:1.0:1788540982.291736:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+6:0:x1875420955806080:12345-192.168.202.56@tcp:41: 00000004:00000024:1.0:1788540982.291780:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788540982.295855:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+6:0:x1875420955805824:12345-192.168.202.56@tcp:41: Request processed in 4275us (4453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540982.295883:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 10 00000100:00100000:0.0:1788540982.301631:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788540982.303531:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955806336 00000100:00100000:2.0:1788540982.303545:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955806336 00000100:00100000:2.0:1788540982.303621:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 13 00000100:00100000:2.0:1788540982.303646:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+6:6154:x1875420955806336:12345-192.168.202.56@tcp:40: 00000100:00100000:2.0:1788540982.303755:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+6:6154:x1875420955806336:12345-192.168.202.56@tcp:40: Request processed in 111us (2134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540982.303763:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 13 00000100:00100000:1.0:1788540982.307792:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+6:0:x1875420955806080:12345-192.168.202.56@tcp:41: Request processed in 16043us (16420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540982.307807:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 12 00000100:00100000:2.0:1788540982.308781:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788540982.309084:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955806464 00000100:00100000:3.0:1788540982.309093:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955806464 00000100:00100000:3.0:1788540982.309140:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 16 00000100:00100000:3.0:1788540982.309148:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706832d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2393:x1875420955806464:12345-192.168.202.56@tcp:8: 00010000:00080000:3.0:1788540982.309181:0:8432:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 384f52e3-0481-4979-9299-157aff7472d2@192.168.202.56@tcp t0 exp 0000000000000000 cur 263 last 0 00000020:00000080:3.0:1788540982.309344:0:8432:0:(genops.c:1385:class_connect()) connect: client 384f52e3-0481-4979-9299-157aff7472d2, cookie 0x2aac941e5f4a76a9 00002000:00100000:3.0:1788540982.309357:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 384f52e3-0481-4979-9299-157aff7472d2/ffff9a683f192000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788540982.309375:0:8432:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788540982.309577:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788540982.309607:0:8432:0:(import.c:65:import_set_state_nolock()) ffff9a683f191000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788540982.309690:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706832d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:384f52e3-0481-4979-9299-157aff7472d2+6:2393:x1875420955806464:12345-192.168.202.56@tcp:8: Request processed in 540us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540982.309699:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 16 00000100:00100000:2.0:1788540982.317115:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788540982.317159:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788540982.317268:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788540982.317336:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955806592 00000100:00100000:3.0:1788540982.317344:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955806720 00000100:00100000:0.0:1788540982.317346:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955806592 00000100:00100000:3.0:1788540982.317348:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955806720 00000100:00100000:0.0:1788540982.317386:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 17 00000100:00100000:3.0:1788540982.317389:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 4 00000100:00100000:3.0:1788540982.317395:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:384f52e3-0481-4979-9299-157aff7472d2+6:6154:x1875420955806720:12345-192.168.202.56@tcp:900: 00000100:00100000:0.0:1788540982.317403:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706833b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2393:x1875420955806592:12345-192.168.202.56@tcp:8: 00010000:00080000:0.0:1788540982.317431:0:8431:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 384f52e3-0481-4979-9299-157aff7472d2@192.168.202.56@tcp t0 exp 0000000000000000 cur 263 last 0 00000020:00000080:0.0:1788540982.317474:0:8431:0:(genops.c:1385:class_connect()) connect: client 384f52e3-0481-4979-9299-157aff7472d2, cookie 0x2aac941e5f4a76b0 00000100:00100000:3.0:1788540982.317479:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:384f52e3-0481-4979-9299-157aff7472d2+6:6154:x1875420955806720:12345-192.168.202.56@tcp:900: Request processed in 84us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540982.317486:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 4 00002000:00100000:0.0:1788540982.317494:0:8431:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 384f52e3-0481-4979-9299-157aff7472d2/ffff9a6837957000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788540982.317512:0:8431:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788540982.317676:0:8431:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788540982.317715:0:8431:0:(import.c:65:import_set_state_nolock()) ffff9a6837950800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788540982.317745:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706833b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:384f52e3-0481-4979-9299-157aff7472d2+6:2393:x1875420955806592:12345-192.168.202.56@tcp:8: Request processed in 350us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540982.317753:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 17 00000100:00100000:1.0:1788540982.318474:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955806848 00000100:00100000:1.0:1788540982.318482:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955806848 00000100:00100000:2.0:1788540982.318669:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 196 00000100:00100000:2.0:1788540982.318677:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e788c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+10:2394:x1875420955806848:12345-192.168.202.56@tcp:400: 00000100:00100000:2.0:1788540982.318776:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e788c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+10:2394:x1875420955806848:12345-192.168.202.56@tcp:400: Request processed in 100us (1616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540982.318784:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 196 00000100:00100000:2.0:1788540982.322743:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788540982.322993:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955806976 00000100:00100000:3.0:1788540982.323002:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955806976 00000100:00100000:3.0:1788540982.323058:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 0 00000100:00100000:3.0:1788540982.323067:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+6:6154:x1875420955806976:12345-192.168.202.56@tcp:33: 00000004:00080000:3.0:1788540982.351660:0:6520:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 28513us 00000004:00200000:3.0:1788540982.362763:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788540982.362911:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+6:6154:x1875420955806976:12345-192.168.202.56@tcp:33: Request processed in 39838us (40170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540982.362923:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 0 00000100:00100000:3.0:1788540982.610591:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788540982.610838:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955807104 00000100:00100000:1.0:1788540982.610850:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955807104 00000100:00100000:1.0:1788540982.610955:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 14 00000100:00100000:1.0:1788540982.610966:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6837969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+6:6197:x1875420955807104:12345-192.168.202.56@tcp:101: 00010000:00010000:1.0:1788540982.610988:0:9339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788540982.611061:0:9339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da000/0x2aac941e5f4a76b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3310ee expref: -99 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540982.611125:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da200/0x2aac941e5f4a76be lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540982.611139:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da200/0x2aac941e5f4a76be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540982.611278:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da200/0x2aac941e5f4a76be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788540982.611326:0:9339:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788540982.611330:0:9339:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788540982.611347:0:9339:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da200/0x2aac941e5f4a76be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540982.611373:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da000/0x2aac941e5f4a76b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3310ee expref: 8 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540982.612511:0:9339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da200/0x2aac941e5f4a76be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3310ee expref: 7 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540982.612627:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6811269500) 00010000:00010000:1.0:1788540982.612631:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788540982.612635:0:9339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68354da200, rc 0) 00000100:00100000:1.0:1788540982.612954:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6837969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+7:6197:x1875420955807104:12345-192.168.202.56@tcp:101: Request processed in 1988us (2371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540982.612962:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 14 00000100:00100000:1.0:1788540982.730322:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981021184:0@lo:13: 00000100:00100000:1.0:1788540982.730399:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540982.730802:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6837968a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981021312:0@lo:13: 00000100:00100000:3.0:1788540982.730834:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540982.730901:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981021184 00000100:00100000:3.0:1788540982.730908:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981021184 00000100:00100000:3.0:1788540982.730953:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981021312 00000100:00100000:3.0:1788540982.730956:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981021312 00000100:00100000:3.0:1788540982.730973:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788540982.730981:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670687bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981021184:12345-0@lo:13: 00002000:00000024:3.0:1788540982.731002:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00010000:2.0:1788540982.731122:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788540982.731131:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788540982.731139:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981021440:0@lo:41: 00000100:00100000:2.0:1788540982.731166:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540982.731195:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981021440 00000100:00100000:2.0:1788540982.731199:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981021440 00000100:00100000:2.0:1788540982.731236:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788540982.731243:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981021440:12345-0@lo:41: 00000004:00000024:2.0:1788540982.731262:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788540982.731292:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981021440:12345-0@lo:41: Request processed in 49us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540982.731298:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788540982.731350:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981021440:0@lo:41: 00000100:00080000:2.0:1788540982.731379:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788540982.735446:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670687bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981021184:12345-0@lo:13: Request processed in 4453us (5043us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540982.735460:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788540982.735493:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788540982.735510:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683796a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981021312:12345-0@lo:13: 00002000:00000024:3.0:1788540982.735547:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788540982.735626:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683796a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981021312:12345-0@lo:13: Request processed in 125us (4790us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540982.735653:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1788540982.735893:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6837968a80 x1875420981021312/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788540998 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788540982.735918:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6837968a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981021312:0@lo:13: 00010000:00080000:1.0:1788540982.744937:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707a30700 x1875420981021184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788540998 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540982.744966:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981021184:0@lo:13: 00000100:00100000:1.0:1788540983.242206:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981021568:0@lo:41: 00000100:00100000:1.0:1788540983.242291:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540983.242436:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981021568 00000100:00100000:2.0:1788540983.242444:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981021568 00000100:00100000:2.0:1788540983.242494:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788540983.242504:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670687ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981021568:12345-0@lo:41: 00000004:00000024:2.0:1788540983.242536:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788540983.242590:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670687ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981021568:12345-0@lo:41: Request processed in 88us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540983.242597:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788540983.242683:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981021568:0@lo:41: 00010000:00010000:0.0:1788540983.754706:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788540984.778169:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670687a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981021696:0@lo:13: 00000100:00100000:3.0:1788540984.778243:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540984.778443:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706879180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875420981022208:0@lo:400: 00000100:00100000:1.0:1788540984.778474:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540984.778492:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706878e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981022720:0@lo:400: 00000100:00100000:1.0:1788540984.778513:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540984.778530:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670687aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981023232:0@lo:400: 00000100:00100000:1.0:1788540984.778549:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540984.778580:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788540984.778586:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706879c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981022080:0@lo:400: 00000100:00100000:1.0:1788540984.778608:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540984.778622:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706878380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875420981022592:0@lo:400: 00000100:00100000:1.0:1788540984.778640:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540984.778654:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875420981023104:0@lo:400: 00000100:00100000:1.0:1788540984.778699:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540984.778728:0:8973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981022720 00000100:00100000:1.0:1788540984.778735:0:8973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981022720 00000100:00100000:1.0:1788540984.778778:0:8973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981023232 00000100:00100000:1.0:1788540984.778781:0:8973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981023232 00000100:00100000:1.0:1788540984.778800:0:8973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788540984.778810:0:8973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981022720:12345-0@lo:400: 00000100:00100000:1.0:1788540984.778856:0:8973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981022720:12345-0@lo:400: Request processed in 48us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540984.778863:0:8973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788540984.778897:0:8973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788540984.778905:0:8973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981023232:12345-0@lo:400: 00000100:00100000:1.0:1788540984.778935:0:8973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981023232:12345-0@lo:400: Request processed in 31us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540984.778941:0:8973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788540984.778960:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981022208 00000100:00100000:0.0:1788540984.778966:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981022208 00010000:00080000:1.0:1788540984.778980:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6706878e00 x1875420981022720/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540984.778995:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706878e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981022720:0@lo:400: 00010000:00080000:1.0:1788540984.779005:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670687aa00 x1875420981023232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540984.779026:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670687aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981023232:0@lo:400: 00000100:00100000:1.0:1788540984.779055:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981022592 00000100:00100000:1.0:1788540984.779059:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981022592 00000100:00100000:0.0:1788540984.779077:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981023104 00000100:00100000:0.0:1788540984.779082:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981023104 00000100:00100000:1.0:1788540984.779086:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788540984.779096:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875420981022208:12345-0@lo:400: 00000100:00100000:0.0:1788540984.779113:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788540984.779123:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875420981022592:12345-0@lo:400: 00000100:00100000:1.0:1788540984.779136:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875420981022208:12345-0@lo:400: Request processed in 42us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540984.779144:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788540984.779160:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788540984.779168:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875420981023104:12345-0@lo:400: 00000100:00100000:0.0:1788540984.779171:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875420981022592:12345-0@lo:400: Request processed in 49us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540984.779180:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788540984.779204:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875420981023104:12345-0@lo:400: Request processed in 37us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540984.779212:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1788540984.779227:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6706878380 x1875420981022592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540984.779239:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706878380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875420981022592:0@lo:400: 00000100:00100000:2.0:1788540984.779423:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981021696 00000100:00100000:2.0:1788540984.779427:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981021696 00000100:00100000:2.0:1788540984.779467:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788540984.779474:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6837968380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981021696:12345-0@lo:13: 00002000:00000024:2.0:1788540984.779494:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788540984.779527:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6837968380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981021696:12345-0@lo:13: Request processed in 54us (1286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540984.779534:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788540984.779553:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670687b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875420981021952:0@lo:400: 00000100:00100000:2.0:1788540984.779578:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540984.779596:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670687a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875420981022464:0@lo:400: 00010000:00080000:0.0:1788540984.779615:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6706878700 x1875420981023104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788540984.779622:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540984.779633:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875420981023104:0@lo:400: 00000100:00100000:2.0:1788540984.779646:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706879500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875420981022976:0@lo:400: 00000100:00100000:0.0:1788540984.779651:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706879180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875420981022208:0@lo:400: 00010000:00080000:0.0:1788540984.779696:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670687a300 x1875420981021696/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541000 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540984.779710:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670687a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981021696:0@lo:13: 00000100:00080000:0.0:1788540984.779756:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788540984.779761:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788540984.779764:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788540984.779773:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981021952 00000100:00100000:0.0:1788540984.779777:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981021952 00000100:00100000:2.0:1788540984.779792:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540984.779802:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981022464 00000100:00100000:0.0:1788540984.779807:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981022464 00000100:00100000:2.0:1788540984.779814:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1788540984.779824:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706879f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420981021824:0@lo:400: 00000100:00100000:0.0:1788540984.779828:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981022976 00000100:00100000:0.0:1788540984.779832:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981022976 00000100:00100000:0.0:1788540984.779853:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788540984.779858:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540984.779864:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875420981021952:12345-0@lo:400: 00000100:00100000:2.0:1788540984.779910:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706878a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981022336:0@lo:400: 00000100:00100000:0.0:1788540984.779931:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875420981021952:12345-0@lo:400: Request processed in 69us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540984.779942:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788540984.779945:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540984.779962:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788540984.779970:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670687b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981022848:0@lo:400: 00000100:00100000:2.0:1788540984.779993:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540984.780008:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981023360:0@lo:13: 00000100:00100000:2.0:1788540984.780031:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540984.780052:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670687b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875420981021952:0@lo:400: 00000100:00100000:2.0:1788540984.780073:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981021824 00000100:00100000:2.0:1788540984.780076:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981021824 00000100:00100000:2.0:1788540984.780103:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788540984.780110:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e78b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+24:3642:x1875420981021824:12345-0@lo:400: 00000100:00100000:2.0:1788540984.780142:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e78b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+24:3642:x1875420981021824:12345-0@lo:400: Request processed in 32us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540984.780148:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788540984.780177:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981022080 00000100:00100000:2.0:1788540984.780181:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981022080 00000100:00100000:2.0:1788540984.780197:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981022336 00000100:00100000:2.0:1788540984.780200:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981022336 00000100:00100000:0.0:1788540984.780203:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875420981022464:12345-0@lo:400: 00000100:00100000:2.0:1788540984.780214:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788540984.780223:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981022080:12345-0@lo:400: 00000100:00100000:0.0:1788540984.780259:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875420981022464:12345-0@lo:400: Request processed in 289us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540984.780266:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788540984.780282:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788540984.780289:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875420981022976:12345-0@lo:400: 00000100:00100000:1.0:1788540984.780348:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981023360 00000100:00100000:1.0:1788540984.780352:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981023360 00000100:00100000:1.0:1788540984.780370:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788540984.780376:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706831c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981023360:12345-0@lo:13: 00002000:00000024:1.0:1788540984.780386:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788540984.780438:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981022080:12345-0@lo:400: Request processed in 217us (1829us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540984.780454:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788540984.780467:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788540984.780473:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981022336:12345-0@lo:400: 00000100:00100000:2.0:1788540984.780500:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981022336:12345-0@lo:400: Request processed in 27us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540984.780505:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00010000:2.0:1788540984.780552:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788540984.780568:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706879f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420981021824:0@lo:400: 00000100:00100000:2.0:1788540984.780577:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706878a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981022336:0@lo:400: 00000100:00100000:2.0:1788540984.780587:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670687a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875420981022464:0@lo:400: 00000100:00100000:3.0:1788540984.780627:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981022848 00000100:00100000:3.0:1788540984.780631:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981022848 00000100:00100000:3.0:1788540984.780657:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788540984.780689:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706832680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981022848:12345-0@lo:400: 00000100:00100000:3.0:1788540984.780727:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706832680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981022848:12345-0@lo:400: Request processed in 47us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540984.780734:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788540984.781106:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875420981022976:12345-0@lo:400: Request processed in 816us (1314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540984.781113:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1788540984.781147:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788540984.781151:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788540984.781184:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706879c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981022080:0@lo:400: 00010000:00080000:2.0:1788540984.781206:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670687b480 x1875420981022848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788540984.781218:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670687b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981022848:0@lo:400: 00000100:00100000:2.0:1788540984.781232:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706879500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875420981022976:0@lo:400: 00000100:00100000:1.0:1788540984.782172:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706831c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981023360:12345-0@lo:13: Request processed in 1790us (2134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540984.782183:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1788540984.782294:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6706833480 x1875420981023360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541000 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788540984.782315:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981023360:0@lo:13: 00000100:00100000:2.0:1788540985.039282:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788540985.039616:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955807232 00000100:00100000:3.0:1788540985.039627:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955807232 00000100:00100000:3.0:1788540985.039724:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 15 00000100:00100000:3.0:1788540985.039734:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+7:6249:x1875420955807232:12345-192.168.202.56@tcp:41: 00000004:00000024:3.0:1788540985.039773:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1788540985.039851:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+7:6249:x1875420955807232:12345-192.168.202.56@tcp:41: Request processed in 117us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540985.039858:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 15 00000100:00080000:0.0:1788540985.040507:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788540985.043533:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788540985.043636:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955807360 00000100:00100000:0.0:1788540985.043647:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955807360 00000100:00100000:0.0:1788540985.043739:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 16 00000100:00100000:0.0:1788540985.043750:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+6:6249:x1875420955807360:12345-192.168.202.56@tcp:41: 00000004:00000024:0.0:1788540985.043799:0:9339:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788540985.043863:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+6:6249:x1875420955807360:12345-192.168.202.56@tcp:41: Request processed in 115us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540985.043903:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 16 00000100:00080000:2.0:1788540985.043965:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788540985.050006:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788540985.050287:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955807488 00000100:00100000:2.0:1788540985.050297:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955807488 00000100:00100000:2.0:1788540985.050376:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 20 00000100:00100000:2.0:1788540985.050387:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:384f52e3-0481-4979-9299-157aff7472d2+6:6249:x1875420955807488:12345-192.168.202.56@tcp:13: 00002000:00000024:2.0:1788540985.050433:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788540985.050500:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:384f52e3-0481-4979-9299-157aff7472d2+6:6249:x1875420955807488:12345-192.168.202.56@tcp:13: Request processed in 114us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540985.050506:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 20 00000100:00080000:0.0:1788540985.052482:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788540985.055381:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788540985.055834:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955807616 00000100:00100000:2.0:1788540985.055844:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955807616 00000100:00100000:2.0:1788540985.055945:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 21 00000100:00100000:2.0:1788540985.055954:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6837968e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:384f52e3-0481-4979-9299-157aff7472d2+6:6249:x1875420955807616:12345-192.168.202.56@tcp:13: 00002000:00000024:2.0:1788540985.056007:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788540985.056082:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6837968e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:384f52e3-0481-4979-9299-157aff7472d2+6:6249:x1875420955807616:12345-192.168.202.56@tcp:13: Request processed in 129us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540985.056090:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 21 00000100:00080000:0.0:1788540985.056358:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788540985.804945:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788540985.815112:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 384f52e3-0481-4979-9299-157aff7472d2 00000001:00100000:0.0:1788540986.828911:0:6496:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 384f52e3-0481-4979-9299-157aff7472d2 00010000:00010000:0.0:1788540986.829242:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788540986.830592:0:7448:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 384f52e3-0481-4979-9299-157aff7472d2 00000100:00100000:0.0:1788540987.685570:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788540987.685619:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788540987.685649:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788540987.685701:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788540987.685727:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788540987.685766:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955808000 00000100:00100000:0.0:1788540987.685781:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955808000 00000100:00100000:0.0:1788540987.685857:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955807872 00000100:00100000:0.0:1788540987.685860:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955807872 00000100:00100000:0.0:1788540987.685910:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 55 00000100:00100000:0.0:1788540987.685923:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+5:2394:x1875420955808000:12345-192.168.202.56@tcp:400: 00000100:00100000:0.0:1788540987.686084:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+5:2394:x1875420955808000:12345-192.168.202.56@tcp:400: Request processed in 164us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540987.686092:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 55 00000100:00100000:0.0:1788540987.686111:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 56 00000100:00100000:0.0:1788540987.686117:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+6:2394:x1875420955807872:12345-192.168.202.56@tcp:400: 00000100:00100000:0.0:1788540987.686138:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+6:2394:x1875420955807872:12345-192.168.202.56@tcp:400: Request processed in 22us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540987.686144:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 56 00000100:00100000:0.0:1788540987.686165:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955808256 00000100:00100000:0.0:1788540987.686168:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955808256 00000100:00100000:0.0:1788540987.686194:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955808128 00000100:00100000:0.0:1788540987.686197:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955808128 00000100:00100000:0.0:1788540987.686218:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 13 00000100:00100000:0.0:1788540987.686224:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:384f52e3-0481-4979-9299-157aff7472d2+5:2394:x1875420955808256:12345-192.168.202.56@tcp:400: 00000100:00100000:0.0:1788540987.686247:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:384f52e3-0481-4979-9299-157aff7472d2+5:2394:x1875420955808256:12345-192.168.202.56@tcp:400: Request processed in 24us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540987.686254:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 13 00000100:00100000:0.0:1788540987.686263:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 14 00000100:00100000:0.0:1788540987.686268:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:384f52e3-0481-4979-9299-157aff7472d2+6:2394:x1875420955808128:12345-192.168.202.56@tcp:400: 00000100:00100000:0.0:1788540987.686285:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:384f52e3-0481-4979-9299-157aff7472d2+6:2394:x1875420955808128:12345-192.168.202.56@tcp:400: Request processed in 17us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540987.686291:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 14 00000100:00080000:0.0:1788540987.686304:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788540987.686308:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788540987.686311:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788540987.686319:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788540987.686864:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955807744 00000100:00100000:2.0:1788540987.686908:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955807744 00000100:00100000:2.0:1788540987.687356:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 198 00000100:00100000:2.0:1788540987.687367:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e78b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+10:2394:x1875420955807744:12345-192.168.202.56@tcp:400: 00000100:00100000:2.0:1788540987.687442:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e78b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+10:2394:x1875420955807744:12345-192.168.202.56@tcp:400: Request processed in 78us (1887us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540987.687450:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 198 00010000:00010000:2.0:1788540987.850449:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788540987.850720:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788540987.850751:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981023616:0@lo:41: 00000100:00100000:0.0:1788540987.850848:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540987.851065:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683796b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981023488:0@lo:13: 00000100:00100000:2.0:1788540987.851104:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540987.851197:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981023616 00000100:00100000:2.0:1788540987.851207:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981023616 00000100:00100000:2.0:1788540987.851270:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788540987.851292:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981023616:12345-0@lo:41: 00000004:00000024:2.0:1788540987.851338:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788540987.851394:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981023616:12345-0@lo:41: Request processed in 104us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540987.851402:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788540987.851466:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981023616:0@lo:41: 00000100:00100000:1.0:1788540987.852163:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981023744:0@lo:13: 00000100:00100000:1.0:1788540987.852213:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:2.0:1788540987.858398:0:8426:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 384f52e3-0481-4979-9299-157aff7472d2 00000100:00100000:3.0:1788540987.859372:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981023488 00000100:00100000:3.0:1788540987.859389:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981023488 00000100:00100000:3.0:1788540987.859481:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981023744 00000100:00100000:3.0:1788540987.859485:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981023744 00000100:00100000:3.0:1788540987.859511:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788540987.859523:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f0fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981023488:12345-0@lo:13: 00002000:00000024:3.0:1788540987.859567:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788540987.859716:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f0fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981023488:12345-0@lo:13: Request processed in 195us (8609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540987.859724:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788540987.859742:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788540987.859749:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981023744:12345-0@lo:13: 00002000:00000024:3.0:1788540987.859760:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788540987.859795:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981023744:12345-0@lo:13: Request processed in 46us (7581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540987.859801:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1788540987.859941:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a683796b480 x1875420981023488/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541003 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788540987.859967:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683796b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981023488:0@lo:13: 00000100:00080000:1.0:1788540987.860064:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788540987.860097:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707a31c00 x1875420981023744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541003 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540987.860112:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981023744:0@lo:13: 00000001:02000400:1.0:1788540988.071411:0:10182:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1788540988.363967:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981023872:0@lo:41: 00000100:00100000:3.0:1788540988.364139:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540988.369808:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981023872 00000100:00100000:2.0:1788540988.369825:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981023872 00000100:00100000:2.0:1788540988.370025:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788540988.370048:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6837969500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981023872:12345-0@lo:41: 00000004:00000024:2.0:1788540988.370090:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788540988.370179:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6837969500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981023872:12345-0@lo:41: Request processed in 144us (6040us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540988.370186:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788540988.370255:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981023872:0@lo:41: 00010000:00010000:2.0:1788540988.874749:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788540989.902606:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788540989.902641:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981024000:0@lo:13: 00000100:00100000:0.0:1788540989.902730:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540989.903008:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981024128:0@lo:13: 00000100:00100000:0.0:1788540989.903039:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540989.903077:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981024000 00000100:00100000:0.0:1788540989.903084:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981024000 00000100:00100000:0.0:1788540989.903128:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981024128 00000100:00100000:0.0:1788540989.903132:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981024128 00000100:00100000:0.0:1788540989.903152:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788540989.903161:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6805674e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981024000:12345-0@lo:13: 00002000:00000024:0.0:1788540989.903193:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788540989.903240:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6805674e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981024000:12345-0@lo:13: Request processed in 80us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540989.903247:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788540989.903265:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788540989.903272:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981024128:12345-0@lo:13: 00002000:00000024:0.0:1788540989.903281:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788540989.903310:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981024128:12345-0@lo:13: Request processed in 38us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540989.903316:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1788540989.903349:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68355b5880 x1875420981024128/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541005 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540989.903368:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981024128:0@lo:13: 00010000:00080000:0.0:1788540989.903404:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707a31c00 x1875420981024000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541005 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540989.903415:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981024000:0@lo:13: 00000100:00080000:1.0:1788540989.903858:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788540989.911709:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683796b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:425687b6-1d99-41d2-88d8-2fb230997596:3644:1875420981024256:0@lo:400: 00000100:00100000:3.0:1788540989.911823:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6837968a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875420981024384:0@lo:400: 00000100:00100000:1.0:1788540989.912575:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540989.912678:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981024768:0@lo:400: 00000100:00100000:1.0:1788540989.912710:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540989.912784:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981025280:0@lo:400: 00000100:00100000:1.0:1788540989.912812:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540989.912843:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788540989.912850:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875420981024640:0@lo:400: 00000100:00100000:1.0:1788540989.912901:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540989.912923:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981025152:0@lo:400: 00000100:00100000:1.0:1788540989.912947:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540989.912978:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981025280 00000100:00100000:1.0:1788540989.912985:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981025280 00000100:00100000:1.0:1788540989.913036:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981025152 00000100:00100000:1.0:1788540989.913040:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981025152 00000100:00100000:1.0:1788540989.913064:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788540989.913074:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981025280:12345-0@lo:400: 00000100:00100000:1.0:1788540989.913130:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981025280:12345-0@lo:400: Request processed in 57us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540989.913138:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788540989.913156:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788540989.913174:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981025152:12345-0@lo:400: 00000100:00100000:1.0:1788540989.913206:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981025152:12345-0@lo:400: Request processed in 32us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540989.913212:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788540989.913231:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981024640 00000100:00100000:1.0:1788540989.913235:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981024640 00000100:00100000:1.0:1788540989.913262:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788540989.913269:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875420981024640:12345-0@lo:400: 00000100:00100000:1.0:1788540989.913301:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875420981024640:12345-0@lo:400: Request processed in 33us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540989.913307:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1788540989.913327:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788540989.913362:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875420981024640:0@lo:400: 00010000:00080000:1.0:1788540989.913376:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67079e0700 x1875420981025152/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541005 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540989.913386:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981025152:0@lo:400: 00010000:00080000:1.0:1788540989.913395:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67079e2a00 x1875420981025280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541005 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788540989.913402:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981025280:0@lo:400: 00000100:00100000:2.0:1788540989.913736:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981024256 00000100:00100000:2.0:1788540989.913741:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981024256 00000100:00100000:2.0:1788540989.913782:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788540989.913790:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e789450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+24:3644:x1875420981024256:12345-0@lo:400: 00000100:00100000:2.0:1788540989.913833:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e789450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+24:3644:x1875420981024256:12345-0@lo:400: Request processed in 44us (1260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540989.913839:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788540989.913898:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683796b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:425687b6-1d99-41d2-88d8-2fb230997596:3644:1875420981024256:0@lo:400: 00000100:00100000:3.0:1788540989.914018:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540989.914058:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875420981024896:0@lo:400: 00000100:00100000:3.0:1788540989.914085:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540989.914106:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875420981025408:0@lo:400: 00000100:00100000:3.0:1788540989.914128:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540989.914150:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788540989.914156:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981024512:0@lo:400: 00000100:00100000:3.0:1788540989.914179:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540989.914316:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981024384 00000100:00100000:2.0:1788540989.914321:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981024384 00000100:00100000:2.0:1788540989.914352:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981024896 00000100:00100000:2.0:1788540989.914356:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981024896 00000100:00100000:2.0:1788540989.914375:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981025408 00000100:00100000:2.0:1788540989.914377:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981025408 00000100:00100000:2.0:1788540989.914391:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788540989.914397:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875420981024384:12345-0@lo:400: 00000100:00100000:2.0:1788540989.914440:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875420981024384:12345-0@lo:400: Request processed in 43us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540989.914447:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788540989.914459:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788540989.914476:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875420981024896:12345-0@lo:400: 00000100:00100000:2.0:1788540989.914504:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875420981024896:12345-0@lo:400: Request processed in 40us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540989.914510:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788540989.914521:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788540989.914527:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875420981025408:12345-0@lo:400: 00000100:00100000:2.0:1788540989.914550:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875420981025408:12345-0@lo:400: Request processed in 24us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540989.914555:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1788540989.914569:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788540989.914997:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875420981025024:0@lo:400: 00000100:00100000:3.0:1788540989.915025:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540989.915041:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875420981025536:0@lo:400: 00000100:00100000:3.0:1788540989.915061:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540989.915101:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6837968a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875420981024384:0@lo:400: 00000100:00100000:3.0:1788540989.915112:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875420981024896:0@lo:400: 00000100:00100000:3.0:1788540989.915121:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875420981025408:0@lo:400: 00000100:00100000:3.0:1788540989.915153:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981025024 00000100:00100000:3.0:1788540989.915156:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981025024 00000100:00100000:3.0:1788540989.915186:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981025536 00000100:00100000:3.0:1788540989.915189:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981025536 00000100:00100000:3.0:1788540989.915204:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788540989.915210:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875420981025024:12345-0@lo:400: 00000100:00100000:3.0:1788540989.915248:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875420981025024:12345-0@lo:400: Request processed in 38us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540989.915254:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788540989.915266:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788540989.915272:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875420981025536:12345-0@lo:400: 00000100:00100000:3.0:1788540989.915298:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875420981025536:12345-0@lo:400: Request processed in 26us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540989.915303:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:3.0:1788540989.915334:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67079e1500 x1875420981025024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541005 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540989.915344:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875420981025024:0@lo:400: 00010000:00080000:3.0:1788540989.915353:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67079e1880 x1875420981025536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541005 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540989.915360:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875420981025536:0@lo:400: 00000100:00080000:3.0:1788540989.915383:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788540989.917618:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981024768 00000100:00100000:0.0:1788540989.917641:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981024768 00000100:00100000:0.0:1788540989.917689:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981024512 00000100:00100000:0.0:1788540989.917693:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981024512 00000100:00100000:0.0:1788540989.917712:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788540989.917722:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981024768:12345-0@lo:400: 00000100:00100000:0.0:1788540989.917821:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981024768:12345-0@lo:400: Request processed in 101us (5109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540989.917828:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788540989.917843:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788540989.917848:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981024512:12345-0@lo:400: 00000100:00100000:0.0:1788540989.917897:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981024512:12345-0@lo:400: Request processed in 48us (3716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540989.917903:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788540989.917947:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981024512:0@lo:400: 00000100:00100000:2.0:1788540989.925978:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981024768:0@lo:400: 00010000:00010000:2.0:1788540990.925055:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540991.947340:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788540991.970265:0:10330:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcdb211e90 20000000:00000080:1.0:1788540991.970283:0:10330:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a68378c4400 uarg=0000000000000000 20000000:01000000:1.0:1788540991.970379:0:10330:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1788540991.970382:0:10330:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1788540991.970385:0:10330:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788540991.970390:0:10330:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788540991.970395:0:10330:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1788540991.970459:0:10330:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788540991.970462:0:10330:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788540991.971260:0:10331:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:1.0:1788540991.971683:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:1.0:1788540991.971718:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:1.0:1788540991.971735:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:1.0:1788540991.971747:0:10330:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788540991.971750:0:10330:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788540991.972595:0:10332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:0.0:1788540991.973551:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:0.0:1788540991.973595:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:0.0:1788540991.973627:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:0.0:1788540991.973640:0:10330:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1788540991.973642:0:10330:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788540991.974408:0:10333:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:0.0:1788540991.974642:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:0.0:1788540991.974669:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:0.0:1788540991.974687:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:0.0:1788540991.974697:0:10330:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788540991.974708:0:10330:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788540991.975663:0:10334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:0.0:1788540991.975854:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:0.0:1788540991.976356:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:0.0:1788540991.976379:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:0.0:1788540991.976391:0:10330:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788540991.976393:0:10330:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788540991.976733:0:10335:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:0.0:1788540991.977026:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:0.0:1788540991.977048:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:0.0:1788540991.977298:0:10330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 10000000:01000000:0.0:1788540991.977316:0:10330:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788540991.977337:0:10330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a682e75ee00/0x2aac941e5f4a76c5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540991.977357:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a68354db600/0x2aac941e5f4a7560 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a7559 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540991.977365:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a683551b400/0x2aac941e5f4a758a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a7583 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540991.977371:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a75c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a75c2 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540991.977377:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a682e75fe00/0x2aac941e5f4a75d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a75d0 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540991.977384:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a682e75f200/0x2aac941e5f4a75e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a75de expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540991.977391:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a682e75f400/0x2aac941e5f4a7601 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a75fa expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540991.977397:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a682e75e400/0x2aac941e5f4a762b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a7624 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540991.977414:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6842173400/0x2aac941e5f4a7647 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a7640 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540991.977421:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a683551ba00/0x2aac941e5f4a766a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a7663 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540991.977430:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6812045400/0x2aac941e5f4a767f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33107e expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540991.977438:0:10330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a683551b000/0x2aac941e5f4a7686 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331085 expref: 9 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540991.977445:0:10330:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a682e75ee00/0x2aac941e5f4a76c5 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540991.977489:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a683551b000/0x2aac941e5f4a7686 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331085 expref: 9 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540991.977504:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a683551b000/0x2aac941e5f4a7686 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331085 expref: 9 pid: 6509 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540991.977518:0:10330:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1875420981025664:192.168.202.56@tcp:104: 00010000:00010000:0.0:1788540991.977681:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6812045400/0x2aac941e5f4a767f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33107e expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540991.977690:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6812045400/0x2aac941e5f4a767f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33107e expref: 9 pid: 6511 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540991.977698:0:10330:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1875420981025792:192.168.202.56@tcp:104: 00010000:00010000:0.0:1788540991.977737:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a683551ba00/0x2aac941e5f4a766a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a7663 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540991.977746:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a683551ba00/0x2aac941e5f4a766a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a7663 expref: 23 pid: 6512 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540991.977755:0:10330:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1875420981025920:0@lo:104: 00000100:00100000:0.0:1788540991.977796:0:10330:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788540991.977838:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6842173400/0x2aac941e5f4a7647 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a7640 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540991.977847:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6842173400/0x2aac941e5f4a7647 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a7640 expref: 23 pid: 6509 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540991.977855:0:10330:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1875420981026048:0@lo:104: 00000100:00100000:0.0:1788540991.977912:0:10330:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788540991.977939:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a682e75e400/0x2aac941e5f4a762b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a7624 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540991.977948:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a682e75e400/0x2aac941e5f4a762b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a7624 expref: 23 pid: 6509 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540991.977956:0:10330:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a31c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1875420981026176:0@lo:104: 00000100:00100000:0.0:1788540991.977992:0:10330:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788540991.978014:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a682e75f400/0x2aac941e5f4a7601 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a75fa expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540991.978021:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a682e75f400/0x2aac941e5f4a7601 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a75fa expref: 23 pid: 6512 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540991.978041:0:10330:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ed180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1875420981026304:0@lo:104: 00000100:00100000:0.0:1788540991.978085:0:10330:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788540991.978105:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a682e75f200/0x2aac941e5f4a75e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a75de expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540991.978112:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a682e75f200/0x2aac941e5f4a75e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a75de expref: 23 pid: 6512 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540991.978120:0:10330:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078eca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1875420981026432:0@lo:104: 00010000:00010000:0.0:1788540991.978154:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a682e75fe00/0x2aac941e5f4a75d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a75d0 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540991.978274:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788540991.978293:0:6501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540991.978305:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981025920 00000100:00100000:2.0:1788540991.978315:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981025920 00000100:00100000:2.0:1788540991.978353:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981026048 00000100:00100000:2.0:1788540991.978356:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981026048 00000100:00100000:2.0:1788540991.978364:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981026176 00000100:00100000:2.0:1788540991.978366:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981026176 00000100:00100000:2.0:1788540991.978373:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981026304 00000100:00100000:2.0:1788540991.978376:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981026304 00000100:00100000:2.0:1788540991.978383:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981026432 00000100:00100000:2.0:1788540991.978385:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981026432 00000100:00100000:2.0:1788540991.978396:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788540991.978405:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+7:10330:x1875420981025920:12345-0@lo:104: 00010000:00010000:2.0:1788540991.978417:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a683551b800/0x2aac941e5f4a7663 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a766a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.978468:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788540991.978473:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+7:10330:x1875420981025920:12345-0@lo:104: Request processed in 70us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540991.978480:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788540991.978496:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788540991.978501:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+6:10330:x1875420981026048:12345-0@lo:104: 00010000:00010000:2.0:1788540991.978508:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a6842173800/0x2aac941e5f4a7640 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a7647 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.978551:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788540991.978556:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+6:10330:x1875420981026048:12345-0@lo:104: Request processed in 55us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540991.978562:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788540991.978575:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788540991.978581:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+5:10330:x1875420981026176:12345-0@lo:104: 00010000:00010000:2.0:1788540991.978588:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a682e75e600/0x2aac941e5f4a7624 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a762b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.978626:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788540991.978632:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+5:10330:x1875420981026176:12345-0@lo:104: Request processed in 52us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540991.978637:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788540991.978649:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788540991.978655:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706964c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+4:10330:x1875420981026304:12345-0@lo:104: 00010000:00010000:2.0:1788540991.978663:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a682e75ec00/0x2aac941e5f4a75fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a7601 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.978688:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788540991.978693:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706964c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+4:10330:x1875420981026304:12345-0@lo:104: Request processed in 39us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540991.978698:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788540991.978728:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788540991.978735:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670772a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+3:10330:x1875420981026432:12345-0@lo:104: 00010000:00010000:2.0:1788540991.978743:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a683551a600/0x2aac941e5f4a75de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a75e5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.978778:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788540991.978783:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670772a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+3:10330:x1875420981026432:12345-0@lo:104: Request processed in 49us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540991.978789:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:2.0:1788540991.978808:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788540991.978815:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a683551b800/0x2aac941e5f4a7663 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a766a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.978821:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551b800 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:2.0:1788540991.978825:0:8446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a683551b800/0x2aac941e5f4a7663 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a766a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.978833:0:8446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a683551b800/0x2aac941e5f4a7663 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a766a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788540991.978839:0:8446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a683551b800/0x2aac941e5f4a7663 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a766a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788540991.978844:0:8446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788540991.978890:0:8446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a683551b800/0x2aac941e5f4a7663 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a766a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.978896:0:8446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788540991.978915:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a683551b800/0x2aac941e5f4a7663 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a766a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.978922:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a683551b800/0x2aac941e5f4a7663 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a766a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.978946:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788540991.978949:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a6842173800/0x2aac941e5f4a7640 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a7647 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.978955:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842173800 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:2.0:1788540991.978958:0:8446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a6842173800/0x2aac941e5f4a7640 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a7647 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.978965:0:8446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a6842173800/0x2aac941e5f4a7640 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a7647 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788540991.978970:0:8446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a6842173800/0x2aac941e5f4a7640 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a7647 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788540991.978975:0:8446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788540991.978989:0:8446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a6842173800/0x2aac941e5f4a7640 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7647 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.978994:0:8446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788540991.979000:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a6842173800/0x2aac941e5f4a7640 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7647 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.979006:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a6842173800/0x2aac941e5f4a7640 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7647 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.979016:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788540991.979018:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a682e75e600/0x2aac941e5f4a7624 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a762b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.979034:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75e600 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:2.0:1788540991.979037:0:8446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a682e75e600/0x2aac941e5f4a7624 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a762b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.979047:0:8446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a682e75e600/0x2aac941e5f4a7624 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a762b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788540991.979053:0:8446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a682e75e600/0x2aac941e5f4a7624 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a762b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788540991.979058:0:8446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788540991.979071:0:8446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a682e75e600/0x2aac941e5f4a7624 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a762b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.979077:0:8446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788540991.979092:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a682e75e600/0x2aac941e5f4a7624 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a762b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.979099:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a682e75e600/0x2aac941e5f4a7624 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a762b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.979108:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788540991.979111:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a682e75ec00/0x2aac941e5f4a75fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a7601 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.979117:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75ec00 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:2.0:1788540991.979119:0:8446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a682e75ec00/0x2aac941e5f4a75fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a7601 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.979137:0:8446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a682e75ec00/0x2aac941e5f4a75fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a7601 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788540991.979143:0:8446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a682e75ec00/0x2aac941e5f4a75fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a7601 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788540991.979148:0:8446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788540991.979233:0:8446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a682e75ec00/0x2aac941e5f4a75fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7601 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.979240:0:8446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788540991.979246:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a682e75ec00/0x2aac941e5f4a75fa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7601 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.979252:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a682e75ec00/0x2aac941e5f4a75fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7601 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.979262:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788540991.979265:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a683551a600/0x2aac941e5f4a75de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a75e5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.979270:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551a600 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:2.0:1788540991.979273:0:8446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a683551a600/0x2aac941e5f4a75de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a75e5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.979280:0:8446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a683551a600/0x2aac941e5f4a75de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a75e5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788540991.979286:0:8446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a683551a600/0x2aac941e5f4a75de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a75e5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788540991.979298:0:8446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788540991.979312:0:8446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a683551a600/0x2aac941e5f4a75de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a75e5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.979318:0:8446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788540991.979322:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a683551a600/0x2aac941e5f4a75de lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a75e5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.979328:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a683551a600/0x2aac941e5f4a75de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a75e5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.979337:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540991.979338:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540991.979340:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540991.979348:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540991.979353:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788540991.979371:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707728700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420981026688:0@lo:103: 00000100:00100000:2.0:1788540991.979405:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540991.979435:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670772bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420981027200:0@lo:103: 00000100:00100000:2.0:1788540991.979453:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540991.979474:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788540991.979479:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420981026816:0@lo:103: 00000100:00100000:2.0:1788540991.979498:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540991.979525:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670772ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420981026944:0@lo:103: 00000100:00100000:2.0:1788540991.979548:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540991.979564:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788540991.979569:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707729f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420981027072:0@lo:103: 00000100:00100000:2.0:1788540991.979598:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540991.979635:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981026688 00000100:00100000:2.0:1788540991.979640:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981026688 00010000:00010000:2.0:1788540991.979661:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a683551ba00/0x2aac941e5f4a766a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a7663 expref: 24 pid: 6512 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540991.979677:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981027200 00000100:00100000:2.0:1788540991.979679:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981027200 00010000:00010000:2.0:1788540991.979688:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a682e75f200/0x2aac941e5f4a75e5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a75de expref: 25 pid: 6512 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540991.979696:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981026816 00000100:00100000:2.0:1788540991.979698:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981026816 00010000:00010000:2.0:1788540991.979706:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6842173400/0x2aac941e5f4a7647 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a7640 expref: 26 pid: 6509 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540991.979715:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981026944 00000100:00100000:2.0:1788540991.979718:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981026944 00010000:00010000:2.0:1788540991.979726:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a682e75e400/0x2aac941e5f4a762b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a7624 expref: 27 pid: 6509 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540991.979736:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981027072 00000100:00100000:2.0:1788540991.979738:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981027072 00010000:00010000:2.0:1788540991.979748:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a682e75f400/0x2aac941e5f4a7601 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a75fa expref: 28 pid: 6512 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540991.979759:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788540991.979765:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680763e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+28:3643:x1875420981026688:12345-0@lo:103: 00010000:00010000:2.0:1788540991.979775:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788540991.979779:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a683551ba00/0x2aac941e5f4a766a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a7663 expref: 28 pid: 6512 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540991.979847:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a682e75fe00/0x2aac941e5f4a75d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a75d0 expref: 28 pid: 6509 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540991.979858:0:10330:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ee680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1875420981026560:0@lo:104: 00000100:00100000:0.0:1788540991.979900:0:10330:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788540991.980044:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a683551ba00/0x2aac941e5f4a766a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a7663 expref: 28 pid: 6512 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.980063:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788540991.980104:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680763e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+28:3643:x1875420981026688:12345-0@lo:103: Request processed in 338us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540991.980111:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788540991.980147:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788540991.980274:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981026560 00000100:00100000:1.0:1788540991.980279:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981026560 00000100:00100000:1.0:1788540991.980303:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788540991.980309:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:425687b6-1d99-41d2-88d8-2fb230997596+3:10330:x1875420981026560:12345-0@lo:104: 00010000:00010000:1.0:1788540991.980319:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a682e75fc00/0x2aac941e5f4a75d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a75d7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540991.980359:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788540991.980364:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:425687b6-1d99-41d2-88d8-2fb230997596+3:10330:x1875420981026560:12345-0@lo:104: Request processed in 57us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540991.980369:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788540991.980418:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670772b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+27:3643:x1875420981027200:12345-0@lo:103: 00010000:00010000:2.0:1788540991.980428:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788540991.980434:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a682e75f200/0x2aac941e5f4a75e5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a75de expref: 27 pid: 6512 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.980443:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a682e75f200/0x2aac941e5f4a75e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a75de expref: 27 pid: 6512 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.980453:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788540991.980476:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670772b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+27:3643:x1875420981027200:12345-0@lo:103: Request processed in 322us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540991.980481:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788540991.980494:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788540991.980501:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670772b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+26:3643:x1875420981026816:12345-0@lo:103: 00010000:00010000:2.0:1788540991.980507:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788540991.980512:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6842173400/0x2aac941e5f4a7647 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a7640 expref: 26 pid: 6509 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.980522:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6842173400/0x2aac941e5f4a7647 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a7640 expref: 26 pid: 6509 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.980540:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788540991.980562:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670772b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+26:3643:x1875420981026816:12345-0@lo:103: Request processed in 63us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540991.980569:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788540991.980582:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788540991.980588:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707729880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+25:3641:x1875420981026944:12345-0@lo:103: 00010000:00010000:2.0:1788540991.980595:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788540991.980600:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a682e75e400/0x2aac941e5f4a762b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a7624 expref: 25 pid: 6509 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.980608:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a682e75e400/0x2aac941e5f4a762b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a7624 expref: 25 pid: 6509 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.980626:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788540991.980664:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707729880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+25:3641:x1875420981026944:12345-0@lo:103: Request processed in 76us (1115us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540991.980670:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788540991.980682:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788540991.980688:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706833100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+24:3641:x1875420981027072:12345-0@lo:103: 00010000:00010000:2.0:1788540991.980695:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788540991.980700:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a682e75f400/0x2aac941e5f4a7601 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a75fa expref: 24 pid: 6512 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.980707:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a682e75f400/0x2aac941e5f4a7601 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a75fa expref: 24 pid: 6512 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.980715:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788540991.980742:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706833100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+24:3641:x1875420981027072:12345-0@lo:103: Request processed in 55us (1143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540991.980747:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788540991.980795:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420981026816:0@lo:103: 00000100:00100000:2.0:1788540991.980805:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707728700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420981026688:0@lo:103: 00000100:00100000:2.0:1788540991.980811:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670772bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420981027200:0@lo:103: 00010000:00010000:2.0:1788540991.980833:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788540991.980838:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a682e75fc00/0x2aac941e5f4a75d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a75d7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.980845:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75fc00 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:2.0:1788540991.980848:0:8446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a682e75fc00/0x2aac941e5f4a75d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a75d7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.980855:0:8446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a682e75fc00/0x2aac941e5f4a75d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a75d7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788540991.980861:0:8446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a682e75fc00/0x2aac941e5f4a75d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a75d7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788540991.980866:0:8446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788540991.980921:0:8446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a682e75fc00/0x2aac941e5f4a75d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a75d7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.980927:0:8446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788540991.980938:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a682e75fc00/0x2aac941e5f4a75d0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a75d7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.980946:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a682e75fc00/0x2aac941e5f4a75d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a75d7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.980965:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540991.980966:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540991.980968:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788540991.980979:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:425687b6-1d99-41d2-88d8-2fb230997596:3644:1875420981027328:0@lo:103: 00000100:00100000:2.0:1788540991.981005:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540991.981046:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981027328 00000100:00100000:2.0:1788540991.981050:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981027328 00010000:00010000:2.0:1788540991.981080:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a682e75fe00/0x2aac941e5f4a75d7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a75d0 expref: 24 pid: 6509 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540991.981099:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788540991.981105:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706832a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+24:3644:x1875420981027328:12345-0@lo:103: 00010000:00010000:2.0:1788540991.981112:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788540991.981116:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a682e75fe00/0x2aac941e5f4a75d7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a75d0 expref: 24 pid: 6509 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.981124:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a682e75fe00/0x2aac941e5f4a75d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a75d0 expref: 24 pid: 6509 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.981134:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788540991.981392:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707729f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420981027072:0@lo:103: 00000100:00100000:1.0:1788540991.981402:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670772ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420981026944:0@lo:103: 00000100:00100000:2.0:1788540991.981560:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706832a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+24:3644:x1875420981027328:12345-0@lo:103: Request processed in 454us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540991.981567:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788540991.981598:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:425687b6-1d99-41d2-88d8-2fb230997596:3644:1875420981027328:0@lo:103: 00010000:00010000:0.0:1788540991.984925:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a75c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a75c2 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540991.984941:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a75c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a75c2 expref: 23 pid: 6512 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540991.984953:0:10330:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ece00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1875420981027456:0@lo:104: 00000100:00100000:0.0:1788540991.985000:0:10330:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788540991.985042:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a683551b400/0x2aac941e5f4a758a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a7583 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540991.985182:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981027456 00000100:00100000:2.0:1788540991.985189:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981027456 00000100:00100000:2.0:1788540991.985230:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788540991.985242:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:425687b6-1d99-41d2-88d8-2fb230997596+3:10330:x1875420981027456:12345-0@lo:104: 00010000:00010000:2.0:1788540991.985253:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a6842172000/0x2aac941e5f4a75c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a75c9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.985291:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788540991.985294:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:425687b6-1d99-41d2-88d8-2fb230997596+3:10330:x1875420981027456:12345-0@lo:104: Request processed in 54us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540991.985299:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:2.0:1788540991.985315:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788540991.985319:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a6842172000/0x2aac941e5f4a75c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a75c9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.985324:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842172000 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:2.0:1788540991.985327:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a6842172000/0x2aac941e5f4a75c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a75c9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.985332:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a6842172000/0x2aac941e5f4a75c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a75c9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788540991.985336:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a6842172000/0x2aac941e5f4a75c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a75c9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788540991.985340:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788540991.985360:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a6842172000/0x2aac941e5f4a75c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a75c9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.985364:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788540991.985379:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a6842172000/0x2aac941e5f4a75c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a75c9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.985391:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a6842172000/0x2aac941e5f4a75c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a75c9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.985403:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540991.985405:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540991.985406:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788540991.985421:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788540991.985449:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420981027712:0@lo:103: 00000100:00100000:2.0:1788540991.985480:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540991.985512:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981027712 00000100:00100000:2.0:1788540991.985516:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981027712 00010000:00010000:2.0:1788540991.985532:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a75c9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a75c2 expref: 24 pid: 6512 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540991.985554:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788540991.985560:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670772ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:425687b6-1d99-41d2-88d8-2fb230997596+24:3642:x1875420981027712:12345-0@lo:103: 00010000:00010000:2.0:1788540991.985569:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788540991.985573:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a75c9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a75c2 expref: 24 pid: 6512 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540991.985942:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a683551b400/0x2aac941e5f4a758a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a7583 expref: 24 pid: 6509 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540991.985952:0:10330:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ed500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1875420981027584:0@lo:104: 00000100:00100000:0.0:1788540991.985981:0:10330:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540991.986330:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981027584 00000100:00100000:3.0:1788540991.986340:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981027584 00000100:00100000:3.0:1788540991.986363:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788540991.986368:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:425687b6-1d99-41d2-88d8-2fb230997596+3:10330:x1875420981027584:12345-0@lo:104: 00010000:00010000:3.0:1788540991.986376:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a68354db200/0x2aac941e5f4a7583 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a758a expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540991.986411:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788540991.986417:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:425687b6-1d99-41d2-88d8-2fb230997596+3:10330:x1875420981027584:12345-0@lo:104: Request processed in 49us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540991.986424:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:2.0:1788540991.986724:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a75c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a75c2 expref: 24 pid: 6512 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.986894:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788540991.986928:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670772ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:425687b6-1d99-41d2-88d8-2fb230997596+24:3642:x1875420981027712:12345-0@lo:103: Request processed in 1368us (1447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540991.986936:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788540991.987043:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420981027712:0@lo:103: 00010000:00010000:0.0:1788540991.987569:0:10330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a68354db600/0x2aac941e5f4a7560 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a7559 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540991.987582:0:10330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a68354db600/0x2aac941e5f4a7560 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a7559 expref: 23 pid: 6509 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540991.987594:0:10330:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078eea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1875420981027840:0@lo:104: 00000100:00100000:0.0:1788540991.987643:0:10330:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540991.987723:0:10330:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068dd180 going to sleep for 11 seconds 00000100:00100000:0.0:1788540991.987740:0:10330:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1875420981025664:192.168.202.56@tcp:104: 00000100:00100000:0.0:1788540991.987749:0:10330:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1875420981025792:192.168.202.56@tcp:104: 00010000:00010000:2.0:1788540991.987759:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788540991.987759:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a683551ba00/0x2aac941e5f4a766a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a7663 expref: 23 pid: 6512 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540991.987770:0:10330:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1875420981025920:0@lo:104: 00010000:00010000:2.0:1788540991.987773:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a68354db200/0x2aac941e5f4a7583 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a758a expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540991.987779:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6842173400/0x2aac941e5f4a7647 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a7640 expref: 22 pid: 6509 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.987780:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68354db200 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:2.0:1788540991.987784:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a68354db200/0x2aac941e5f4a7583 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a758a expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540991.987788:0:10330:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1875420981026048:0@lo:104: 00010000:00010000:0.0:1788540991.987796:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a682e75e400/0x2aac941e5f4a762b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a7624 expref: 21 pid: 6509 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.987807:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a68354db200/0x2aac941e5f4a7583 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a758a expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788540991.987815:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a68354db200/0x2aac941e5f4a7583 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a758a expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540991.987815:0:10330:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a31c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1875420981026176:0@lo:104: 10000000:01000000:2.0:1788540991.987821:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788540991.987827:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a682e75f400/0x2aac941e5f4a7601 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a75fa expref: 20 pid: 6512 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540991.987834:0:10330:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ed180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1875420981026304:0@lo:104: 00010000:00010000:0.0:1788540991.987844:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a682e75f200/0x2aac941e5f4a75e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a75de expref: 19 pid: 6512 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540991.987851:0:10330:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078eca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1875420981026432:0@lo:104: 00010000:00010000:2.0:1788540991.987854:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a68354db200/0x2aac941e5f4a7583 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a758a expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.987860:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788540991.987861:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a682e75fe00/0x2aac941e5f4a75d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a75d0 expref: 18 pid: 6509 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540991.987867:0:10330:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ee680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1875420981026560:0@lo:104: 00010000:00010000:2.0:1788540991.987898:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a68354db200/0x2aac941e5f4a7583 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a758a expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.987906:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a68354db200/0x2aac941e5f4a7583 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a758a expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.987918:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540991.987919:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540991.987921:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788540991.987928:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788540991.987939:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707729f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420981027968:0@lo:103: 00000100:00100000:2.0:1788540991.987968:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540991.987999:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981027968 00000100:00100000:2.0:1788540991.988010:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981027968 00010000:00010000:0.0:1788540991.988024:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a75c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a75c2 expref: 18 pid: 6512 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.988032:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a683551b400/0x2aac941e5f4a758a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a7583 expref: 17 pid: 6509 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540991.988032:0:10330:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ece00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1875420981027456:0@lo:104: 00000100:00100000:0.0:1788540991.988040:0:10330:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ed500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1875420981027584:0@lo:104: 00000100:00100000:2.0:1788540991.988065:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788540991.988074:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680763e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+17:3641:x1875420981027968:12345-0@lo:103: 00010000:00010000:2.0:1788540991.988085:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788540991.988090:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a683551b400/0x2aac941e5f4a758a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a7583 expref: 17 pid: 6509 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.988099:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a683551b400/0x2aac941e5f4a758a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a7583 expref: 17 pid: 6509 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.988110:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a683551b400/0x2aac941e5f4a758a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a7583 expref: 17 pid: 6509 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540991.988120:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788540991.988149:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680763e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+16:3641:x1875420981027968:12345-0@lo:103: Request processed in 77us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540991.988156:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788540991.988199:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707729f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420981027968:0@lo:103: 00000100:00100000:3.0:1788540991.988352:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981027840 00000100:00100000:3.0:1788540991.988357:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981027840 00000100:00100000:3.0:1788540991.988797:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788540991.988808:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:425687b6-1d99-41d2-88d8-2fb230997596+3:10330:x1875420981027840:12345-0@lo:104: 00010000:00010000:3.0:1788540991.988821:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a68354da800/0x2aac941e5f4a7559 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a7560 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540991.988969:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788540991.989537:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00010000:00010000:3.0:1788540991.989671:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788540991.989679:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:425687b6-1d99-41d2-88d8-2fb230997596+3:10330:x1875420981027840:12345-0@lo:104: Request processed in 874us (2035us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540991.989687:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:1.0:1788540991.989731:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788540991.989737:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a68354da800/0x2aac941e5f4a7559 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a7560 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540991.989744:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68354da800 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:1.0:1788540991.989748:0:8446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a68354da800/0x2aac941e5f4a7559 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a7560 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540991.989771:0:8446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a68354da800/0x2aac941e5f4a7559 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a7560 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788540991.989778:0:8446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a68354da800/0x2aac941e5f4a7559 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a7560 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788540991.989784:0:8446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788540991.989816:0:8446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a68354da800/0x2aac941e5f4a7559 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7560 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540991.989823:0:8446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788540991.989839:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a68354da800/0x2aac941e5f4a7559 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7560 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540991.989847:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a68354da800/0x2aac941e5f4a7559 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7560 expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540991.989866:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788540991.989883:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788540991.989885:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788540991.989949:0:10330:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078eea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10330:1875420981027840:0@lo:104: 00010000:00010000:0.0:1788540991.989998:0:10330:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a682e75ee00/0x2aac941e5f4a76c5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540992.000306:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955808512 00000100:00100000:0.0:1788540992.000322:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955808512 00010000:00010000:0.0:1788540992.000376:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6812045400/0x2aac941e5f4a767f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33107e expref: 10 pid: 6511 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540992.000455:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955808384 00000100:00100000:0.0:1788540992.000459:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955808384 00010000:00010000:0.0:1788540992.000474:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a683551b000/0x2aac941e5f4a7686 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331085 expref: 11 pid: 6509 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540992.000508:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 32 00000100:00100000:0.0:1788540992.000517:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de51b185-1fb8-4395-8428-f3d8fb602cc3+11:2396:x1875420955808512:12345-192.168.202.56@tcp:103: 00010000:00010000:0.0:1788540992.000532:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788540992.000538:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6812045400/0x2aac941e5f4a767f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33107e expref: 11 pid: 6511 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540992.000550:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6812045400/0x2aac941e5f4a767f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33107e expref: 11 pid: 6511 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540992.000569:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6812045400/0x2aac941e5f4a767f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33107e expref: 11 pid: 6511 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540992.000585:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788540992.000663:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de51b185-1fb8-4395-8428-f3d8fb602cc3+10:2396:x1875420955808512:12345-192.168.202.56@tcp:103: Request processed in 146us (11693us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540992.000671:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 32 00000100:00100000:0.0:1788540992.000690:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 33 00000100:00100000:0.0:1788540992.000696:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de51b185-1fb8-4395-8428-f3d8fb602cc3+9:2396:x1875420955808384:12345-192.168.202.56@tcp:103: 00010000:00010000:0.0:1788540992.000704:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788540992.000709:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a683551b000/0x2aac941e5f4a7686 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331085 expref: 9 pid: 6509 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540992.000731:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a683551b000/0x2aac941e5f4a7686 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331085 expref: 9 pid: 6509 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540992.000747:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a683551b000/0x2aac941e5f4a7686 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331085 expref: 9 pid: 6509 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540992.000756:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788540992.000775:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de51b185-1fb8-4395-8428-f3d8fb602cc3+8:2396:x1875420955808384:12345-192.168.202.56@tcp:103: Request processed in 79us (11241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540992.000780:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 33 00000100:00100000:3.0:1788540992.001312:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420981028096:0@lo:103: 00000100:00100000:3.0:1788540992.001358:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540992.001992:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981028096 00000100:00100000:0.0:1788540992.002002:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981028096 00010000:00010000:0.0:1788540992.002029:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a68354db600/0x2aac941e5f4a7560 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a7559 expref: 16 pid: 6509 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540992.002098:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788540992.002107:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:425687b6-1d99-41d2-88d8-2fb230997596+16:3643:x1875420981028096:12345-0@lo:103: 00010000:00010000:0.0:1788540992.002118:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788540992.002123:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a68354db600/0x2aac941e5f4a7560 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a7559 expref: 16 pid: 6509 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540992.002133:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a68354db600/0x2aac941e5f4a7560 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a7559 expref: 16 pid: 6509 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540992.002146:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a68354db600/0x2aac941e5f4a7560 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a7559 expref: 16 pid: 6509 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540992.002161:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a682e75ee00/0x2aac941e5f4a76c5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540992.002181:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a682e75ee00/0x2aac941e5f4a76c5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540992.002198:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a682e75ee00/0x2aac941e5f4a76c5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540992.002206:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a682e75ee00/0x2aac941e5f4a76c5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540992.002213:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a682e75ee00/0x2aac941e5f4a76c5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540992.002220:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a682e75ee00/0x2aac941e5f4a76c5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540992.002226:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75ee00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788540992.002230:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a682e75ee00/0x2aac941e5f4a76c5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540992.002239:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a682e75ee00/0x2aac941e5f4a76c5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540992.002265:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a682e75ee00/0x2aac941e5f4a76c5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540992.002277:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788540992.002322:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:425687b6-1d99-41d2-88d8-2fb230997596+15:3643:x1875420981028096:12345-0@lo:103: Request processed in 216us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540992.002330:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788540992.002410:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420981028096:0@lo:103: 00010000:00010000:3.0:1788540992.002457:0:10330:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a682e75ee00/0x2aac941e5f4a76c5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540992.002475:0:10330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a682e75ee00/0x2aac941e5f4a76c5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540992.002480:0:10330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a682e75ee00/0x2aac941e5f4a76c5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540992.147320:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788540992.147784:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955808640 00000100:00100000:0.0:1788540992.147803:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955808640 00000100:00100000:0.0:1788540992.147859:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 200 00000100:00100000:0.0:1788540992.147889:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e789c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+8:6168:x1875420955808640:12345-192.168.202.56@tcp:101: 00010000:00010000:0.0:1788540992.147909:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788540992.147929:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a682e75f600/0x2aac941e5f4a76cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16473202a3310f5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540992.147962:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a682e75f600/0x2aac941e5f4a76cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3310f5 expref: 9 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540992.147976:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a682e75f600/0x2aac941e5f4a76cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3310f5 expref: 9 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540992.147986:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75f600, rc 0) 00000100:00100000:0.0:1788540992.148051:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e789c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+9:6168:x1875420955808640:12345-192.168.202.56@tcp:101: Request processed in 182us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540992.148058:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 200 00000100:00100000:0.0:1788540992.150810:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788540992.150913:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955808768 00000100:00100000:1.0:1788540992.150923:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955808768 00000100:00100000:1.0:1788540992.150974:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 201 00000100:00100000:1.0:1788540992.150984:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+9:6168:x1875420955808768:12345-192.168.202.56@tcp:501: 00000100:00100000:1.0:1788540992.151148:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+9:6168:x1875420955808768:12345-192.168.202.56@tcp:501: Request processed in 165us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540992.151157:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 201 00000100:00100000:0.0:1788540992.155719:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788540992.156076:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955808896 00000100:00100000:2.0:1788540992.156086:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955808896 00000100:00100000:2.0:1788540992.156149:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 202 00000100:00100000:2.0:1788540992.156160:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+9:6168:x1875420955808896:12345-192.168.202.56@tcp:503: 00000100:00100000:2.0:1788540992.156310:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+9:6168:x1875420955808896:12345-192.168.202.56@tcp:503: Request processed in 152us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540992.156318:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 202 00000100:00100000:3.0:1788540992.166970:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788540992.169926:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955809024 00000100:00100000:0.0:1788540992.169943:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955809024 00000100:00100000:0.0:1788540992.169998:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 203 00000100:00100000:0.0:1788540992.170008:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+9:6643:x1875420955809024:12345-192.168.202.56@tcp:502: 00000100:00100000:0.0:1788540992.170172:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+9:6643:x1875420955809024:12345-192.168.202.56@tcp:502: Request processed in 164us (3211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540992.170180:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 203 00000100:00100000:0.0:1788540992.191117:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788540992.205291:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955809152 00000100:00100000:2.0:1788540992.205307:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955809152 00000100:00100000:2.0:1788540992.205366:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 204 00000100:00100000:2.0:1788540992.205377:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+9:6643:x1875420955809152:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788540992.205607:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+9:6643:x1875420955809152:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 232us (14498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540992.205625:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 204 00000100:00100000:0.0:1788540992.208683:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788540992.210332:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955809280 00000100:00100000:3.0:1788540992.210348:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955809280 00000100:00100000:3.0:1788540992.210416:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 205 00000100:00100000:3.0:1788540992.210428:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+9:6168:x1875420955809280:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788540992.210585:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788540992.210603:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6812044a00/0x2aac941e5f4a76d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16473202a3310fc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540992.210643:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6812044a00/0x2aac941e5f4a76d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3310fc expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540992.210655:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6812044a00/0x2aac941e5f4a76d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3310fc expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540992.210663:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6812044a00, rc 0) 00000100:00100000:3.0:1788540992.210726:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+10:6168:x1875420955809280:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 Request processed in 301us (2052us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540992.210734:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 205 00000100:00100000:2.0:1788540992.225323:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788540992.225425:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955809408 00000100:00100000:0.0:1788540992.225435:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955809408 00000100:00100000:0.0:1788540992.225544:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 206 00000100:00100000:0.0:1788540992.225556:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+10:6168:x1875420955809408:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788540992.225719:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+10:6168:x1875420955809408:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 Request processed in 164us (405us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788540992.225727:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 206 00000100:00100000:3.0:1788540992.801949:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788540992.801999:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788540992.802253:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788540992.802278:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788540992.802575:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788540992.802618:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955809792 00000100:00100000:3.0:1788540992.802628:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955809792 00000100:00100000:3.0:1788540992.802695:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955809664 00000100:00100000:3.0:1788540992.802699:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955809664 00000100:00100000:3.0:1788540992.802724:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 63 00000100:00100000:3.0:1788540992.802733:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+5:2397:x1875420955809792:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1788540992.802743:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955809536 00000100:00100000:2.0:1788540992.802747:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955809536 00000100:00100000:2.0:1788540992.802775:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 207 00000100:00100000:2.0:1788540992.802781:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+10:2397:x1875420955809536:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788540992.802809:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+5:2397:x1875420955809792:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 77us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540992.802816:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+10:2397:x1875420955809536:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 35us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540992.802817:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 63 00000100:00100000:2.0:1788540992.802821:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 207 00000100:00100000:3.0:1788540992.802832:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 64 00000100:00100000:3.0:1788540992.802838:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+6:2397:x1875420955809664:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788540992.802860:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+6:2397:x1875420955809664:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 23us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540992.802866:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 64 00000100:00080000:3.0:1788540992.802903:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788540992.802907:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788540992.803431:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955810048 00000100:00100000:1.0:1788540992.803436:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955810048 00000100:00100000:1.0:1788540992.803485:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955809920 00000100:00100000:1.0:1788540992.803488:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955809920 00000100:00100000:1.0:1788540992.803514:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 17 00000100:00100000:1.0:1788540992.803522:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:384f52e3-0481-4979-9299-157aff7472d2+5:2397:x1875420955810048:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1788540992.803559:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:384f52e3-0481-4979-9299-157aff7472d2+5:2397:x1875420955810048:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 39us (1307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540992.803566:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 17 00000100:00100000:1.0:1788540992.803580:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 18 00000100:00100000:1.0:1788540992.803586:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:384f52e3-0481-4979-9299-157aff7472d2+5:2397:x1875420955809920:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1788540992.803631:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:384f52e3-0481-4979-9299-157aff7472d2+5:2397:x1875420955809920:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 44us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540992.803638:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 18 00000100:00080000:3.0:1788540992.806481:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788540992.806489:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788540992.970320:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788540992.970346:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981028224:0@lo:13: 00000100:00100000:3.0:1788540992.970428:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540992.970575:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788540992.970585:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707729f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981028352:0@lo:41: 00000100:00100000:2.0:1788540992.970626:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540992.970676:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981028352 00000100:00100000:2.0:1788540992.970683:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981028352 00000100:00100000:2.0:1788540992.970740:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788540992.970749:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670772b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981028352:12345-0@lo:41: 00000004:00000024:2.0:1788540992.970784:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788540992.970832:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670772b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981028352:12345-0@lo:41: Request processed in 83us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540992.970839:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788540992.970895:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981028224 00000100:00100000:0.0:1788540992.970900:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981028224 00000100:00100000:2.0:1788540992.970916:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707729f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981028352:0@lo:41: 00000100:00100000:0.0:1788540992.970938:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788540992.970944:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981028224:12345-0@lo:13: 00002000:00000024:0.0:1788540992.970963:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788540992.971001:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981028224:12345-0@lo:13: Request processed in 57us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540992.971007:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1788540992.971045:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:2.0:1788540992.971318:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67079e1180 x1875420981028224/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541008 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788540992.971334:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981028224:0@lo:13: 00000100:00080000:2.0:1788540992.971361:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788540992.972006:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788540992.972022:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981028480:0@lo:13: 00000100:00100000:3.0:1788540992.972082:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540992.972129:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981028480 00000100:00100000:0.0:1788540992.972135:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981028480 00000100:00100000:0.0:1788540992.972194:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788540992.972202:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981028480:12345-0@lo:13: 00002000:00000024:0.0:1788540992.972217:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788540992.972254:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981028480:12345-0@lo:13: Request processed in 53us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540992.972260:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1788540992.972444:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788540992.972468:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67078eea00 x1875420981028480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541008 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540992.972484:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981028480:0@lo:13: 00000100:00100000:0.0:1788540993.484285:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707729f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981028608:0@lo:41: 00000100:00100000:0.0:1788540993.484365:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540993.486835:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981028608 00000100:00100000:2.0:1788540993.486849:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981028608 00000100:00100000:2.0:1788540993.486950:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788540993.486961:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981028608:12345-0@lo:41: 00000004:00000024:2.0:1788540993.486999:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788540993.487087:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981028608:12345-0@lo:41: Request processed in 128us (2721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540993.487094:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788540993.487348:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707729f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981028608:0@lo:41: 10000000:01000000:2.0:1788540993.611538:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788540993.611547:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a67067e3800 from 48 10000000:01000000:2.0:1788540993.611552:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788540993.611609:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551a400/0x2aac941e5f4a76da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540993.611621:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a683551a400/0x2aac941e5f4a76da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540993.611632:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a683551a400/0x2aac941e5f4a76da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540993.611657:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670772b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981028736:0@lo:101: 00000100:00100000:2.0:1788540993.611746:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540993.611820:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068fd3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788540993.612025:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981028736 00000100:00100000:1.0:1788540993.612035:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981028736 00000100:00100000:1.0:1788540993.612100:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788540993.612109:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+15:6514:x1875420981028736:12345-0@lo:101: 00010000:00010000:1.0:1788540993.612122:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788540993.612136:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a68354da600/0x2aac941e5f4a76e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a76da expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540993.612162:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68354da600/0x2aac941e5f4a76e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a76da expref: 16 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540993.612172:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a68354da600/0x2aac941e5f4a76e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a76da expref: 16 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540993.612201:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68354da600, rc 0) 00000100:00100000:1.0:1788540993.612263:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+16:6514:x1875420981028736:12345-0@lo:101: Request processed in 154us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540993.612270:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788540993.612529:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670772b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981028736:0@lo:101: 00010000:00010000:3.0:1788540993.612547:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a683551a400/0x2aac941e5f4a76da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a76e1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540993.612556:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a683551a400/0x2aac941e5f4a76da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a76e1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540993.612628:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981028864:0@lo:501: 00000100:00100000:3.0:1788540993.612658:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540993.612691:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68086dbcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788540993.612901:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981028864 00000100:00100000:1.0:1788540993.612906:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981028864 00000100:00100000:1.0:1788540993.612941:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788540993.612948:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+16:6514:x1875420981028864:12345-0@lo:501: 00000100:00100000:1.0:1788540993.613081:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+16:6514:x1875420981028864:12345-0@lo:501: Request processed in 132us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540993.613089:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788540993.613315:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981028864:0@lo:501: 00000100:00100000:3.0:1788540993.613361:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981028992:0@lo:503: 00000100:00100000:3.0:1788540993.613409:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540993.613428:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68086dbcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788540993.613608:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981028992 00000100:00100000:2.0:1788540993.613613:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981028992 00000100:00100000:2.0:1788540993.613642:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788540993.613649:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+16:6514:x1875420981028992:12345-0@lo:503: 00000100:00100000:2.0:1788540993.613744:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+16:6514:x1875420981028992:12345-0@lo:503: Request processed in 95us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540993.613751:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1788540993.614494:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981028992:0@lo:503: 00000100:00100000:3.0:1788540993.615372:0:10354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079e1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:10354:1875420981029120:0@lo:502: 00000100:00100000:3.0:1788540993.615431:0:10354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540993.615474:0:10354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683f241240 going to sleep for 11 seconds 00000100:00100000:1.0:1788540993.615540:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981029120 00000100:00100000:1.0:1788540993.615546:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981029120 00000100:00100000:1.0:1788540993.615589:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1788540993.616288:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+16:10354:x1875420981029120:12345-0@lo:502: 00000100:00100000:3.0:1788540993.616753:0:10354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079e1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:10354:1875420981029120:0@lo:502: 00000100:00100000:1.0:1788540993.617236:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+16:10354:x1875420981029120:12345-0@lo:502: Request processed in 1636us (1801us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540993.617245:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788540993.617351:0:10354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079e1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:10354:1875420981029248:0@lo:502: 00000100:00100000:3.0:1788540993.628983:0:10354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540993.629066:0:10354:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68086dbcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788540993.629630:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981029248 00000100:00100000:0.0:1788540993.629640:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981029248 00000100:00100000:0.0:1788540993.629695:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788540993.629705:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+16:10354:x1875420981029248:12345-0@lo:502: 00000100:00100000:0.0:1788540993.629847:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+16:10354:x1875420981029248:12345-0@lo:502: Request processed in 142us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540993.629855:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1788540993.630013:0:10354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079e1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:10354:1875420981029248:0@lo:502: 00000040:00080000:1.0:1788540993.630065:0:10354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788540993.631497:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1788540993.631545:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788540993.631558:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551a400/0x2aac941e5f4a76da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a76e1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540993.631571:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a683551a400/0x2aac941e5f4a76da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a76e1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788540993.631581:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788540993.631584:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1788540993.631587:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788540993.631632:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75e400/0x2aac941e5f4a76e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540993.631641:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a682e75e400/0x2aac941e5f4a76e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540993.631650:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a682e75e400/0x2aac941e5f4a76e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540993.631672:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981029376:0@lo:101: 00000100:00100000:0.0:1788540993.631908:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540993.631950:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068ddcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788540993.632007:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981029376 00000100:00100000:1.0:1788540993.632014:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981029376 00000100:00100000:1.0:1788540993.632066:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1788540993.632075:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+16:6514:x1875420981029376:12345-0@lo:101: 00010000:00010000:1.0:1788540993.632087:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788540993.632104:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a68354da400/0x2aac941e5f4a76ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a76e8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540993.632128:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68354da400/0x2aac941e5f4a76ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a76e8 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540993.632140:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a68354da400/0x2aac941e5f4a76ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a76e8 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540993.632149:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68354da400, rc 0) 00000100:00100000:1.0:1788540993.632191:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+17:6514:x1875420981029376:12345-0@lo:101: Request processed in 117us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540993.632197:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788540993.632443:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981029376:0@lo:101: 00010000:00010000:2.0:1788540993.632459:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a682e75e400/0x2aac941e5f4a76e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a76ef expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540993.632469:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a682e75e400/0x2aac941e5f4a76e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a76ef expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540993.632535:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707729880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981029504:0@lo:501: 00000100:00100000:2.0:1788540993.632564:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540993.632585:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068fd900 going to sleep for 11 seconds 00000100:00100000:1.0:1788540993.632726:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981029504 00000100:00100000:1.0:1788540993.632730:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981029504 00000100:00100000:1.0:1788540993.632757:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788540993.632764:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+17:6514:x1875420981029504:12345-0@lo:501: 00000100:00100000:1.0:1788540993.632902:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+17:6514:x1875420981029504:12345-0@lo:501: Request processed in 139us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540993.632909:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788540993.633155:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707729880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981029504:0@lo:501: 00000100:00100000:2.0:1788540993.633181:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707729880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981029632:0@lo:503: 00000100:00100000:2.0:1788540993.633220:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540993.633245:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068fd900 going to sleep for 11 seconds 00000100:00100000:0.0:1788540993.633281:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981029632 00000100:00100000:0.0:1788540993.633285:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981029632 00000100:00100000:0.0:1788540993.633324:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1788540993.633330:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+17:6514:x1875420981029632:12345-0@lo:503: 00000100:00100000:0.0:1788540993.633406:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+17:6514:x1875420981029632:12345-0@lo:503: Request processed in 76us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540993.633413:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788540993.633805:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707729880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981029632:0@lo:503: 00000100:00100000:1.0:1788540993.637821:0:10355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a72d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:10355:1875420981029760:0@lo:502: 00000100:00100000:1.0:1788540993.637950:0:10355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540993.637997:0:10355:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683f2f4300 going to sleep for 11 seconds 00000100:00100000:2.0:1788540993.638186:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981029760 00000100:00100000:2.0:1788540993.638195:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981029760 00000100:00100000:2.0:1788540993.638252:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788540993.638262:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+17:10355:x1875420981029760:12345-0@lo:502: 00000100:00100000:2.0:1788540993.638402:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+17:10355:x1875420981029760:12345-0@lo:502: Request processed in 141us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540993.638410:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788540993.638721:0:10355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a72d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:10355:1875420981029760:0@lo:502: 00000020:01000000:1.0:1788540993.638753:0:10355:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788540993.638762:0:10355:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788540993.638765:0:10355:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788540993.638770:0:10355:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788540993.638795:0:10355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a72d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:10355:1875420981029888:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788540993.638839:0:10355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540993.638928:0:10355:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683f2f4300 going to sleep for 11 seconds 00000100:00100000:2.0:1788540993.639074:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981029888 00000100:00100000:2.0:1788540993.639080:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981029888 00000100:00100000:2.0:1788540993.639119:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788540993.639128:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e778050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+17:10355:x1875420981029888:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788540993.639222:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e778050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+17:10355:x1875420981029888:12345-0@lo:502:llog_process_th.0 Request processed in 94us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540993.639228:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788540993.639396:0:10355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a72d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:10355:1875420981029888:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788540993.639418:0:10355:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788540993.639435:0:10355:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788540993.639436:0:10355:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788540993.639440:0:10355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:2.0:1788540993.639728:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1788540993.639749:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788540993.639760:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75e400/0x2aac941e5f4a76e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a76ef expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540993.639770:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a682e75e400/0x2aac941e5f4a76e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a76ef expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788540993.639781:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788540993.639784:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a683533b800 from 48 10000000:01000000:2.0:1788540993.639786:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788540993.639812:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551ae00/0x2aac941e5f4a76f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540993.639820:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a683551ae00/0x2aac941e5f4a76f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540993.639829:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a683551ae00/0x2aac941e5f4a76f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540993.639858:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707729880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981030016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788540993.640125:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540993.640193:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068fd840 going to sleep for 11 seconds 00000100:00100000:1.0:1788540993.648212:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981030016 00000100:00100000:1.0:1788540993.648230:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981030016 00000100:00100000:1.0:1788540993.648971:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788540993.648983:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e778850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+17:6514:x1875420981030016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788540993.649004:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788540993.649028:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a68354dae00/0x2aac941e5f4a76fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a76f6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540993.649176:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68354dae00/0x2aac941e5f4a76fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a76f6 expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540993.649189:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a68354dae00/0x2aac941e5f4a76fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a76f6 expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540993.649199:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68354dae00, rc 0) 00000100:00100000:1.0:1788540993.649285:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e778850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+18:6514:x1875420981030016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 304us (9159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540993.649292:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788540993.649342:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707729880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981030016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788540993.649363:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a683551ae00/0x2aac941e5f4a76f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a76fd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788540993.649391:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a683551ae00/0x2aac941e5f4a76f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a76fd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540993.650646:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981030144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788540993.650703:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540993.651326:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683f2f4300 going to sleep for 11 seconds 00000100:00100000:1.0:1788540993.651364:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981030144 00000100:00100000:1.0:1788540993.651372:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981030144 00000100:00100000:1.0:1788540993.651966:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788540993.651989:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e77b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+18:6514:x1875420981030144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788540993.652630:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e77b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+18:6514:x1875420981030144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 653us (1924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540993.652640:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788540993.658681:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981030144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788540993.658772:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981030272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788540993.658857:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540993.658933:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068dd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788540993.659640:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981030272 00000100:00100000:3.0:1788540993.659649:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981030272 00000100:00100000:3.0:1788540993.659727:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788540993.659739:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e77bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+18:6514:x1875420981030272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788540993.659925:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e77bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+18:6514:x1875420981030272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 186us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540993.659933:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788540993.659986:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981030272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788540993.660244:0:10357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079e0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:10357:1875420981030400:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788540993.660284:0:10357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540993.660313:0:10357:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683f241540 going to sleep for 11 seconds 00000100:00100000:0.0:1788540993.660936:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981030400 00000100:00100000:0.0:1788540993.660945:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981030400 00000100:00100000:0.0:1788540993.660983:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788540993.660991:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e77a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+18:10357:x1875420981030400:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788540993.661115:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e77a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+18:10357:x1875420981030400:12345-0@lo:502:llog_process_th.0 Request processed in 124us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540993.661123:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788540993.662208:0:10357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079e0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:10357:1875420981030400:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788540993.662278:0:10357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079e0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:10357:1875420981030528:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788540993.662329:0:10357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540993.662367:0:10357:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683f241540 going to sleep for 11 seconds 00000100:00100000:0.0:1788540993.662800:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981030528 00000100:00100000:0.0:1788540993.662809:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981030528 00000100:00100000:0.0:1788540993.662856:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788540993.662865:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e77a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+18:10357:x1875420981030528:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788540993.663024:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e77a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+18:10357:x1875420981030528:12345-0@lo:502:llog_process_th.0 Request processed in 159us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540993.663212:0:10357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079e0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:10357:1875420981030528:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788540993.663247:0:10357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788540993.663326:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788540993.663352:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788540993.663367:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551ae00/0x2aac941e5f4a76f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a76fd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540993.663380:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a683551ae00/0x2aac941e5f4a76f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a76fd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788540993.663405:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788540993.663408:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1788540993.663411:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788540993.663592:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6812045600/0x2aac941e5f4a7704 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540993.663611:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a6812045600/0x2aac941e5f4a7704 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540993.663620:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a6812045600/0x2aac941e5f4a7704 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540993.663639:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981030656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788540993.663677:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540993.663704:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683f241540 going to sleep for 11 seconds 00000100:00100000:3.0:1788540993.664176:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981030656 00000100:00100000:3.0:1788540993.664183:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981030656 00000100:00100000:0.0:1788540993.664240:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788540993.665260:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788540993.665273:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e77a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+18:6514:x1875420981030656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788540993.665291:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788540993.665308:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6812045200/0x2aac941e5f4a770b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a7704 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540993.665335:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6812045200/0x2aac941e5f4a770b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a7704 expref: 19 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540993.665346:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6812045200/0x2aac941e5f4a770b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a7704 expref: 19 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540993.665368:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6812045200, rc 0) 00000100:00100000:3.0:1788540993.665437:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e77a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+19:6514:x1875420981030656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (1758us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540993.665444:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788540993.667564:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981030656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788540993.667606:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a6812045600/0x2aac941e5f4a7704 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a770b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540993.667619:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a6812045600/0x2aac941e5f4a7704 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a770b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540993.667824:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981030784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788540993.668183:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540993.668273:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683f241540 going to sleep for 11 seconds 00000100:00100000:2.0:1788540993.668451:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981030784 00000100:00100000:2.0:1788540993.668461:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981030784 00000100:00100000:2.0:1788540993.668521:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788540993.668531:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e778c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+19:6514:x1875420981030784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788540993.668701:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e778c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+19:6514:x1875420981030784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 171us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540993.668721:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788540993.668766:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981030784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788540993.668811:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670772ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981030912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788540993.668854:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540993.668891:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068fd480 going to sleep for 11 seconds 00000100:00100000:2.0:1788540993.668904:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981030912 00000100:00100000:2.0:1788540993.668907:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981030912 00000100:00100000:2.0:1788540993.668926:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788540993.668931:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e77b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+19:6514:x1875420981030912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788540993.669015:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e77b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+19:6514:x1875420981030912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540993.669022:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788540993.669514:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670772ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981030912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788540993.669982:0:10358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670772ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:10358:1875420981031040:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788540993.670285:0:10358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540993.670323:0:10358:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068fd6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788540993.670374:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981031040 00000100:00100000:3.0:1788540993.670379:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981031040 00000100:00100000:3.0:1788540993.670423:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788540993.670441:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e77b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+19:10358:x1875420981031040:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788540993.670560:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e77b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+19:10358:x1875420981031040:12345-0@lo:502:llog_process_th.0 Request processed in 130us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540993.670567:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788540993.671053:0:10358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670772ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:10358:1875420981031040:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788540993.671083:0:10358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788540993.671094:0:10358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788540993.671096:0:10358:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788540993.671101:0:10358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788540993.671126:0:10358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670772ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:10358:1875420981031168:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788540993.671163:0:10358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540993.671191:0:10358:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068fd6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788540993.671353:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981031168 00000100:00100000:3.0:1788540993.671359:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981031168 00000100:00100000:3.0:1788540993.671384:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788540993.671391:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e779450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+19:10358:x1875420981031168:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788540993.671484:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e779450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+19:10358:x1875420981031168:12345-0@lo:502:llog_process_th.0 Request processed in 93us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540993.671491:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788540993.672234:0:10358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670772ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:10358:1875420981031168:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788540993.672271:0:10358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788540993.672280:0:10358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788540993.672281:0:10358:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788540993.672286:0:10358:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:3.0:1788540993.672623:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1788540993.672650:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788540993.672661:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6812045600/0x2aac941e5f4a7704 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a770b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540993.672673:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a6812045600/0x2aac941e5f4a7704 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a770b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788540993.672684:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788540993.672686:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a6839117000 from 48 10000000:01000000:3.0:1788540993.672689:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788540993.672799:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6812044200/0x2aac941e5f4a7712 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540993.672808:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a6812044200/0x2aac941e5f4a7712 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540993.672818:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a6812044200/0x2aac941e5f4a7712 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540993.672838:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981031296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788540993.672927:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540993.672954:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683f241540 going to sleep for 11 seconds 00000100:00100000:0.0:1788540993.673174:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981031296 00000100:00100000:0.0:1788540993.673181:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981031296 00000100:00100000:3.0:1788540993.673289:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788540993.673298:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e779c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+19:6514:x1875420981031296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788540993.673321:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788540993.673335:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6812044c00/0x2aac941e5f4a7719 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a7712 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540993.673359:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6812044c00/0x2aac941e5f4a7719 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a7712 expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540993.673370:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6812044c00/0x2aac941e5f4a7719 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a7712 expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540993.673379:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6812044c00, rc 0) 00000100:00100000:3.0:1788540993.673634:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e779c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+20:6514:x1875420981031296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540993.673644:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788540993.673689:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981031296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788540993.673704:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a6812044200/0x2aac941e5f4a7712 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7719 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540993.673823:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a6812044200/0x2aac941e5f4a7712 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a7719 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540993.674243:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981031424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788540993.674275:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540993.674311:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6831c25cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788540993.674352:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981031424 00000100:00100000:2.0:1788540993.674357:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981031424 00000100:00100000:2.0:1788540993.674392:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788540993.674400:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e77ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+20:6514:x1875420981031424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788540993.674541:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e77ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+20:6514:x1875420981031424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 140us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540993.674549:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788540993.674900:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981031424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788540993.674938:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981031552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788540993.674989:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540993.675009:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6831c25cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788540993.675022:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981031552 00000100:00100000:3.0:1788540993.675026:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981031552 00000100:00100000:3.0:1788540993.675068:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788540993.675075:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e779050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+20:6514:x1875420981031552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788540993.675150:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e779050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+20:6514:x1875420981031552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540993.675157:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788540993.675194:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981031552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788540993.675416:0:10359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079e2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:10359:1875420981031680:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788540993.675470:0:10359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540993.675490:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981031680 00000100:00100000:3.0:1788540993.675494:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981031680 00000100:00100000:3.0:1788540993.675828:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788540993.675837:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e779850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+20:10359:x1875420981031680:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788540993.675944:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e779850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+20:10359:x1875420981031680:12345-0@lo:502:llog_process_th.0 Request processed in 108us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540993.675951:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788540993.675983:0:10359:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6831c25cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788540993.675996:0:10359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079e2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:10359:1875420981031680:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788540993.676106:0:10359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079e2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:10359:1875420981031808:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788540993.676141:0:10359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540993.676161:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981031808 00000100:00100000:3.0:1788540993.676170:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981031808 00000100:00100000:3.0:1788540993.676187:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788540993.676192:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e778450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+20:10359:x1875420981031808:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788540993.676245:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e778450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+20:10359:x1875420981031808:12345-0@lo:502:llog_process_th.0 Request processed in 52us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540993.676252:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788540993.676282:0:10359:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6706ab4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788540993.676294:0:10359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079e2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:10359:1875420981031808:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788540993.676313:0:10359:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788540993.676371:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788540993.676388:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788540993.676397:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6812044200/0x2aac941e5f4a7712 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7719 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540993.676407:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a6812044200/0x2aac941e5f4a7712 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7719 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788540993.676416:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788540993.676948:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:3.0:1788540993.676953:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788540993.676982:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6812044e00/0x2aac941e5f4a7720 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540993.676991:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a6812044e00/0x2aac941e5f4a7720 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540993.677001:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a6812044e00/0x2aac941e5f4a7720 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540993.677027:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981031936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788540993.677171:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540993.677191:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6706ab4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788540993.677210:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981031936 00000100:00100000:3.0:1788540993.677214:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981031936 00000100:00100000:3.0:1788540993.677238:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788540993.677245:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680cee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+20:6514:x1875420981031936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788540993.677255:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788540993.677266:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6812045e00/0x2aac941e5f4a7727 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a7720 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540993.677288:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6812045e00/0x2aac941e5f4a7727 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a7720 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540993.677299:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6812045e00/0x2aac941e5f4a7727 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a7720 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540993.677307:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6812045e00, rc 0) 00000100:00100000:3.0:1788540993.677338:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680cee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+21:6514:x1875420981031936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540993.677344:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788540993.677379:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981031936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788540993.677393:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a6812044e00/0x2aac941e5f4a7720 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7727 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540993.677401:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a6812044e00/0x2aac941e5f4a7720 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a7727 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540993.677864:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981032064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788540993.677927:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540993.677950:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6706ab4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788540993.678179:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981032064 00000100:00100000:2.0:1788540993.678183:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981032064 00000100:00100000:2.0:1788540993.678212:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788540993.678220:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680cee4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+21:6514:x1875420981032064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788540993.678331:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680cee4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+21:6514:x1875420981032064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540993.678347:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788540993.678399:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981032064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788540993.678446:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670772ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981032192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788540993.678485:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540993.678500:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068fd240 going to sleep for 11 seconds 00000100:00100000:2.0:1788540993.678526:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981032192 00000100:00100000:2.0:1788540993.678530:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981032192 00000100:00100000:2.0:1788540993.678548:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788540993.678554:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680cee5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+21:6514:x1875420981032192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788540993.678642:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680cee5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+21:6514:x1875420981032192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540993.678649:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788540993.678687:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670772ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981032192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788540993.685226:0:10360:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670772ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:10360:1875420981032320:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788540993.685315:0:10360:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540993.685359:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981032320 00000100:00100000:2.0:1788540993.685366:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981032320 00000100:00100000:2.0:1788540993.685464:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788540993.685475:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680cee7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+21:10360:x1875420981032320:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788540993.685618:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680cee7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+21:10360:x1875420981032320:12345-0@lo:502:llog_process_th.0 Request processed in 144us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540993.685627:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788540993.688256:0:10360:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683f1a7300 going to sleep for 11 seconds 00000100:00100000:3.0:1788540993.688295:0:10360:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670772ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:10360:1875420981032320:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788540993.688337:0:10360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788540993.688348:0:10360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788540993.688351:0:10360:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788540993.688357:0:10360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788540993.688397:0:10360:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079e0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:10360:1875420981032448:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788540993.688483:0:10360:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540993.693414:0:10360:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6706ab4180 going to sleep for 11 seconds 00000100:00100000:1.0:1788540993.701342:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981032448 00000100:00100000:1.0:1788540993.701359:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981032448 00000100:00100000:1.0:1788540993.701436:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788540993.701446:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680cee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+21:10360:x1875420981032448:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788540993.701904:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680cee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+21:10360:x1875420981032448:12345-0@lo:502:llog_process_th.0 Request processed in 457us (13420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540993.701913:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788540993.703246:0:10360:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079e0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:10360:1875420981032448:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788540993.703297:0:10360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788540993.703304:0:10360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788540993.703307:0:10360:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788540993.703312:0:10360:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:0.0:1788540993.703569:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:0.0:1788540993.703594:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788540993.703614:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6812044e00/0x2aac941e5f4a7720 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7727 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540993.703625:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a6812044e00/0x2aac941e5f4a7720 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7727 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788540993.703636:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788540993.703638:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a68112dc000 from 48 10000000:01000000:0.0:1788540993.703642:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788540993.703678:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75e000/0x2aac941e5f4a772e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540993.703685:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a682e75e000/0x2aac941e5f4a772e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540993.703693:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a682e75e000/0x2aac941e5f4a772e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540993.704609:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078eca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981032576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788540993.704679:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540993.705374:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068dda80 going to sleep for 11 seconds 00000100:00100000:0.0:1788540993.705404:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981032576 00000100:00100000:0.0:1788540993.705413:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981032576 00000100:00100000:0.0:1788540993.706071:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788540993.706081:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6805288050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+21:6514:x1875420981032576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788540993.706098:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788540993.706121:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a682e75f800/0x2aac941e5f4a7735 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a772e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540993.706150:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a682e75f800/0x2aac941e5f4a7735 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a772e expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540993.706162:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a682e75f800/0x2aac941e5f4a7735 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a772e expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540993.706172:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75f800, rc 0) 00000100:00100000:0.0:1788540993.706249:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6805288050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+22:6514:x1875420981032576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (1569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540993.706257:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788540993.706329:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078eca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981032576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788540993.706347:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a682e75e000/0x2aac941e5f4a772e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7735 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540993.706356:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a682e75e000/0x2aac941e5f4a772e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a7735 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540993.706439:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981032704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788540993.706473:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540993.714521:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6706ab4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788540993.717592:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981032704 00000100:00100000:2.0:1788540993.717617:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981032704 00000100:00100000:3.0:1788540993.723015:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788540993.723028:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680528a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+22:6514:x1875420981032704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788540993.723252:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680528a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+22:6514:x1875420981032704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 225us (16777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540993.723268:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788540993.723316:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981032704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788540993.723372:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981032832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788540993.723697:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540993.723791:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6706ab4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788540993.723814:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981032832 00000100:00100000:3.0:1788540993.723821:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981032832 00000100:00100000:3.0:1788540993.723842:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788540993.723848:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6805289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+22:6514:x1875420981032832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788540993.723948:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6805289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+22:6514:x1875420981032832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540993.723955:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788540993.723988:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981032832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788540993.734476:0:10364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079e0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:10364:1875420981032960:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788540993.734824:0:10364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540993.734898:0:10364:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6706ab4000 going to sleep for 11 seconds 00000100:00100000:2.0:1788540993.735020:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981032960 00000100:00100000:2.0:1788540993.735028:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981032960 00000100:00100000:2.0:1788540993.735089:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788540993.735100:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6805288850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+22:10364:x1875420981032960:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788540993.735414:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6805288850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+22:10364:x1875420981032960:12345-0@lo:502:llog_process_th.0 Request processed in 315us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540993.735432:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788540993.735677:0:10364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079e0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:10364:1875420981032960:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788540993.735805:0:10364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079e0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:10364:1875420981033088:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788540993.735845:0:10364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540993.735951:0:10364:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6706ab4000 going to sleep for 11 seconds 00000100:00100000:1.0:1788540993.739330:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981033088 00000100:00100000:1.0:1788540993.739349:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981033088 00000100:00100000:1.0:1788540993.739434:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788540993.739445:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6809078850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+22:10364:x1875420981033088:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788540993.739658:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6809078850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+22:10364:x1875420981033088:12345-0@lo:502:llog_process_th.0 Request processed in 214us (3811us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540993.739674:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788540993.742193:0:10364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079e0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:10364:1875420981033088:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788540993.742247:0:10364:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788540993.743069:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1788540993.743099:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788540993.743112:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75e000/0x2aac941e5f4a772e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7735 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540993.743124:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a682e75e000/0x2aac941e5f4a772e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7735 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788540993.743135:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788540993.743148:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:2.0:1788540993.743152:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788540993.743196:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551be00/0x2aac941e5f4a773c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540993.743205:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a683551be00/0x2aac941e5f4a773c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540993.743229:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a683551be00/0x2aac941e5f4a773c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540993.743253:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670772bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981033216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788540993.743329:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540993.743379:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6835519540 going to sleep for 11 seconds 00000100:00100000:3.0:1788540993.743927:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981033216 00000100:00100000:3.0:1788540993.743942:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981033216 00000100:00100000:3.0:1788540993.744007:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788540993.744018:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680907a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+22:6514:x1875420981033216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788540993.744044:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788540993.744061:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6812045400/0x2aac941e5f4a7743 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a773c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540993.744088:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6812045400/0x2aac941e5f4a7743 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a773c expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540993.744099:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6812045400/0x2aac941e5f4a7743 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a773c expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540993.744110:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6812045400, rc 0) 00000100:00100000:3.0:1788540993.744701:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680907a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+23:6514:x1875420981033216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 682us (1370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540993.744831:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670772bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981033216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788540993.744850:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a683551be00/0x2aac941e5f4a773c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7743 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540993.744861:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a683551be00/0x2aac941e5f4a773c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a7743 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540993.744960:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788540993.745653:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981033344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788540993.745700:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540993.745809:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683f2f4540 going to sleep for 11 seconds 00000100:00100000:2.0:1788540993.745862:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981033344 00000100:00100000:2.0:1788540993.745907:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981033344 00000100:00100000:2.0:1788540993.745949:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788540993.745957:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680907ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+23:6514:x1875420981033344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788540993.746306:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680907ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+23:6514:x1875420981033344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 349us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540993.746315:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788540993.746500:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981033344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788540993.746620:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981033472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788540993.746672:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788540993.746685:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683f2f4540 going to sleep for 11 seconds 00000100:00100000:2.0:1788540993.746805:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981033472 00000100:00100000:2.0:1788540993.746810:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981033472 00000100:00100000:2.0:1788540993.746844:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788540993.746851:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6809078450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+23:6514:x1875420981033472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788540993.746968:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6809078450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+23:6514:x1875420981033472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 117us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540993.746985:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788540993.747261:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981033472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788540993.755980:0:10366:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079e0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:10366:1875420981033600:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788540993.756090:0:10366:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540993.756131:0:10366:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6706ab4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788540993.759001:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981033600 00000100:00100000:1.0:1788540993.759017:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981033600 00000100:00100000:1.0:1788540993.759093:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788540993.759106:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807634850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+23:10366:x1875420981033600:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788540993.759298:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807634850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+23:10366:x1875420981033600:12345-0@lo:502:llog_process_th.0 Request processed in 194us (3207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540993.759306:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788540993.759791:0:10366:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079e0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:10366:1875420981033600:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788540993.759831:0:10366:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788540993.759843:0:10366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788540993.759845:0:10366:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788540993.759852:0:10366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788540993.759929:0:10366:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079e0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:10366:1875420981033728:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788540993.759984:0:10366:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540993.760019:0:10366:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6706ab4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788540993.760648:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981033728 00000100:00100000:2.0:1788540993.760656:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981033728 00000100:00100000:2.0:1788540993.760708:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1788540993.760717:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+23:10366:x1875420981033728:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788540993.760835:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+23:10366:x1875420981033728:12345-0@lo:502:llog_process_th.0 Request processed in 118us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540993.760842:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788540993.762192:0:10366:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079e0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:10366:1875420981033728:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788540993.762231:0:10366:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788540993.762239:0:10366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788540993.762241:0:10366:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788540993.762245:0:10366:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1788540993.762307:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:3.0:1788540993.762328:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788540993.762339:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551be00/0x2aac941e5f4a773c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7743 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540993.762351:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a683551be00/0x2aac941e5f4a773c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7743 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788540993.762361:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788540993.762363:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9a682e74b380 from 1 10000000:01000000:3.0:1788540993.762366:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788540993.762400:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6842173400/0x2aac941e5f4a774a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540993.762408:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a6842173400/0x2aac941e5f4a774a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540993.762418:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a6842173400/0x2aac941e5f4a774a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540993.763071:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981033856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788540993.763137:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540993.763179:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6706ab4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788540993.764273:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981033856 00000100:00100000:2.0:1788540993.764285:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981033856 00000100:00100000:2.0:1788540993.764345:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788540993.764355:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+23:6514:x1875420981033856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788540993.764372:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788540993.764389:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a683551a800/0x2aac941e5f4a7751 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a774a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540993.764417:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a683551a800/0x2aac941e5f4a7751 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a774a expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540993.765020:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a683551a800/0x2aac941e5f4a7751 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a774a expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540993.765030:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a683551a800, rc 0) 00000100:00100000:3.0:1788540993.765616:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+24:6514:x1875420981033856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1257us (2474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540993.765644:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788540993.765991:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981033856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788540993.766020:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a6842173400/0x2aac941e5f4a774a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7751 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540993.766055:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a6842173400/0x2aac941e5f4a774a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a7751 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540993.766170:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670772bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981033984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788540993.766212:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540993.766247:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68355196c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788540993.766395:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981033984 00000100:00100000:3.0:1788540993.766402:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981033984 00000100:00100000:3.0:1788540993.766683:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788540993.766695:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807636c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+24:6514:x1875420981033984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788540993.766807:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807636c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+24:6514:x1875420981033984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (594us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788540993.766815:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1788540993.767006:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670772bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981033984:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788540993.767044:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788540993.767053:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6842173400/0x2aac941e5f4a774a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7751 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540993.767062:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a6842173400/0x2aac941e5f4a774a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7751 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540993.994098:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788540994.207014:0:10391:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffea1011e40 20000000:00000080:0.0:1788540994.207031:0:10391:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a6706a30400 uarg=0000000000000000 20000000:01000000:0.0:1788540994.207218:0:10391:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788540994.207223:0:10391:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788540994.207228:0:10391:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788540994.209547:0:10392:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1788540994.209749:0:10391:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1788540994.218318:0:10391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1788540994.218385:0:10391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1788540994.218406:0:10391:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1788540994.218437:0:10391:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788540994.218460:0:10391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a7758 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540994.218482:0:10391:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6812044400/0x2aac941e5f4a73a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a7399 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540994.218489:0:10391:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6812044000/0x2aac941e5f4a73ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a73e6 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540994.218523:0:10391:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a68354dac00/0x2aac941e5f4a7456 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a744f expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540994.218529:0:10391:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a68354dbe00/0x2aac941e5f4a757c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a7575 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540994.218539:0:10391:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a682e75fa00/0x2aac941e5f4a7694 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3310bd expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540994.218546:0:10391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a7758 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540994.218601:0:10391:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a682e75fa00/0x2aac941e5f4a7694 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3310bd expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540994.218619:0:10391:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a682e75fa00/0x2aac941e5f4a7694 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3310bd expref: 9 pid: 6511 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540994.218635:0:10391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ed180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10391:1875420981034112:192.168.202.56@tcp:104: 00010000:00010000:0.0:1788540994.218757:0:10391:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a68354dbe00/0x2aac941e5f4a757c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a7575 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540994.218766:0:10391:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a68354dbe00/0x2aac941e5f4a757c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a7575 expref: 23 pid: 6512 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540994.218790:0:10391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ed880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10391:1875420981034240:0@lo:104: 00000100:00100000:0.0:1788540994.218836:0:10391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788540994.218902:0:10391:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a68354dac00/0x2aac941e5f4a7456 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a744f expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540994.218917:0:10391:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a68354dac00/0x2aac941e5f4a7456 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a744f expref: 23 pid: 6512 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540994.218927:0:10391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ef800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10391:1875420981034368:0@lo:104: 00000100:00100000:0.0:1788540994.218955:0:10391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788540994.218977:0:10391:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6812044000/0x2aac941e5f4a73ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a73e6 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540994.218985:0:10391:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6812044000/0x2aac941e5f4a73ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a73e6 expref: 23 pid: 6512 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540994.218992:0:10391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078eed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10391:1875420981034496:0@lo:104: 00000100:00100000:2.0:1788540994.219006:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:0.0:1788540994.219020:0:10391:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6812044400/0x2aac941e5f4a73a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a7399 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540994.219024:0:6501:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788540994.219028:0:10391:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6812044400/0x2aac941e5f4a73a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a7399 expref: 23 pid: 6509 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540994.219035:0:10391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ee300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10391:1875420981034624:0@lo:104: 00000100:00100000:2.0:1788540994.219036:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981034240 00000100:00100000:2.0:1788540994.219042:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981034240 00000100:00100000:0.0:1788540994.219052:0:10391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540994.219062:0:10391:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068ddf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788540994.219091:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981034368 00000100:00100000:2.0:1788540994.219095:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981034368 00000100:00100000:2.0:1788540994.219106:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981034496 00000100:00100000:2.0:1788540994.219108:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981034496 00000100:00100000:2.0:1788540994.219117:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981034624 00000100:00100000:2.0:1788540994.219119:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981034624 00000100:00100000:2.0:1788540994.219131:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788540994.219139:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+6:10391:x1875420981034240:12345-0@lo:104: 00010000:00010000:2.0:1788540994.219162:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a68354daa00/0x2aac941e5f4a7575 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a757c expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540994.219228:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788540994.219235:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+6:10391:x1875420981034240:12345-0@lo:104: Request processed in 97us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540994.219242:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788540994.219259:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788540994.219265:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f0fb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+5:10391:x1875420981034368:12345-0@lo:104: 00010000:00010000:2.0:1788540994.219273:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a6842049000/0x2aac941e5f4a744f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a7456 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540994.219304:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788540994.219310:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f0fb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+5:10391:x1875420981034368:12345-0@lo:104: Request processed in 45us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540994.219316:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788540994.219344:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788540994.219349:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670772bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+4:10391:x1875420981034496:12345-0@lo:104: 00010000:00010000:2.0:1788540994.219357:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a6842173200/0x2aac941e5f4a73e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a73ed expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540994.219386:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788540994.219390:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670772bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+4:10391:x1875420981034496:12345-0@lo:104: Request processed in 42us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540994.219396:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788540994.219406:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788540994.219411:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+3:10391:x1875420981034624:12345-0@lo:104: 00010000:00010000:2.0:1788540994.219423:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a6842048600/0x2aac941e5f4a7399 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a73a0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540994.219447:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788540994.219452:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+3:10391:x1875420981034624:12345-0@lo:104: Request processed in 41us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540994.219457:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:2.0:1788540994.219475:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788540994.219480:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a68354daa00/0x2aac941e5f4a7575 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a757c expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540994.219487:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68354daa00 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:2.0:1788540994.219491:0:8446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a68354daa00/0x2aac941e5f4a7575 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a757c expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540994.219499:0:8446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a68354daa00/0x2aac941e5f4a7575 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a757c expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788540994.219506:0:8446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a68354daa00/0x2aac941e5f4a7575 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a757c expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788540994.219511:0:8446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788540994.219539:0:8446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a68354daa00/0x2aac941e5f4a7575 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a757c expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540994.219546:0:8446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788540994.219577:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a68354daa00/0x2aac941e5f4a7575 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a757c expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540994.219585:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a68354daa00/0x2aac941e5f4a7575 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a757c expref: -99 pid: 9509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540994.219621:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788540994.219624:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a6842049000/0x2aac941e5f4a744f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a7456 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540994.219629:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842049000 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:2.0:1788540994.219632:0:8446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a6842049000/0x2aac941e5f4a744f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a7456 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540994.219639:0:8446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a6842049000/0x2aac941e5f4a744f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a7456 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788540994.219644:0:8446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a6842049000/0x2aac941e5f4a744f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a7456 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788540994.219650:0:8446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788540994.219664:0:8446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a6842049000/0x2aac941e5f4a744f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7456 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540994.219670:0:8446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788540994.219684:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a6842049000/0x2aac941e5f4a744f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7456 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540994.219691:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a6842049000/0x2aac941e5f4a744f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7456 expref: -99 pid: 8424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540994.219698:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670772a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:425687b6-1d99-41d2-88d8-2fb230997596:3644:1875420981034752:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788540994.219700:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788540994.219703:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a6842173200/0x2aac941e5f4a73e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a73ed expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540994.219730:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842173200 already unused, calling callback (ffffffffc150fc20) 00000100:00100000:3.0:1788540994.219732:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:2.0:1788540994.219733:0:8446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a6842173200/0x2aac941e5f4a73e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a73ed expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540994.219740:0:8446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a6842173200/0x2aac941e5f4a73e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a73ed expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788540994.219747:0:8446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a6842173200/0x2aac941e5f4a73e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a73ed expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788540994.219751:0:8446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1788540994.219764:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707728700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420981034880:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788540994.219765:0:8446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a6842173200/0x2aac941e5f4a73e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a73ed expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540994.219770:0:8446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788540994.219776:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a6842173200/0x2aac941e5f4a73e6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a73ed expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540994.219783:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a6842173200/0x2aac941e5f4a73e6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a73ed expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540994.219793:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788540994.219796:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a6842048600/0x2aac941e5f4a7399 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a73a0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540994.219797:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788540994.219802:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842048600 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:2.0:1788540994.219804:0:8446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a6842048600/0x2aac941e5f4a7399 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a73a0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540994.219816:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788540994.219821:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420981035008:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788540994.219822:0:8446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a6842048600/0x2aac941e5f4a7399 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a73a0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788540994.219829:0:8446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a6842048600/0x2aac941e5f4a7399 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a73a0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788540994.219834:0:8446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1788540994.219838:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788540994.219847:0:8446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a6842048600/0x2aac941e5f4a7399 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a73a0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540994.219853:0:8446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788540994.219861:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981034752 00010000:00010000:2.0:1788540994.219862:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a6842048600/0x2aac941e5f4a7399 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a73a0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540994.219865:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981034752 00010000:00010000:2.0:1788540994.219893:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a6842048600/0x2aac941e5f4a7399 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a73a0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540994.219908:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a68354dbe00/0x2aac941e5f4a757c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a7575 expref: 24 pid: 6512 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540994.219908:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540994.219909:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540994.219911:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540994.219917:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540994.219922:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788540994.219927:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981034880 00000100:00100000:3.0:1788540994.219931:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981034880 00000100:00100000:2.0:1788540994.219937:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670772ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420981035136:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788540994.219940:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a68354dac00/0x2aac941e5f4a7456 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a744f expref: 25 pid: 6512 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540994.219949:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981035008 00000100:00100000:3.0:1788540994.219957:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981035008 00000100:00100000:2.0:1788540994.219962:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788540994.219969:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6812044000/0x2aac941e5f4a73ed lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a73e6 expref: 26 pid: 6512 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540994.219980:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981035136 00000100:00100000:3.0:1788540994.219982:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981035136 00010000:00010000:3.0:1788540994.219992:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6812044400/0x2aac941e5f4a73a0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a7399 expref: 27 pid: 6509 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540994.220002:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788540994.220007:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+27:3644:x1875420981034752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788540994.220017:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788540994.220022:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a68354dbe00/0x2aac941e5f4a757c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a7575 expref: 27 pid: 6512 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540994.220030:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a68354dbe00/0x2aac941e5f4a757c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a7575 expref: 27 pid: 6512 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540994.220046:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788540994.220070:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+27:3644:x1875420981034752:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540994.220076:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788540994.220088:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788540994.220093:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+26:3641:x1875420981034880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788540994.220101:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788540994.220105:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a68354dac00/0x2aac941e5f4a7456 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a744f expref: 26 pid: 6512 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540994.220112:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a68354dac00/0x2aac941e5f4a7456 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a744f expref: 26 pid: 6512 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540994.220133:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788540994.220295:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+26:3641:x1875420981034880:12345-0@lo:103:ldlm_bl.0 Request processed in 201us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540994.220302:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788540994.220316:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788540994.220322:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+25:3641:x1875420981035008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788540994.220330:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788540994.220334:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6812044000/0x2aac941e5f4a73ed lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a73e6 expref: 25 pid: 6512 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540994.220342:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6812044000/0x2aac941e5f4a73ed lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a73e6 expref: 25 pid: 6512 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540994.220351:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788540994.220371:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+25:3641:x1875420981035008:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540994.220376:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788540994.220386:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788540994.220392:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680763cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+24:3643:x1875420981035136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788540994.220400:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788540994.220403:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6812044400/0x2aac941e5f4a73a0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a7399 expref: 24 pid: 6509 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540994.220410:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6812044400/0x2aac941e5f4a73a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a7399 expref: 24 pid: 6509 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540994.220433:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788540994.220470:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680763cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+24:3643:x1875420981035136:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540994.220476:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:0.0:1788540994.221741:0:10391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a68354dbe00/0x2aac941e5f4a757c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a7575 expref: 23 pid: 6512 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540994.221757:0:10391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ed880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10391:1875420981034240:0@lo:104: 00010000:00010000:0.0:1788540994.221769:0:10391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a68354dac00/0x2aac941e5f4a7456 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a744f expref: 22 pid: 6512 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540994.222356:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420981035008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788540994.222367:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707728700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420981034880:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788540994.222518:0:10391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ef800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10391:1875420981034368:0@lo:104: 00010000:00010000:0.0:1788540994.222534:0:10391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6812044000/0x2aac941e5f4a73ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a73e6 expref: 21 pid: 6512 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540994.222542:0:10391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078eed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10391:1875420981034496:0@lo:104: 00010000:00010000:0.0:1788540994.222552:0:10391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6812044400/0x2aac941e5f4a73a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a7399 expref: 20 pid: 6509 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540994.222559:0:10391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ee300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10391:1875420981034624:0@lo:104: 00000100:00100000:0.0:1788540994.225892:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670772a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:425687b6-1d99-41d2-88d8-2fb230997596:3644:1875420981034752:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788540994.229383:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670772ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420981035136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788540994.229689:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788540994.229763:0:10391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ed180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10391:1875420981034112:192.168.202.56@tcp:104: 00010000:00010000:1.0:1788540994.229807:0:10391:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a7758 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540994.230401:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955810176 00000100:00100000:3.0:1788540994.230409:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955810176 00010000:00010000:3.0:1788540994.230458:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a682e75fa00/0x2aac941e5f4a7694 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3310bd expref: 10 pid: 6511 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788540994.230505:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 39 00000100:00100000:3.0:1788540994.230516:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de51b185-1fb8-4395-8428-f3d8fb602cc3+10:2396:x1875420955810176:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788540994.230532:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788540994.230537:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a682e75fa00/0x2aac941e5f4a7694 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3310bd expref: 10 pid: 6511 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540994.230548:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a682e75fa00/0x2aac941e5f4a7694 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3310bd expref: 10 pid: 6511 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540994.230566:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a682e75fa00/0x2aac941e5f4a7694 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3310bd expref: 10 pid: 6511 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540994.230582:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a7758 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540994.230590:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a7758 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540994.230616:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a7758 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540994.230635:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a7758 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540994.230641:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a7758 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540994.230647:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a7758 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540994.230653:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75e200 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:3.0:1788540994.230657:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a7758 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540994.230666:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a7758 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540994.230688:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a7758 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540994.230697:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788540994.230755:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de51b185-1fb8-4395-8428-f3d8fb602cc3+9:2396:x1875420955810176:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 239us (1068us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540994.230762:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 39 00010000:00010000:0.0:1788540994.230967:0:10391:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a7758 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540994.230975:0:10391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a7758 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540994.230982:0:10391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a682e75e200/0x2aac941e5f4a7758 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540995.020891:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981035264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788540995.020978:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540995.021056:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981035264 00000100:00100000:0.0:1788540995.021064:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981035264 00000100:00100000:0.0:1788540995.021119:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788540995.021128:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981035264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788540995.021173:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788540995.021217:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981035264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540995.021225:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1788540995.021245:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788540995.021278:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67078ed180 x1875420981035264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541011 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540995.021297:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981035264:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788540995.021576:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788540995.021858:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981035392:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788540995.021932:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1788540995.022206:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788540995.022210:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a67067e3800 from 4 10000000:01000000:0.0:1788540995.022213:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788540995.022241:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a775f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540995.022250:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a775f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540995.022260:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a775f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540995.022274:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981036800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788540995.022301:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540995.022330:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068dd540 going to sleep for 11 seconds 00000100:00100000:0.0:1788540995.022343:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981035648:0@lo:400:kworker.0 00000100:00100000:0.0:1788540995.022366:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540995.022383:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670772ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875420981036160:0@lo:400:kworker.0 00000100:00100000:0.0:1788540995.022404:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540995.022427:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875420981036672:0@lo:400:kworker.0 00000100:00100000:0.0:1788540995.022445:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540995.022464:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788540995.022469:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875420981035776:0@lo:400:kworker.0 00000100:00100000:0.0:1788540995.022487:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540995.022505:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670772a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981036288:0@lo:400:kworker.0 00000100:00100000:0.0:1788540995.022525:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540995.022551:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981035648 00000100:00100000:0.0:1788540995.022556:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981035648 00000100:00100000:0.0:1788540995.022621:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788540995.022630:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981035648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788540995.022677:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981035648:12345-0@lo:400:kworker.0 Request processed in 48us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540995.022684:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788540995.022704:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981036160 00000100:00100000:0.0:1788540995.022707:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981036160 00000100:00100000:0.0:1788540995.022736:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981036672 00000100:00100000:0.0:1788540995.022739:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981036672 00000100:00100000:0.0:1788540995.022749:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981035776 00000100:00100000:0.0:1788540995.022751:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981035776 00000100:00100000:0.0:1788540995.022762:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788540995.022767:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875420981036160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788540995.022797:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875420981036160:12345-0@lo:400:kworker.0 Request processed in 30us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540995.022803:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788540995.022814:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788540995.022820:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875420981036672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788540995.022856:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875420981036672:12345-0@lo:400:kworker.0 Request processed in 35us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540995.022862:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788540995.022898:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788540995.022905:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875420981035776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788540995.022930:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875420981035776:12345-0@lo:400:kworker.0 Request processed in 27us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540995.022935:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788540995.022960:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981036288 00000100:00100000:0.0:1788540995.022963:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981036288 00000100:00100000:0.0:1788540995.022988:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788540995.022994:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981036288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788540995.023022:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981036288:12345-0@lo:400:kworker.0 Request processed in 28us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540995.023027:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1788540995.023052:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788540995.023057:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788540995.023066:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981035392 00000100:00100000:0.0:1788540995.023069:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981035392 00000100:00100000:0.0:1788540995.023094:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788540995.023100:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981035392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788540995.023113:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788540995.023142:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981035392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (1210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540995.023148:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1788540995.023163:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788540995.023187:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707729880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875420981035776:0@lo:400:kworker.0 00010000:00080000:0.0:1788540995.023209:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670772a300 x1875420981036288/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541011 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540995.023219:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670772a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981036288:0@lo:400:kworker.0 00000100:00100000:0.0:1788540995.023228:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707729180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981035648:0@lo:400:kworker.0 00010000:00080000:0.0:1788540995.023236:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670772ad80 x1875420981036160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541011 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540995.023244:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670772ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875420981036160:0@lo:400:kworker.0 00010000:00080000:0.0:1788540995.023253:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68045e3b80 x1875420981036672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541011 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788540995.023260:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875420981036672:0@lo:400:kworker.0 00000100:00100000:2.0:1788540995.023436:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981036800 00000100:00100000:2.0:1788540995.023441:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981036800 00000100:00100000:2.0:1788540995.023469:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1788540995.023476:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807634450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+20:6514:x1875420981036800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788540995.023484:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788540995.023499:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a683551b600/0x2aac941e5f4a7766 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a775f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540995.023523:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a683551b600/0x2aac941e5f4a7766 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a775f expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540995.023533:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a683551b600/0x2aac941e5f4a7766 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a775f expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540995.023542:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a683551b600, rc 0) 00000100:00100000:2.0:1788540995.023574:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807634450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+21:6514:x1875420981036800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (1271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540995.023580:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788540995.023795:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981036800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788540995.023812:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a775f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7766 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540995.023821:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a775f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a7766 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540995.023912:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981036928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788540995.023942:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540995.023971:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068dd540 going to sleep for 11 seconds 00000100:00100000:2.0:1788540995.024041:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981036928 00000100:00100000:2.0:1788540995.024046:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981036928 00000100:00100000:2.0:1788540995.024070:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788540995.024075:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807634050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+21:6514:x1875420981036928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788540995.024186:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807634050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+21:6514:x1875420981036928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540995.024192:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1788540995.024263:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981036928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788540995.024290:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981037056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788540995.024340:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540995.024369:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068dd540 going to sleep for 11 seconds 00000100:00100000:2.0:1788540995.024409:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981037056 00000100:00100000:2.0:1788540995.024413:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981037056 00000100:00100000:2.0:1788540995.024444:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788540995.024450:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807635c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+21:6514:x1875420981037056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788540995.024529:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807635c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+21:6514:x1875420981037056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540995.024536:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788540995.025920:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707728700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875420981035520:0@lo:400:kworker.0 00000100:00100000:3.0:1788540995.025979:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540995.026019:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707729f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875420981036032:0@lo:400:kworker.0 00000100:00100000:3.0:1788540995.026055:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540995.026072:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f0fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875420981036544:0@lo:400:kworker.0 00000100:00100000:3.0:1788540995.026092:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540995.026115:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788540995.026122:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670772b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981035904:0@lo:400:kworker.0 00000100:00100000:3.0:1788540995.026145:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540995.026162:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f0ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981036416:0@lo:400:kworker.0 00000100:00100000:3.0:1788540995.026185:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540995.026223:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981036416 00000100:00100000:3.0:1788540995.026229:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981036416 00000100:00100000:3.0:1788540995.026273:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788540995.026282:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706833100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981036416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788540995.026326:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706833100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981036416:12345-0@lo:400:kworker.0 Request processed in 45us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540995.026334:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1788540995.026376:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67079e1880 x1875420981035392/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541011 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540995.026398:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981035392:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1788540995.026438:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a683f0ff480 x1875420981036416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541011 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540995.026448:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f0ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981036416:0@lo:400:kworker.0 00000100:00100000:2.0:1788540995.027552:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981035520 00000100:00100000:2.0:1788540995.027561:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981035520 00000100:00100000:2.0:1788540995.027626:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981036032 00000100:00100000:2.0:1788540995.027630:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981036032 00000100:00100000:2.0:1788540995.027647:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981036544 00000100:00100000:2.0:1788540995.027650:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981036544 00000100:00100000:2.0:1788540995.027667:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788540995.027675:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875420981035520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788540995.027737:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875420981035520:12345-0@lo:400:kworker.0 Request processed in 63us (1758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540995.027744:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788540995.027760:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788540995.027766:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875420981036032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788540995.027776:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788540995.027785:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875420981036544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788540995.027793:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875420981036032:12345-0@lo:400:kworker.0 Request processed in 28us (1738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540995.027799:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788540995.027813:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875420981036544:12345-0@lo:400:kworker.0 Request processed in 31us (1721us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540995.027831:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788540995.027885:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707728700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875420981035520:0@lo:400:kworker.0 00000100:00100000:3.0:1788540995.027899:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707729f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875420981036032:0@lo:400:kworker.0 00000100:00100000:3.0:1788540995.027909:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f0fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875420981036544:0@lo:400:kworker.0 00000100:00080000:0.0:1788540995.027943:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788540995.027948:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788540995.027960:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981035904 00000100:00100000:0.0:1788540995.027964:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981035904 00000100:00100000:0.0:1788540995.028003:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788540995.028011:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981035904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788540995.028053:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981035904:12345-0@lo:400:kworker.0 Request processed in 44us (1907us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540995.028059:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788540995.028083:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670772b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981035904:0@lo:400:kworker.0 00000100:00100000:0.0:1788540995.028110:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981037056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788540995.028338:0:10411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ed180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:10411:1875420981037184:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788540995.028383:0:10411:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540995.028408:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981037184 00000100:00100000:0.0:1788540995.028412:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981037184 00000100:00100000:0.0:1788540995.028435:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1788540995.028441:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+21:10411:x1875420981037184:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788540995.028543:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+21:10411:x1875420981037184:12345-0@lo:502:llog_process_th.0 Request processed in 102us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540995.028550:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1788540995.028627:0:10411:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068dd480 going to sleep for 11 seconds 00000100:00100000:0.0:1788540995.028639:0:10411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ed180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:10411:1875420981037184:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788540995.028659:0:10411:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788540995.028675:0:10411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788540995.028677:0:10411:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788540995.028683:0:10411:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a67067e3800 00000020:00000080:0.0:1788540995.028686:0:10411:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788540995.030555:0:10411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ed180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:10411:1875420981037312:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788540995.030646:0:10411:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540995.030687:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981037312 00000100:00100000:0.0:1788540995.030693:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981037312 00000100:00100000:0.0:1788540995.030735:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788540995.030744:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+21:10411:x1875420981037312:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788540995.030843:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+21:10411:x1875420981037312:12345-0@lo:502:llog_process_th.0 Request processed in 100us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540995.030851:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788540995.030926:0:10411:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068dd480 going to sleep for 11 seconds 00000100:00100000:0.0:1788540995.030945:0:10411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ed180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:10411:1875420981037312:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788540995.030972:0:10411:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788540995.030978:0:10411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788540995.030980:0:10411:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788540995.030985:0:10411:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788540995.031051:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788540995.031068:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788540995.031079:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a775f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7766 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540995.031091:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a775f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7766 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788540995.031102:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788540995.031105:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a683533b800 from 4 10000000:01000000:0.0:1788540995.031114:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788540995.031139:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75ee00/0x2aac941e5f4a776d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540995.031148:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a682e75ee00/0x2aac941e5f4a776d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540995.031156:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a682e75ee00/0x2aac941e5f4a776d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540995.031168:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981037440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788540995.031193:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540995.031206:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068dd480 going to sleep for 11 seconds 00000100:00100000:0.0:1788540995.031218:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981037440 00000100:00100000:0.0:1788540995.031221:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981037440 00000100:00100000:0.0:1788540995.031242:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788540995.031248:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807636850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+21:6514:x1875420981037440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788540995.031257:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788540995.031268:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a682e75fc00/0x2aac941e5f4a7774 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a776d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540995.031288:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a682e75fc00/0x2aac941e5f4a7774 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a776d expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540995.031297:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a682e75fc00/0x2aac941e5f4a7774 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a776d expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540995.031305:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75fc00, rc 0) 00000100:00100000:0.0:1788540995.031332:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807636850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+22:6514:x1875420981037440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540995.031347:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788540995.031380:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981037440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788540995.031392:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a682e75ee00/0x2aac941e5f4a776d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7774 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540995.031400:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a682e75ee00/0x2aac941e5f4a776d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a7774 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540995.031444:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981037568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788540995.031468:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540995.031481:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068dd480 going to sleep for 11 seconds 00000100:00100000:0.0:1788540995.031492:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981037568 00000100:00100000:0.0:1788540995.031495:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981037568 00000100:00100000:0.0:1788540995.031516:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788540995.031522:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e78bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+22:6514:x1875420981037568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788540995.040890:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e78bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+22:6514:x1875420981037568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 9343us (9397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540995.040906:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788540995.040966:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981037568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788540995.041026:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981037696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788540995.041084:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540995.041118:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068dd480 going to sleep for 11 seconds 00000100:00100000:0.0:1788540995.041140:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981037696 00000100:00100000:0.0:1788540995.041147:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981037696 00000100:00100000:0.0:1788540995.041194:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788540995.041211:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e78a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+22:6514:x1875420981037696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788540995.041313:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e78a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+22:6514:x1875420981037696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 103us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540995.041320:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788540995.041379:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981037696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788540995.042924:0:10414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706832a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:10414:1875420981037824:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788540995.042985:0:10414:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540995.043017:0:10414:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6706ab49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788540995.043070:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981037824 00000100:00100000:0.0:1788540995.043076:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981037824 00000100:00100000:0.0:1788540995.043110:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788540995.043118:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e78a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+22:10414:x1875420981037824:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788540995.043213:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e78a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+22:10414:x1875420981037824:12345-0@lo:502:llog_process_th.0 Request processed in 96us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540995.043221:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788540995.043302:0:10414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706832a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:10414:1875420981037824:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788540995.043325:0:10414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788540995.043334:0:10414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788540995.043336:0:10414:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788540995.043342:0:10414:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a683533b800 00000020:00000080:3.0:1788540995.043344:0:10414:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788540995.043414:0:10414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706832a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:10414:1875420981037952:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788540995.043442:0:10414:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540995.043453:0:10414:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6706ab49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788540995.044106:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981037952 00000100:00100000:0.0:1788540995.044114:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981037952 00000100:00100000:0.0:1788540995.044152:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788540995.044159:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e78a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+22:10414:x1875420981037952:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788540995.053866:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e78a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+22:10414:x1875420981037952:12345-0@lo:502:llog_process_th.0 Request processed in 9696us (10411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540995.053896:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788540995.057164:0:10414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706832a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:10414:1875420981037952:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788540995.057220:0:10414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788540995.057228:0:10414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788540995.057230:0:10414:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788540995.057234:0:10414:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788540995.057407:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788540995.057436:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788540995.057451:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75ee00/0x2aac941e5f4a776d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7774 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540995.057464:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a682e75ee00/0x2aac941e5f4a776d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7774 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788540995.057476:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788540995.057484:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a6839117000 from 4 10000000:01000000:2.0:1788540995.057488:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788540995.057530:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551a000/0x2aac941e5f4a777b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540995.057539:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a683551a000/0x2aac941e5f4a777b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540995.057550:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a683551a000/0x2aac941e5f4a777b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540995.057575:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981038080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788540995.057662:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540995.057704:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6835519d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788540995.057855:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981038080 00000100:00100000:3.0:1788540995.057862:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981038080 00000100:00100000:3.0:1788540995.057930:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788540995.057938:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e788c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+22:6514:x1875420981038080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788540995.057958:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788540995.057971:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6842172000/0x2aac941e5f4a7782 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a777b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540995.057994:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6842172000/0x2aac941e5f4a7782 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a777b expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540995.058005:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6842172000/0x2aac941e5f4a7782 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a777b expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540995.058014:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6842172000, rc 0) 00000100:00100000:3.0:1788540995.058427:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e788c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+23:6514:x1875420981038080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 488us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540995.058434:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788540995.058581:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981038080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788540995.058607:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a683551a000/0x2aac941e5f4a777b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7782 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788540995.058617:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a683551a000/0x2aac941e5f4a777b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a7782 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788540995.058696:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981038208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788540995.058727:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788540995.058837:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068dd900 going to sleep for 11 seconds 00000100:00100000:2.0:1788540995.058924:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981038208 00000100:00100000:2.0:1788540995.058929:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981038208 00000100:00100000:2.0:1788540995.058975:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788540995.058983:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e78b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+23:6514:x1875420981038208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788540995.059095:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e78b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+23:6514:x1875420981038208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540995.059102:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788540995.059125:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981038208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788540995.059158:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981038336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788540995.059196:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540995.059211:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6835519c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788540995.059227:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981038336 00000100:00100000:2.0:1788540995.059230:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981038336 00000100:00100000:2.0:1788540995.059244:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788540995.059257:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e78b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+23:6514:x1875420981038336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788540995.059328:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e78b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+23:6514:x1875420981038336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540995.059335:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788540995.059376:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981038336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788540995.059549:0:10415:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:10415:1875420981038464:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788540995.059583:0:10415:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540995.059622:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981038464 00000100:00100000:2.0:1788540995.059626:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981038464 00000100:00100000:2.0:1788540995.059643:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788540995.059648:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e789450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+23:10415:x1875420981038464:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788540995.059718:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e789450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+23:10415:x1875420981038464:12345-0@lo:502:llog_process_th.0 Request processed in 69us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540995.059724:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788540995.059753:0:10415:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6835519d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788540995.059764:0:10415:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:10415:1875420981038464:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788540995.059783:0:10415:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788540995.059794:0:10415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788540995.059796:0:10415:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788540995.059802:0:10415:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a6839117000 00000020:00000080:2.0:1788540995.059805:0:10415:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788540995.060009:0:10415:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:10415:1875420981038592:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788540995.060042:0:10415:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540995.060062:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981038592 00000100:00100000:2.0:1788540995.060066:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981038592 00000100:00100000:2.0:1788540995.060089:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788540995.060095:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e789c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+23:10415:x1875420981038592:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788540995.060151:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e789c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+23:10415:x1875420981038592:12345-0@lo:502:llog_process_th.0 Request processed in 56us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540995.060157:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788540995.060183:0:10415:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068fdb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788540995.060195:0:10415:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:10415:1875420981038592:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788540995.060212:0:10415:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788540995.060216:0:10415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788540995.060218:0:10415:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788540995.060221:0:10415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788540995.060264:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788540995.060281:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788540995.060288:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551a000/0x2aac941e5f4a777b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7782 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540995.060297:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a683551a000/0x2aac941e5f4a777b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7782 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788540995.060308:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788540995.060310:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a68112dc000 from 4 10000000:01000000:2.0:1788540995.060313:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788540995.060335:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551b800/0x2aac941e5f4a7789 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540995.060343:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a683551b800/0x2aac941e5f4a7789 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540995.060351:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a683551b800/0x2aac941e5f4a7789 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540995.060369:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981038720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788540995.060393:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540995.060405:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068fdb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788540995.060416:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981038720 00000100:00100000:2.0:1788540995.060420:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981038720 00000100:00100000:2.0:1788540995.060435:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788540995.060440:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+23:6514:x1875420981038720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788540995.060448:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788540995.060458:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a683551a600/0x2aac941e5f4a7790 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a7789 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540995.060478:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a683551a600/0x2aac941e5f4a7790 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a7789 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540995.060489:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a683551a600/0x2aac941e5f4a7790 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a7789 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540995.060497:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a683551a600, rc 0) 00000100:00100000:2.0:1788540995.060522:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+24:6514:x1875420981038720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 82us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540995.060528:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788540995.060554:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981038720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788540995.060564:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a683551b800/0x2aac941e5f4a7789 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7790 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540995.060572:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a683551b800/0x2aac941e5f4a7789 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a7790 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788540995.060629:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981038848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788540995.060653:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540995.060666:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068fdb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788540995.060676:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981038848 00000100:00100000:2.0:1788540995.060679:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981038848 00000100:00100000:2.0:1788540995.060695:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788540995.060700:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+24:6514:x1875420981038848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788540995.060772:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+24:6514:x1875420981038848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 71us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540995.060778:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788540995.060804:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981038848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788540995.060826:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981038976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788540995.060859:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540995.060892:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068fdb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788540995.060903:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981038976 00000100:00100000:2.0:1788540995.060906:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981038976 00000100:00100000:2.0:1788540995.060922:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788540995.060927:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+24:6514:x1875420981038976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788540995.060987:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+24:6514:x1875420981038976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 59us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540995.060994:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788540995.061030:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981038976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788540995.064493:0:10416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706832a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:10416:1875420981039104:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788540995.064569:0:10416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540995.066744:0:10416:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6706ab4300 going to sleep for 11 seconds 00000100:00100000:0.0:1788540995.068863:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981039104 00000100:00100000:0.0:1788540995.068891:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981039104 00000100:00100000:0.0:1788540995.068961:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788540995.068972:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+24:10416:x1875420981039104:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788540995.069553:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+24:10416:x1875420981039104:12345-0@lo:502:llog_process_th.0 Request processed in 581us (4981us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540995.069561:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788540995.078862:0:10416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706832a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:10416:1875420981039104:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788540995.078938:0:10416:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788540995.078956:0:10416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788540995.078959:0:10416:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788540995.078965:0:10416:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a68112dc000 00000020:00000080:3.0:1788540995.078968:0:10416:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788540995.079069:0:10416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706832a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:10416:1875420981039232:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788540995.079144:0:10416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540995.079184:0:10416:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6706ab4300 going to sleep for 11 seconds 00000100:00100000:1.0:1788540995.080897:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981039232 00000100:00100000:1.0:1788540995.080914:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981039232 00000100:00100000:1.0:1788540995.080980:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788540995.080993:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+24:10416:x1875420981039232:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788540995.081181:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+24:10416:x1875420981039232:12345-0@lo:502:llog_process_th.0 Request processed in 189us (2037us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540995.081190:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788540995.082793:0:10416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706832a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:10416:1875420981039232:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788540995.082865:0:10416:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788540995.082890:0:10416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788540995.082893:0:10416:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788540995.082898:0:10416:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788540995.083102:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788540995.083128:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788540995.083139:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551b800/0x2aac941e5f4a7789 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7790 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788540995.083150:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a683551b800/0x2aac941e5f4a7789 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7790 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788540995.697264:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788540995.697435:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955810304 00000100:00100000:3.0:1788540995.697446:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955810304 00000100:00100000:3.0:1788540995.697505:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 270 00000100:00100000:3.0:1788540995.697514:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+9:6168:x1875420955810304:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788540995.697530:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788540995.697547:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6842173800/0x2aac941e5f4a7797 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16473202a331103 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540995.697573:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6842173800/0x2aac941e5f4a7797 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331103 expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540995.697595:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6842173800/0x2aac941e5f4a7797 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331103 expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788540995.697604:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6842173800, rc 0) 00000100:00100000:3.0:1788540995.697674:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+10:6168:x1875420955810304:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 Request processed in 161us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540995.697681:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 270 00000100:00100000:3.0:1788540995.703704:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788540995.703787:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955810432 00000100:00100000:1.0:1788540995.703798:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955810432 00000100:00100000:1.0:1788540995.703853:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 271 00000100:00100000:1.0:1788540995.703863:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+10:6168:x1875420955810432:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788540995.704052:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+10:6168:x1875420955810432:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 Request processed in 190us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540995.704060:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 271 00000100:00100000:0.0:1788540995.724831:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788540995.726864:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955810560 00000100:00100000:2.0:1788540995.726895:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955810560 00000100:00100000:2.0:1788540995.726952:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 272 00000100:00100000:2.0:1788540995.726964:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+10:6168:x1875420955810560:12345-192.168.202.56@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788540995.727106:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+10:6168:x1875420955810560:12345-192.168.202.56@tcp:503:ll_cfg_requeue.0 Request processed in 143us (2284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540995.727114:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 272 00000100:00100000:3.0:1788540995.734849:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788540995.738322:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955810688 00000100:00100000:0.0:1788540995.738337:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955810688 00000100:00100000:0.0:1788540995.738415:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 273 00000100:00100000:0.0:1788540995.738425:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+10:6702:x1875420955810688:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788540995.738568:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+10:6702:x1875420955810688:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 143us (3728us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540995.738576:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 273 00000100:00100000:2.0:1788540995.748822:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788540995.748893:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955810816 00000100:00100000:2.0:1788540995.748903:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955810816 00000100:00100000:2.0:1788540995.748960:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 274 00000100:00100000:2.0:1788540995.748970:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+10:6702:x1875420955810816:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788540995.749113:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+10:6702:x1875420955810816:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 144us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540995.749121:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 274 00010000:00010000:2.0:1788540996.043015:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788540997.067513:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788540997.925826:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788540997.925865:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788540997.925914:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788540997.925941:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955811072 00000100:00100000:1.0:1788540997.925943:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788540997.925955:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955811072 00000100:00100000:1.0:1788540997.925971:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788540997.926020:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955811200 00000100:00100000:2.0:1788540997.926023:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955811200 00000100:00100000:3.0:1788540997.926055:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955810944 00000100:00100000:3.0:1788540997.926067:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955810944 00000100:00100000:2.0:1788540997.926109:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 71 00000100:00100000:2.0:1788540997.926121:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+6:2395:x1875420955811072:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788540997.926128:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 275 00000100:00100000:3.0:1788540997.926138:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+10:2395:x1875420955810944:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1788540997.926213:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+6:2395:x1875420955811072:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 81us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540997.926221:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 71 00000100:00100000:2.0:1788540997.926240:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 72 00000100:00100000:2.0:1788540997.926247:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+5:2395:x1875420955811200:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788540997.926376:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955811456 00000100:00100000:0.0:1788540997.926380:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955811456 00000100:00100000:0.0:1788540997.926418:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955811328 00000100:00100000:0.0:1788540997.926422:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955811328 00000100:00100000:0.0:1788540997.926441:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 21 00000100:00100000:0.0:1788540997.926448:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:384f52e3-0481-4979-9299-157aff7472d2+5:2395:x1875420955811456:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1788540997.926989:0:8973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 22 00000100:00100000:1.0:1788540997.927000:0:8973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706879500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:384f52e3-0481-4979-9299-157aff7472d2+5:2394:x1875420955811328:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788540997.927453:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+10:2395:x1875420955810944:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 1315us (1634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540997.927463:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 275 00000100:00080000:3.0:1788540997.927524:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788540997.927528:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788540997.927531:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788540997.927533:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788540997.928029:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+5:2395:x1875420955811200:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 1780us (2112us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540997.928038:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 72 00000100:00100000:0.0:1788540997.929486:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:384f52e3-0481-4979-9299-157aff7472d2+5:2395:x1875420955811456:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 3031us (3536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788540997.929513:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 21 00000100:00100000:1.0:1788540997.945137:0:8973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706879500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:384f52e3-0481-4979-9299-157aff7472d2+5:2394:x1875420955811328:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 18127us (19154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788540997.945155:0:8973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 22 00000100:00100000:2.0:1788540998.090173:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706832a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981039360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788540998.090255:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540998.090366:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981039360 00000100:00100000:3.0:1788540998.090375:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981039360 00000100:00100000:3.0:1788540998.090439:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788540998.090450:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981039360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788540998.090478:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788540998.090529:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981039360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540998.090537:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1788540998.090589:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6706832a00 x1875420981039360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541014 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540998.090608:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706832a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981039360:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788540998.090658:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788540998.090997:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788540998.091083:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981039488:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788540998.091118:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540998.091156:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788540998.091162:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706832a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981039616:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788540998.091187:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788540998.091211:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981039616 00000100:00100000:3.0:1788540998.091215:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981039616 00000100:00100000:3.0:1788540998.091245:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788540998.091267:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f0fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981039616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788540998.091281:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788540998.091313:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f0fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981039616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788540998.091319:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1788540998.091335:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788540998.091352:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6706832a00 x1875420981039616/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541014 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788540998.091365:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706832a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981039616:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788540998.091415:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981039488 00000100:00100000:2.0:1788540998.091419:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981039488 00000100:00100000:2.0:1788540998.091451:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788540998.091458:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981039488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788540998.091480:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788540998.091514:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981039488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 56us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540998.091520:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788540998.091589:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981039488:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788540998.604475:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788540998.604502:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981039744:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788540998.604597:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788540998.604796:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981039744 00000100:00100000:2.0:1788540998.604805:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981039744 00000100:00100000:2.0:1788540998.604858:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788540998.604867:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f0ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981039744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788540998.604946:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788540998.605003:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f0ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981039744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 137us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788540998.605011:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788540998.605093:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981039744:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788540999.114010:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541000.138233:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981039872:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788541000.138323:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541000.138416:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981039872 00000100:00100000:3.0:1788541000.138424:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981039872 00000100:00100000:3.0:1788541000.138487:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788541000.138498:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706832a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981039872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788541000.138531:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788541000.138588:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706832a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981039872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541000.138595:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1788541000.138615:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788541000.138639:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67078ec700 x1875420981039872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541016 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541000.138670:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981039872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788541000.138861:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788541000.138898:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981040000:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788541000.138930:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541000.138995:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981040000 00000100:00100000:0.0:1788541000.139000:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981040000 00000100:00100000:0.0:1788541000.139037:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788541000.139045:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670687b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981040000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788541000.139067:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788541000.139104:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670687b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981040000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541000.139111:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1788541000.139140:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67078ec000 x1875420981040000/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541016 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541000.139153:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981040000:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788541000.139258:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788541000.140246:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670687a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875420981040256:0@lo:400:kworker.0 00000100:00100000:1.0:1788541000.140316:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541000.140349:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670687a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875420981040768:0@lo:400:kworker.0 00000100:00100000:1.0:1788541000.140372:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541000.140395:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670687aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875420981041280:0@lo:400:kworker.0 00000100:00100000:1.0:1788541000.140415:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541000.140435:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788541000.140441:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706878a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981040384:0@lo:400:kworker.0 00000100:00100000:1.0:1788541000.140465:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541000.140484:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706879180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875420981040896:0@lo:400:kworker.0 00000100:00100000:1.0:1788541000.140503:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541000.140519:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706878e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875420981041408:0@lo:400:kworker.0 00000100:00100000:1.0:1788541000.140549:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541000.140574:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981040256 00000100:00100000:1.0:1788541000.140580:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981040256 00000100:00100000:1.0:1788541000.140610:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981040768 00000100:00100000:1.0:1788541000.140612:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981040768 00000100:00100000:1.0:1788541000.140630:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981041280 00000100:00100000:1.0:1788541000.140632:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981041280 00000100:00100000:1.0:1788541000.140642:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981040896 00000100:00100000:1.0:1788541000.140645:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981040896 00000100:00100000:1.0:1788541000.140654:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981041408 00000100:00100000:1.0:1788541000.140656:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981041408 00000100:00100000:1.0:1788541000.140670:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788541000.140677:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708031880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875420981040256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541000.140717:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708031880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875420981040256:12345-0@lo:400:kworker.0 Request processed in 40us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541000.140733:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788541000.140751:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788541000.140757:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708033b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875420981040768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541000.140784:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708033b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875420981040768:12345-0@lo:400:kworker.0 Request processed in 27us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541000.140790:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788541000.140802:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788541000.140808:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708033800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875420981041280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541000.140835:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708033800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875420981041280:12345-0@lo:400:kworker.0 Request processed in 28us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541000.140840:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788541000.140850:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788541000.140855:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708032300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875420981040896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541000.140903:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708032300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875420981040896:12345-0@lo:400:kworker.0 Request processed in 47us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541000.140908:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788541000.140918:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788541000.140924:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708031f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875420981041408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541000.140947:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708031f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875420981041408:12345-0@lo:400:kworker.0 Request processed in 24us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541000.140953:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788541000.140971:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981040384 00000100:00100000:1.0:1788541000.140975:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981040384 00000100:00100000:1.0:1788541000.140996:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788541000.141002:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708032d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981040384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541000.141040:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708032d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981040384:12345-0@lo:400:kworker.0 Request processed in 37us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541000.141046:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788541000.141067:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706879f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875420981040512:0@lo:400:kworker.0 00000100:00100000:1.0:1788541000.141088:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541000.141105:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981041024:0@lo:400:kworker.0 00000100:00100000:1.0:1788541000.141125:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541000.141142:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788541000.141147:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706879c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420981040128:0@lo:400:kworker.0 00000100:00100000:1.0:1788541000.141172:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541000.141205:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670687b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981040640:0@lo:400:kworker.0 00000100:00100000:1.0:1788541000.141225:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541000.141241:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706878380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981041152:0@lo:400:kworker.0 00000100:00100000:1.0:1788541000.141259:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788541000.141279:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788541000.141283:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788541000.141290:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981040640 00000100:00100000:1.0:1788541000.141293:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981040640 00000100:00100000:1.0:1788541000.141310:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788541000.141316:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708031180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981040640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541000.141347:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708031180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981040640:12345-0@lo:400:kworker.0 Request processed in 31us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541000.141353:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788541000.141387:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670687b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981040640:0@lo:400:kworker.0 00000100:00100000:1.0:1788541000.141415:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706878a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981040384:0@lo:400:kworker.0 00010000:00080000:1.0:1788541000.141435:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6706879180 x1875420981040896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541016 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541000.141447:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706879180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875420981040896:0@lo:400:kworker.0 00010000:00080000:1.0:1788541000.141456:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6706878e00 x1875420981041408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541016 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541000.141464:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706878e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875420981041408:0@lo:400:kworker.0 00000100:00100000:1.0:1788541000.141474:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670687a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875420981040256:0@lo:400:kworker.0 00000100:00100000:1.0:1788541000.141482:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670687a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875420981040768:0@lo:400:kworker.0 00000100:00100000:1.0:1788541000.141491:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670687aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875420981041280:0@lo:400:kworker.0 00000100:00100000:1.0:1788541000.141518:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981040512 00000100:00100000:1.0:1788541000.141521:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981040512 00000100:00100000:1.0:1788541000.141555:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788541000.141561:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708033100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875420981040512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541000.141595:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708033100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875420981040512:12345-0@lo:400:kworker.0 Request processed in 34us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541000.141600:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788541000.141624:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706879f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875420981040512:0@lo:400:kworker.0 00000100:00100000:2.0:1788541000.141728:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981040128 00000100:00100000:2.0:1788541000.141733:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981040128 00000100:00100000:2.0:1788541000.141761:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1788541000.141767:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+24:3641:x1875420981040128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541000.141804:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+24:3641:x1875420981040128:12345-0@lo:400:kworker.0 Request processed in 37us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541000.141809:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00010000:00010000:3.0:1788541000.144100:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541000.144136:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981041024 00000100:00100000:3.0:1788541000.144145:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981041024 00000100:00100000:3.0:1788541000.144209:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981041152 00000100:00100000:3.0:1788541000.144212:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981041152 00000100:00100000:3.0:1788541000.144240:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788541000.144249:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708031c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981041024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541000.144321:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708031c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981041024:12345-0@lo:400:kworker.0 Request processed in 74us (3194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541000.144329:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788541000.144345:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788541000.144351:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708030a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981041152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541000.144381:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708030a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981041152:12345-0@lo:400:kworker.0 Request processed in 31us (3121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541000.144386:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788541000.147943:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706879c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420981040128:0@lo:400:kworker.0 00010000:00080000:1.0:1788541000.147970:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6706878380 x1875420981041152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541016 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541000.147982:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706878380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981041152:0@lo:400:kworker.0 00010000:00080000:1.0:1788541000.147995:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6706878700 x1875420981041024/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541016 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541000.148016:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981041024:0@lo:400:kworker.0 00000100:00080000:2.0:1788541000.152648:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788541001.162273:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788541001.267203:0:10691:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg256-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1788541002.188076:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541003.044502:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541003.044556:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541003.044609:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541003.044638:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541003.044657:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541003.044683:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955812096 00000100:00100000:3.0:1788541003.044693:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955812096 00000100:00100000:3.0:1788541003.044760:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955811968 00000100:00100000:3.0:1788541003.044764:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955811968 00000100:00100000:3.0:1788541003.044789:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 25 00000100:00100000:3.0:1788541003.044800:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:384f52e3-0481-4979-9299-157aff7472d2+5:2394:x1875420955812096:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541003.044914:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:384f52e3-0481-4979-9299-157aff7472d2+5:2394:x1875420955812096:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 115us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541003.044923:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 25 00000100:00100000:3.0:1788541003.044943:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 26 00000100:00100000:3.0:1788541003.044950:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:384f52e3-0481-4979-9299-157aff7472d2+5:2394:x1875420955811968:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541003.044974:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:384f52e3-0481-4979-9299-157aff7472d2+5:2394:x1875420955811968:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 25us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541003.044981:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 26 00000100:00080000:3.0:1788541003.044999:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788541003.045003:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788541003.045395:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955811584 00000100:00100000:0.0:1788541003.045400:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955811584 00000100:00100000:0.0:1788541003.045434:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 277 00000100:00100000:0.0:1788541003.045444:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+10:2394:x1875420955811584:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541003.045481:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+10:2394:x1875420955811584:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 39us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541003.045488:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 277 00000100:00100000:1.0:1788541003.045607:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955811840 00000100:00100000:1.0:1788541003.045612:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955811840 00000100:00100000:1.0:1788541003.045659:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955811712 00000100:00100000:1.0:1788541003.045663:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955811712 00000100:00100000:1.0:1788541003.045681:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 79 00000100:00100000:1.0:1788541003.045689:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+5:2394:x1875420955811840:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1788541003.045725:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+5:2394:x1875420955811840:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 37us (1169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541003.045732:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 79 00000100:00100000:1.0:1788541003.045746:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 80 00000100:00100000:1.0:1788541003.045753:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+6:2394:x1875420955811712:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1788541003.045776:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+6:2394:x1875420955811712:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 24us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541003.045782:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 80 00000100:00080000:0.0:1788541003.046086:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788541003.046091:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788541003.224173:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981041536:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788541003.224261:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541003.224325:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788541003.224334:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981041664:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788541003.224359:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541003.224394:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981041792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788541003.224416:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788541003.225181:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541003.226222:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981041536 00000100:00100000:3.0:1788541003.226234:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981041536 00000100:00100000:3.0:1788541003.226286:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788541003.226295:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981041536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788541003.226617:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788541003.226696:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981041536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 402us (2435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541003.226704:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788541003.226727:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981041664 00000100:00100000:3.0:1788541003.226730:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981041664 00000100:00100000:3.0:1788541003.226756:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981041792 00000100:00100000:3.0:1788541003.226758:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981041792 00000100:00100000:3.0:1788541003.226770:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788541003.226775:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981041664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788541003.226794:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788541003.226822:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981041664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 46us (2461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541003.226828:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788541003.226838:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788541003.226843:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981041792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788541003.226852:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788541003.226892:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981041792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (2475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541003.226897:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1788541003.226937:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707b71c00 x1875420981041664/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541019 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541003.226958:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981041664:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788541003.226971:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981041536:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1788541003.227000:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788541003.227030:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707b71180 x1875420981041792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541019 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541003.227044:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981041792:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788541003.735497:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788541003.735535:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981041920:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788541003.735610:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541003.736397:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981041920 00000100:00100000:3.0:1788541003.736408:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981041920 00000100:00100000:3.0:1788541003.736466:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788541003.736477:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708032680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981041920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788541003.736527:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788541003.736599:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708032680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981041920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 124us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541003.736606:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788541003.736866:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981041920:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788541004.235124:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541005.258069:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981042048:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788541005.258143:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541005.258214:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981042048 00000100:00100000:1.0:1788541005.258222:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981042048 00000100:00100000:1.0:1788541005.258273:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788541005.258295:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708030380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981042048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788541005.258337:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788541005.258381:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708030380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981042048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541005.258388:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1788541005.258408:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788541005.258438:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67078ec000 x1875420981042048/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541021 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541005.258456:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981042048:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788541005.258729:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875420981042304:0@lo:400:kworker.0 00000100:00100000:0.0:1788541005.258768:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541005.258787:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875420981042816:0@lo:400:kworker.0 00000100:00100000:0.0:1788541005.258805:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541005.258820:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670772b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875420981043328:0@lo:400:kworker.0 00000100:00100000:0.0:1788541005.258837:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541005.258855:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788541005.258860:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981042432:0@lo:400:kworker.0 00000100:00100000:0.0:1788541005.258913:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541005.258931:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875420981042944:0@lo:400:kworker.0 00000100:00100000:0.0:1788541005.258950:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541005.258965:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707729f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875420981043456:0@lo:400:kworker.0 00000100:00100000:0.0:1788541005.258997:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541005.259023:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981042304 00000100:00100000:0.0:1788541005.259027:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981042304 00000100:00100000:0.0:1788541005.259049:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981042816 00000100:00100000:0.0:1788541005.259051:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981042816 00000100:00100000:0.0:1788541005.259067:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981043328 00000100:00100000:0.0:1788541005.259070:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981043328 00000100:00100000:0.0:1788541005.259081:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981042944 00000100:00100000:0.0:1788541005.259083:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981042944 00000100:00100000:0.0:1788541005.259093:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981043456 00000100:00100000:0.0:1788541005.259095:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981043456 00000100:00100000:0.0:1788541005.259107:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788541005.259113:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670772ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875420981042304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541005.259148:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670772ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875420981042304:12345-0@lo:400:kworker.0 Request processed in 35us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541005.259155:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788541005.259173:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788541005.259179:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707729180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875420981042816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541005.259204:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707729180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875420981042816:12345-0@lo:400:kworker.0 Request processed in 25us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541005.259210:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788541005.259219:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788541005.259225:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670772a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875420981043328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541005.259247:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670772a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875420981043328:12345-0@lo:400:kworker.0 Request processed in 23us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541005.259253:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788541005.259262:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788541005.259267:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875420981042944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541005.259289:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875420981042944:12345-0@lo:400:kworker.0 Request processed in 22us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541005.259295:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788541005.259304:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788541005.259308:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875420981043456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541005.259331:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875420981043456:12345-0@lo:400:kworker.0 Request processed in 22us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541005.259336:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788541005.259359:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981042432 00000100:00100000:0.0:1788541005.259362:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981042432 00000100:00100000:0.0:1788541005.259385:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788541005.259390:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707729880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981042432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541005.259417:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707729880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981042432:12345-0@lo:400:kworker.0 Request processed in 27us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541005.259429:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1788541005.259449:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788541005.259452:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788541005.259460:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875420981042560:0@lo:400:kworker.0 00000100:00100000:0.0:1788541005.259482:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541005.259512:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981043072:0@lo:400:kworker.0 00000100:00100000:0.0:1788541005.259535:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541005.259552:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707728700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981043584:0@lo:400:kworker.0 00000100:00100000:0.0:1788541005.259571:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541005.259590:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788541005.259596:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420981042176:0@lo:400:kworker.0 00000100:00100000:0.0:1788541005.259619:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541005.259641:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981042688:0@lo:400:kworker.0 00000100:00100000:0.0:1788541005.259658:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541005.259671:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981043200:0@lo:400:kworker.0 00000100:00100000:0.0:1788541005.259689:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541005.259713:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981043072 00000100:00100000:0.0:1788541005.259716:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981043072 00000100:00100000:0.0:1788541005.259744:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981043584 00000100:00100000:0.0:1788541005.259746:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981043584 00000100:00100000:0.0:1788541005.259758:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981043200 00000100:00100000:0.0:1788541005.259760:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981043200 00000100:00100000:0.0:1788541005.259771:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788541005.259777:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708080a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981043072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541005.259808:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708080a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981043072:12345-0@lo:400:kworker.0 Request processed in 32us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541005.259822:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788541005.259832:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788541005.259837:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708082680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981043584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541005.259861:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708082680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981043584:12345-0@lo:400:kworker.0 Request processed in 24us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541005.259865:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788541005.259890:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788541005.259896:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708080e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981043200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541005.259918:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708080e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981043200:12345-0@lo:400:kworker.0 Request processed in 23us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541005.259922:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788541005.259940:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981042176 00000100:00100000:0.0:1788541005.259943:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981042176 00000100:00100000:0.0:1788541005.259962:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1788541005.259967:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+24:3641:x1875420981042176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541005.259992:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+24:3641:x1875420981042176:12345-0@lo:400:kworker.0 Request processed in 25us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541005.259997:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00080000:0.0:1788541005.260046:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788541005.260049:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788541005.260055:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981042688 00000100:00100000:0.0:1788541005.260058:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981042688 00000100:00100000:0.0:1788541005.260075:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788541005.260080:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981042688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541005.260081:0:6522:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1788541005.260088:0:6522:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1788541005.260107:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981042688:12345-0@lo:400:kworker.0 Request processed in 26us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541005.260122:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788541005.260155:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981042432:0@lo:400:kworker.0 00010000:00080000:0.0:1788541005.260167:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67078ec000 x1875420981042944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541005.260177:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875420981042944:0@lo:400:kworker.0 00000100:00100000:2.0:1788541005.261842:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981043712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788541005.261931:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788541005.262066:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1788541005.262480:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707729f80 x1875420981043456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541005.262511:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707729f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875420981043456:0@lo:400:kworker.0 00000100:00100000:0.0:1788541005.262538:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875420981042304:0@lo:400:kworker.0 00000100:00100000:0.0:1788541005.262551:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875420981042816:0@lo:400:kworker.0 00000100:00100000:0.0:1788541005.262562:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670772b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875420981043328:0@lo:400:kworker.0 00000100:00100000:0.0:1788541005.262602:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981042560 00000100:00100000:0.0:1788541005.262609:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981042560 00000100:00100000:0.0:1788541005.262690:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788541005.262699:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708081180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875420981042560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541005.262755:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708081180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875420981042560:12345-0@lo:400:kworker.0 Request processed in 57us (3271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541005.262762:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788541005.262837:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981043712 00000100:00100000:1.0:1788541005.262842:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981043712 00000100:00100000:1.0:1788541005.262892:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788541005.262902:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981043712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788541005.262918:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788541005.262960:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981043712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541005.262967:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1788541005.262994:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6708083480 x1875420981043712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541021 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541005.263009:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708083480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981043712:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788541005.263145:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420981042176:0@lo:400:kworker.0 00000100:00100000:0.0:1788541005.263163:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981042688:0@lo:400:kworker.0 00010000:00080000:0.0:1788541005.263180:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67078ed180 x1875420981043200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541005.263197:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981043200:0@lo:400:kworker.0 00000100:00100000:0.0:1788541005.263215:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875420981042560:0@lo:400:kworker.0 00010000:00080000:0.0:1788541005.263233:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67078ec700 x1875420981043072/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541005.263242:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981043072:0@lo:400:kworker.0 00010000:00080000:0.0:1788541005.263252:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707728700 x1875420981043584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541005.263261:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707728700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981043584:0@lo:400:kworker.0 00010000:00010000:0.0:1788541006.283035:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788541006.330678:0:10936:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg256-server.virtnet: executing yml_node 00010000:00010000:2.0:1788541007.307138:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541008.166066:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541008.166125:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541008.166161:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541008.166319:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955812480 00000100:00100000:1.0:1788541008.166329:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955812480 00000100:00100000:1.0:1788541008.166400:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955812352 00000100:00100000:1.0:1788541008.166404:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955812352 00000100:00100000:1.0:1788541008.166427:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 87 00000100:00100000:1.0:1788541008.166437:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+5:2395:x1875420955812480:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1788541008.166539:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+5:2395:x1875420955812480:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 103us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541008.166547:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 87 00000100:00100000:1.0:1788541008.166565:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 88 00000100:00100000:1.0:1788541008.166571:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+6:2395:x1875420955812352:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1788541008.166594:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+6:2395:x1875420955812352:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 24us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541008.166599:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 88 00000100:00080000:3.0:1788541008.167323:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788541008.167329:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788541008.167671:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955812224 00000100:00100000:2.0:1788541008.167678:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955812224 00000100:00100000:2.0:1788541008.167735:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 279 00000100:00100000:2.0:1788541008.167744:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+10:2395:x1875420955812224:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1788541008.167802:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+10:2395:x1875420955812224:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 59us (1746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541008.167809:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 279 00000100:00100000:3.0:1788541008.171213:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541008.171255:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541008.171552:0:8973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955812608 00000100:00100000:1.0:1788541008.171563:0:8973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955812608 00000100:00100000:1.0:1788541008.171640:0:8973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955812736 00000100:00100000:1.0:1788541008.171644:0:8973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955812736 00000100:00100000:1.0:1788541008.171668:0:8973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 18 00000100:00100000:1.0:1788541008.171678:0:8973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:384f52e3-0481-4979-9299-157aff7472d2+5:2393:x1875420955812608:12345-192.168.202.56@tcp:9:kworker.0 00000020:00000080:1.0:1788541008.171715:0:8973:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a76a9 00000100:00080000:1.0:1788541008.171737:0:8973:0:(import.c:65:import_set_state_nolock()) ffff9a683f191000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788541008.171780:0:8973:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1788541008.171964:0:8973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:384f52e3-0481-4979-9299-157aff7472d2+2:2393:x1875420955812608:12345-192.168.202.56@tcp:9:kworker.0 Request processed in 287us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541008.171972:0:8973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 18 00000100:00100000:1.0:1788541008.171988:0:8973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 19 00000100:00100000:1.0:1788541008.171995:0:8973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:384f52e3-0481-4979-9299-157aff7472d2+5:2393:x1875420955812736:12345-192.168.202.56@tcp:9:kworker.0 00000020:00000080:1.0:1788541008.172008:0:8973:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a76b0 00000100:00080000:1.0:1788541008.172015:0:8973:0:(import.c:65:import_set_state_nolock()) ffff9a6837950800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788541008.172035:0:8973:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1788541008.172130:0:8973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:384f52e3-0481-4979-9299-157aff7472d2+2:2393:x1875420955812736:12345-192.168.202.56@tcp:9:kworker.0 Request processed in 134us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541008.172137:0:8973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 19 00010000:00010000:0.0:1788541008.172533:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541008.172967:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788541008.173084:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788541008.173089:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788541008.333025:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541008.333278:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708081500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981043968:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788541008.333359:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541008.333431:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788541008.333438:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981043840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788541008.333462:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541008.333787:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981043968 00000100:00100000:3.0:1788541008.333796:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981043968 00000100:00100000:3.0:1788541008.333847:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981043840 00000100:00100000:3.0:1788541008.333851:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981043840 00000100:00100000:3.0:1788541008.333888:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788541008.333898:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708080700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981043968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788541008.333950:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788541008.334002:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708080700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981043968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541008.334018:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788541008.334034:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788541008.334041:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708082a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981043840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788541008.334050:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788541008.334075:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708082a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981043840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 35us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541008.334080:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1788541008.334125:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707b71500 x1875420981043840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541024 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541008.334143:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981043840:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1788541008.334156:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6708081500 x1875420981043968/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541024 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541008.334166:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708081500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981043968:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788541008.334858:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788541008.335197:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788541008.335212:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981044096:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788541008.335262:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541008.335404:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981044096 00000100:00100000:0.0:1788541008.335409:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981044096 00000100:00100000:0.0:1788541008.335448:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788541008.335456:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708030e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981044096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788541008.335492:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788541008.335541:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708030e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981044096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541008.335563:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788541008.335697:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981044096:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788541008.844823:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981044224:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788541008.844948:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541008.845264:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981044224 00000100:00100000:2.0:1788541008.845274:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981044224 00000100:00100000:2.0:1788541008.845338:0:10866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788541008.845347:0:10866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708033480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981044224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788541008.845389:0:10866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788541008.845448:0:10866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708033480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981044224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541008.845456:0:10866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788541008.845511:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981044224:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788541009.357125:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541010.379469:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788541010.379492:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981044352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788541010.379573:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541010.379681:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981044352 00000100:00100000:2.0:1788541010.379689:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981044352 00000100:00100000:2.0:1788541010.379739:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788541010.379748:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981044352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788541010.379775:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788541010.379821:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981044352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541010.379827:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1788541010.379847:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788541010.379917:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68355b4000 x1875420981044352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541026 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541010.379935:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981044352:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788541010.380202:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541010.380793:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981044480:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788541010.380827:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541010.385178:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981044480 00000100:00100000:3.0:1788541010.385194:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981044480 00000100:00100000:3.0:1788541010.385279:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788541010.385289:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981044480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788541010.385317:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788541010.385400:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981044480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 111us (4570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541010.385425:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1788541010.386041:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707b71500 x1875420981044480/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541026 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541010.386066:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981044480:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788541010.386351:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788541010.389158:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708030700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875420981044736:0@lo:400:kworker.0 00000100:00100000:1.0:1788541010.389230:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541010.389273:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706878380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875420981045248:0@lo:400:kworker.0 00000100:00100000:1.0:1788541010.389296:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541010.389318:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670687a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875420981045760:0@lo:400:kworker.0 00000100:00100000:1.0:1788541010.389339:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541010.389369:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788541010.389376:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708031500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420981044608:0@lo:400:kworker.0 00000100:00100000:1.0:1788541010.389403:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541010.389424:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981045120:0@lo:400:kworker.0 00000100:00100000:1.0:1788541010.389462:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541010.389483:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670687aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981045632:0@lo:400:kworker.0 00000100:00100000:1.0:1788541010.389520:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541010.389552:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708032a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981044864:0@lo:400:kworker.0 00000100:00100000:1.0:1788541010.389586:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541010.389606:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706879c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875420981045376:0@lo:400:kworker.0 00000100:00100000:1.0:1788541010.389625:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541010.389642:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670687a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875420981045888:0@lo:400:kworker.0 00000100:00100000:1.0:1788541010.389660:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541010.389671:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788541010.389676:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708030000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875420981044992:0@lo:400:kworker.0 00000100:00100000:1.0:1788541010.389696:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541010.389707:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706879f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981045504:0@lo:400:kworker.0 00000100:00100000:1.0:1788541010.389726:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541010.389757:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981044736 00000100:00100000:1.0:1788541010.389765:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981044736 00000100:00100000:1.0:1788541010.389807:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981045248 00000100:00100000:1.0:1788541010.389811:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981045248 00000100:00100000:1.0:1788541010.389834:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981045760 00000100:00100000:1.0:1788541010.389837:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981045760 00000100:00100000:1.0:1788541010.389851:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981045376 00000100:00100000:1.0:1788541010.389853:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981045376 00000100:00100000:1.0:1788541010.389864:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981045888 00000100:00100000:1.0:1788541010.389866:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981045888 00000100:00100000:1.0:1788541010.389919:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981044992 00000100:00100000:1.0:1788541010.389923:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981044992 00000100:00100000:1.0:1788541010.389941:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788541010.389950:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706878e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875420981044736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541010.390006:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706878e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875420981044736:12345-0@lo:400:kworker.0 Request processed in 57us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541010.390015:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788541010.390032:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788541010.390047:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706879180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875420981045248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541010.390080:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706879180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875420981045248:12345-0@lo:400:kworker.0 Request processed in 35us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541010.390086:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788541010.390098:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788541010.390105:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875420981045760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541010.390131:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875420981045760:12345-0@lo:400:kworker.0 Request processed in 27us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541010.390137:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788541010.390148:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788541010.390154:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875420981045376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541010.390187:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875420981045376:12345-0@lo:400:kworker.0 Request processed in 33us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541010.390193:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788541010.390205:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788541010.390210:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707baca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875420981045888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541010.390232:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707baca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875420981045888:12345-0@lo:400:kworker.0 Request processed in 22us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541010.390237:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788541010.390246:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788541010.390250:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875420981044992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541010.390272:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875420981044992:12345-0@lo:400:kworker.0 Request processed in 22us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541010.390277:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788541010.390302:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981044608 00000100:00100000:1.0:1788541010.390311:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981044608 00000100:00100000:1.0:1788541010.390341:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1788541010.390348:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+24:3642:x1875420981044608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541010.390378:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+24:3642:x1875420981044608:12345-0@lo:400:kworker.0 Request processed in 30us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541010.390384:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1788541010.390410:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981045120 00000100:00100000:1.0:1788541010.390414:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981045120 00000100:00100000:1.0:1788541010.390435:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981044864 00000100:00100000:1.0:1788541010.390438:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981044864 00000100:00100000:1.0:1788541010.390462:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788541010.390468:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670687b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981045120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541010.390499:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670687b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981045120:12345-0@lo:400:kworker.0 Request processed in 31us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541010.390505:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788541010.390517:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788541010.390523:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707badc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981044864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541010.390547:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707badc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981044864:12345-0@lo:400:kworker.0 Request processed in 26us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541010.390553:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788541010.390572:0:8973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981045632 00000100:00100000:1.0:1788541010.390576:0:8973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981045632 00000100:00100000:1.0:1788541010.390598:0:8973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981045504 00000100:00100000:1.0:1788541010.390601:0:8973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981045504 00000100:00100000:1.0:1788541010.390620:0:8973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788541010.390625:0:8973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707baf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981045632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541010.390654:0:8973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707baf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981045632:12345-0@lo:400:kworker.0 Request processed in 29us (1133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541010.390668:0:8973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788541010.390679:0:8973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788541010.390685:0:8973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981045504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541010.390713:0:8973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981045504:12345-0@lo:400:kworker.0 Request processed in 28us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541010.390719:0:8973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1788541010.390747:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788541010.390751:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788541010.390753:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788541010.390778:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708031500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420981044608:0@lo:400:kworker.0 00000100:00100000:1.0:1788541010.390789:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981045120:0@lo:400:kworker.0 00010000:00080000:1.0:1788541010.390801:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670687aa00 x1875420981045632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541010.390811:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670687aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981045632:0@lo:400:kworker.0 00000100:00100000:1.0:1788541010.390820:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708030700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875420981044736:0@lo:400:kworker.0 00000100:00100000:1.0:1788541010.390830:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706878380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875420981045248:0@lo:400:kworker.0 00000100:00100000:1.0:1788541010.390839:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670687a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875420981045760:0@lo:400:kworker.0 00000100:00100000:1.0:1788541010.390901:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708030000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875420981044992:0@lo:400:kworker.0 00010000:00080000:1.0:1788541010.390912:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6706879f80 x1875420981045504/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541010.390921:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706879f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981045504:0@lo:400:kworker.0 00000100:00100000:1.0:1788541010.390931:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708032a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981044864:0@lo:400:kworker.0 00010000:00080000:1.0:1788541010.390951:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6706879c00 x1875420981045376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541010.390959:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706879c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875420981045376:0@lo:400:kworker.0 00010000:00080000:1.0:1788541010.390968:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670687a680 x1875420981045888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541010.390975:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670687a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875420981045888:0@lo:400:kworker.0 00000001:02000400:2.0:1788541010.617769:0:11120:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.2 00010000:00010000:1.0:1788541011.402063:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541012.430314:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788541012.952755:0:11217:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.2 00000100:00100000:0.0:1788541013.283021:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541013.283082:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541013.283110:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541013.283161:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955812864 00000100:00100000:0.0:1788541013.283171:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955812864 00000100:00100000:0.0:1788541013.283224:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 281 00000100:00100000:0.0:1788541013.283233:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e778050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+10:2396:x1875420955812864:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541013.283300:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e778050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+10:2396:x1875420955812864:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 68us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541013.283308:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 281 00000100:00100000:0.0:1788541013.283447:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955812992 00000100:00100000:0.0:1788541013.283452:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955812992 00000100:00100000:0.0:1788541013.283489:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955813120 00000100:00100000:0.0:1788541013.283492:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955813120 00000100:00100000:0.0:1788541013.283515:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 95 00000100:00100000:0.0:1788541013.283523:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+6:2396:x1875420955812992:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541013.283558:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+6:2396:x1875420955812992:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 36us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541013.283565:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 95 00000100:00100000:0.0:1788541013.283578:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 96 00000100:00100000:0.0:1788541013.283585:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+5:2396:x1875420955813120:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541013.283621:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+5:2396:x1875420955813120:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 36us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541013.283644:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 96 00000100:00080000:0.0:1788541013.283678:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788541013.283682:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788541013.450386:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981046016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788541013.450505:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541013.450579:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788541013.450588:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981046144:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788541013.450613:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541013.450642:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981046016 00000100:00100000:1.0:1788541013.450649:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981046016 00000100:00100000:1.0:1788541013.450710:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981046144 00000100:00100000:1.0:1788541013.450714:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981046144 00000100:00100000:1.0:1788541013.450732:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788541013.450740:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981046016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788541013.450767:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788541013.450809:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981046016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541013.450816:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788541013.450834:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788541013.450840:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707baf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981046144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788541013.450849:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788541013.450913:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707baf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981046144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541013.450920:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1788541013.450935:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788541013.450960:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6708083b80 x1875420981046144/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541029 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541013.451109:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981046144:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788541013.451130:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981046272:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788541013.451171:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788541013.451270:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707b70700 x1875420981046016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541029 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541013.451283:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981046016:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788541013.451583:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541013.455138:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981046272 00000100:00100000:0.0:1788541013.455153:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981046272 00000100:00100000:2.0:1788541013.457655:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788541013.457672:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981046272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788541013.457722:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788541013.457827:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981046272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 158us (6654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541013.457834:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788541013.458001:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981046272:0@lo:41:osp-pre-1-0.0 00000001:00100000:1.0:1788541013.970056:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 384f52e3-0481-4979-9299-157aff7472d2 00000020:00000080:1.0:1788541013.970067:0:9510:0:(genops.c:885:class_export_put()) final put ffff9a6837957000/384f52e3-0481-4979-9299-157aff7472d2 00000020:00000080:2.0:1788541013.975968:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6837957000/384f52e3-0481-4979-9299-157aff7472d2 for lustre-OST0001 00000020:00000080:2.0:1788541013.976042:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a6837950800 for lustre-OST0001 00000100:00100000:2.0:1788541013.976275:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788541013.976297:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981046400:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788541013.976390:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541013.976467:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981046400 00000100:00100000:2.0:1788541013.976476:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981046400 00000100:00100000:2.0:1788541013.976530:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788541013.976540:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981046400:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788541013.976578:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788541013.976647:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981046400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541013.976655:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788541013.976702:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981046400:0@lo:41:osp-pre-0-1.0 00000001:00100000:0.0:1788541013.981971:0:8426:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 384f52e3-0481-4979-9299-157aff7472d2 00000020:00000080:0.0:1788541013.981981:0:8426:0:(genops.c:885:class_export_put()) final put ffff9a683f192000/384f52e3-0481-4979-9299-157aff7472d2 00000020:00000080:3.0:1788541013.982255:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a683f192000/384f52e3-0481-4979-9299-157aff7472d2 for lustre-OST0000 00000020:00000080:3.0:1788541013.982315:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a683f191000 for lustre-OST0000 00010000:00010000:1.0:1788541014.474116:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541015.498635:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541015.498703:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708082d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981046528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788541015.498774:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541015.498902:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981046528 00000100:00100000:1.0:1788541015.498910:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981046528 00000100:00100000:1.0:1788541015.498965:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788541015.498974:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981046528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788541015.499002:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788541015.499051:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981046528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541015.499066:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1788541015.499254:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788541015.499517:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6708082d80 x1875420981046528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541031 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541015.499534:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708082d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981046528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788541015.499661:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875420981047040:0@lo:400:kworker.0 00000100:00100000:2.0:1788541015.499691:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541015.499708:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6811425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981047552:0@lo:400:kworker.0 00000100:00100000:2.0:1788541015.499733:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541015.499756:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981048064:0@lo:400:kworker.0 00000100:00100000:2.0:1788541015.499777:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541015.499800:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788541015.499805:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981046912:0@lo:400:kworker.0 00000100:00100000:2.0:1788541015.499842:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541015.500044:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420981046656:0@lo:400:kworker.0 00000100:00100000:0.0:1788541015.500089:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541015.500112:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6837968a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981047168:0@lo:400:kworker.0 00000100:00100000:0.0:1788541015.500133:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541015.500149:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981047680:0@lo:400:kworker.0 00000100:00100000:0.0:1788541015.500167:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541015.500184:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788541015.500189:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875420981046784:0@lo:400:kworker.0 00000100:00100000:0.0:1788541015.500205:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541015.500218:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683796b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875420981047296:0@lo:400:kworker.0 00000100:00100000:0.0:1788541015.500246:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541015.500260:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875420981047808:0@lo:400:kworker.0 00000100:00100000:0.0:1788541015.500277:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541015.500300:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981047040 00000100:00100000:0.0:1788541015.500304:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981047040 00000100:00100000:0.0:1788541015.500329:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981046784 00000100:00100000:0.0:1788541015.500332:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981046784 00000100:00100000:0.0:1788541015.500341:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981047296 00000100:00100000:0.0:1788541015.500351:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981047296 00000100:00100000:0.0:1788541015.500384:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981047808 00000100:00100000:0.0:1788541015.500387:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981047808 00000100:00100000:0.0:1788541015.500410:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788541015.500418:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875420981047040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541015.500456:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875420981047040:12345-0@lo:400:kworker.0 Request processed in 39us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541015.500462:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788541015.500476:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788541015.500482:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708083100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875420981046784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541015.500523:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708083100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875420981046784:12345-0@lo:400:kworker.0 Request processed in 41us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541015.500528:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788541015.500539:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788541015.500545:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708082d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875420981047296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541015.500567:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708082d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875420981047296:12345-0@lo:400:kworker.0 Request processed in 24us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541015.500573:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788541015.500584:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788541015.500589:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875420981047808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541015.500613:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875420981047808:12345-0@lo:400:kworker.0 Request processed in 24us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541015.500619:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788541015.500636:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981046656 00000100:00100000:0.0:1788541015.500639:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981046656 00000100:00100000:0.0:1788541015.500665:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788541015.500671:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e778850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+24:3641:x1875420981046656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541015.500705:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e778850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+24:3641:x1875420981046656:12345-0@lo:400:kworker.0 Request processed in 35us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541015.500711:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788541015.500739:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981046912 00000100:00100000:0.0:1788541015.500742:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981046912 00000100:00100000:0.0:1788541015.500764:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981047168 00000100:00100000:0.0:1788541015.500768:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981047168 00000100:00100000:0.0:1788541015.500779:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788541015.500784:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981046912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541015.500813:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981046912:12345-0@lo:400:kworker.0 Request processed in 29us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541015.500819:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788541015.500831:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788541015.500836:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708082300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981047168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541015.500892:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708082300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981047168:12345-0@lo:400:kworker.0 Request processed in 56us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541015.500899:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788541015.500916:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981047552 00000100:00100000:0.0:1788541015.500919:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981047552 00000100:00100000:0.0:1788541015.500941:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981048064 00000100:00100000:0.0:1788541015.500955:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981048064 00000100:00100000:0.0:1788541015.500969:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981047680 00000100:00100000:0.0:1788541015.500971:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981047680 00000100:00100000:0.0:1788541015.500982:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788541015.500988:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68357b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981047552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541015.501017:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68357b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981047552:12345-0@lo:400:kworker.0 Request processed in 29us (1283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541015.501032:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788541015.501195:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788541015.501202:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981048064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541015.501231:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981048064:12345-0@lo:400:kworker.0 Request processed in 30us (1453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541015.501237:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788541015.501248:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788541015.501254:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708081f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981047680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541015.501277:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708081f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981047680:12345-0@lo:400:kworker.0 Request processed in 25us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541015.501283:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1788541015.501303:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788541015.501306:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788541015.501308:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788541015.501336:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875420981046784:0@lo:400:kworker.0 00000100:00100000:0.0:1788541015.501347:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683796b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875420981047296:0@lo:400:kworker.0 00000100:00100000:0.0:1788541015.501357:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875420981047808:0@lo:400:kworker.0 00000100:00100000:0.0:1788541015.501365:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420981046656:0@lo:400:kworker.0 00000100:00100000:0.0:1788541015.501374:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6837968a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981047168:0@lo:400:kworker.0 00010000:00080000:0.0:1788541015.501384:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68045f5c00 x1875420981047680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541015.501393:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981047680:0@lo:400:kworker.0 00000100:00100000:2.0:1788541015.502273:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981046912:0@lo:400:kworker.0 00000100:00100000:2.0:1788541015.502283:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6811426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875420981047424:0@lo:400:kworker.0 00000100:00100000:2.0:1788541015.502321:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541015.502348:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875420981047936:0@lo:400:kworker.0 00000100:00100000:2.0:1788541015.502380:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541015.502416:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875420981047040:0@lo:400:kworker.0 00010000:00080000:2.0:1788541015.502428:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6811425500 x1875420981047552/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541015.502438:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6811425500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981047552:0@lo:400:kworker.0 00010000:00080000:2.0:1788541015.502448:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6705aa6d80 x1875420981048064/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541015.502465:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981048064:0@lo:400:kworker.0 00000100:00100000:2.0:1788541015.502516:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981047424 00000100:00100000:2.0:1788541015.502521:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981047424 00000100:00100000:2.0:1788541015.502557:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981047936 00000100:00100000:2.0:1788541015.502560:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981047936 00000100:00100000:2.0:1788541015.502576:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788541015.502583:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875420981047424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541015.502624:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875420981047424:12345-0@lo:400:kworker.0 Request processed in 41us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541015.502631:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788541015.502645:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788541015.502651:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670691a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875420981047936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541015.502673:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670691a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875420981047936:12345-0@lo:400:kworker.0 Request processed in 24us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541015.502679:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:2.0:1788541015.502692:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788541015.502708:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6811426a00 x1875420981047424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541015.502716:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6811426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875420981047424:0@lo:400:kworker.0 00010000:00080000:2.0:1788541015.502723:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6705aa7100 x1875420981047936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541015.502730:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875420981047936:0@lo:400:kworker.0 00000100:00100000:0.0:1788541015.508235:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981048192:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788541015.508323:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541015.508613:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981048192 00000100:00100000:3.0:1788541015.508621:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981048192 00000100:00100000:3.0:1788541015.508669:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788541015.508678:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708080a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981048192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788541015.508701:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788541015.508754:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708080a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981048192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541015.508762:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1788541015.508860:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707b72a00 x1875420981048192/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541031 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541015.508918:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981048192:0@lo:13:osp-pre-1-1.0 00000001:02000400:0.0:1788541015.768120:0:11314:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.2 00010000:00010000:2.0:1788541016.522562:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541017.548046:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788541017.955659:0:11363:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Sep 4 12:56:55 EDT 2026 00000100:00100000:0.0:1788541018.401737:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541018.401828:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541018.401952:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541018.402831:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955813504 00000100:00100000:2.0:1788541018.402854:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955813504 00000100:00100000:2.0:1788541018.402948:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955813376 00000100:00100000:2.0:1788541018.402953:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955813376 00000100:00100000:2.0:1788541018.402978:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 103 00000100:00100000:2.0:1788541018.402987:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708082680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+5:2396:x1875420955813504:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1788541018.403063:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708082680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+5:2396:x1875420955813504:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 76us (1234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541018.403071:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 103 00000100:00100000:2.0:1788541018.403087:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 104 00000100:00100000:2.0:1788541018.403094:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708080e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+6:2396:x1875420955813376:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1788541018.403118:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708080e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+6:2396:x1875420955813376:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 25us (1167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541018.403124:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 104 00000100:00080000:0.0:1788541018.406766:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788541018.406776:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788541018.410641:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955813248 00000100:00100000:1.0:1788541018.410656:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955813248 00000100:00100000:2.0:1788541018.411471:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 283 00000100:00100000:2.0:1788541018.411481:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e77b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+10:2396:x1875420955813248:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1788541018.411562:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e77b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+10:2396:x1875420955813248:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 83us (9834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541018.411569:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 283 00000100:00100000:2.0:1788541018.570194:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788541018.570223:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981048320:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788541018.570307:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541018.570509:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981048320 00000100:00100000:0.0:1788541018.570529:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981048320 00000100:00100000:0.0:1788541018.570602:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788541018.570612:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981048320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788541018.570645:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788541018.570696:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981048320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541018.570704:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788541018.570749:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981048320:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788541018.571110:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541018.571441:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981048576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788541018.571478:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541018.571511:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788541018.571525:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981048448:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788541018.571566:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541018.571699:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981048576 00000100:00100000:0.0:1788541018.571703:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981048576 00000100:00100000:0.0:1788541018.571736:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981048448 00000100:00100000:0.0:1788541018.571740:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981048448 00000100:00100000:0.0:1788541018.571755:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788541018.571761:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706919880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981048576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788541018.571781:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788541018.572023:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788541018.583469:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706919880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981048576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 11699us (11981us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541018.583499:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788541018.583541:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788541018.583555:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981048448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788541018.583596:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788541018.583644:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981048448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (12077us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541018.583650:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1788541018.583995:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6708083b80 x1875420981048448/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541034 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541018.584018:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708083b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981048448:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1788541018.584033:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707b70000 x1875420981048576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541034 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541018.584044:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981048576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788541019.083940:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707bac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981048704:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788541019.084020:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541019.084097:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981048704 00000100:00100000:1.0:1788541019.084105:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981048704 00000100:00100000:1.0:1788541019.084150:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788541019.084159:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707baea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981048704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788541019.084204:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788541019.084251:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707baea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981048704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541019.084258:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788541019.084304:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707bac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981048704:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788541019.598086:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541020.618256:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981048832:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788541020.618325:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541020.618459:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981048832 00000100:00100000:3.0:1788541020.618468:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981048832 00000100:00100000:3.0:1788541020.618524:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788541020.618535:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981048832:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788541020.618564:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788541020.618611:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981048832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541020.618617:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1788541020.618655:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707b71880 x1875420981048832/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541036 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541020.618671:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981048832:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788541020.618752:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788541020.619369:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541020.619614:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707bac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420981048960:0@lo:400:kworker.0 00000100:00100000:2.0:1788541020.619659:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541020.619698:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707baed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981049472:0@lo:400:kworker.0 00000100:00100000:2.0:1788541020.619723:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541020.619741:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707bac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981049984:0@lo:400:kworker.0 00000100:00100000:2.0:1788541020.619761:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541020.619795:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788541020.619802:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707bad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875420981049088:0@lo:400:kworker.0 00000100:00100000:2.0:1788541020.619826:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541020.619844:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707bae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875420981049600:0@lo:400:kworker.0 00000100:00100000:2.0:1788541020.619864:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541020.619900:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706879500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875420981050112:0@lo:400:kworker.0 00000100:00100000:2.0:1788541020.619933:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541020.620220:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981048960 00000100:00100000:1.0:1788541020.620226:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981048960 00000100:00100000:1.0:1788541020.620262:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1788541020.620270:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e77bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+24:3643:x1875420981048960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541020.620334:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981049472 00000100:00100000:2.0:1788541020.620338:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981049472 00000100:00100000:2.0:1788541020.620380:0:10866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788541020.620395:0:10866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670691aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981049472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541020.621463:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707bafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981049216:0@lo:400:kworker.0 00000100:00100000:0.0:1788541020.621506:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541020.621535:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707badf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875420981049728:0@lo:400:kworker.0 00000100:00100000:0.0:1788541020.621557:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541020.621575:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670687a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875420981050240:0@lo:400:kworker.0 00000100:00100000:0.0:1788541020.621596:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541020.621610:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788541020.621616:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707baf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875420981049344:0@lo:400:kworker.0 00000100:00100000:0.0:1788541020.621637:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541020.621648:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981049856:0@lo:400:kworker.0 00000100:00100000:0.0:1788541020.621668:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541020.621685:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706879c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981050368:0@lo:400:kworker.0 00000100:00100000:0.0:1788541020.621705:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541020.621736:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981049984 00000100:00100000:0.0:1788541020.621741:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981049984 00000100:00100000:0.0:1788541020.621780:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981049856 00000100:00100000:0.0:1788541020.621783:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981049856 00000100:00100000:0.0:1788541020.621799:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981050368 00000100:00100000:0.0:1788541020.621811:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981050368 00000100:00100000:0.0:1788541020.621832:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788541020.621838:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981049984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541020.626615:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e77bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+24:3643:x1875420981048960:12345-0@lo:400:kworker.0 Request processed in 6338us (6946us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541020.626631:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1788541020.626702:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981049216 00000100:00100000:1.0:1788541020.626711:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981049216 00000100:00100000:1.0:1788541020.626759:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788541020.626779:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981049216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541020.626858:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981049216:12345-0@lo:400:kworker.0 Request processed in 91us (5350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541020.626864:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788541020.626924:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707bafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981049216:0@lo:400:kworker.0 00000100:00080000:1.0:1788541020.626951:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788541020.627843:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788541020.628220:0:10866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670691aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981049472:12345-0@lo:400:kworker.0 Request processed in 7824us (8492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541020.628231:0:10866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788541020.628275:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981050496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788541020.628925:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541020.629074:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981050496 00000100:00100000:1.0:1788541020.629081:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981050496 00000100:00100000:1.0:1788541020.629122:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788541020.629131:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875420981050496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788541020.629151:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788541020.629243:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981049088 00000100:00100000:3.0:1788541020.629249:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981049088 00000100:00100000:3.0:1788541020.629274:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981049600 00000100:00100000:3.0:1788541020.629277:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981049600 00000100:00100000:3.0:1788541020.629311:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981050112 00000100:00100000:3.0:1788541020.629314:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981050112 00000100:00100000:3.0:1788541020.629329:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981049728 00000100:00100000:3.0:1788541020.629332:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981049728 00000100:00100000:3.0:1788541020.629343:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981050240 00000100:00100000:3.0:1788541020.629346:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981050240 00000100:00100000:3.0:1788541020.629374:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981049344 00000100:00100000:3.0:1788541020.629377:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981049344 00000100:00100000:3.0:1788541020.629392:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788541020.629399:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6811426a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875420981049088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541020.629457:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707bac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420981048960:0@lo:400:kworker.0 00000100:00100000:1.0:1788541020.629503:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875420981050496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 374us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541020.629511:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788541020.629698:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981049984:12345-0@lo:400:kworker.0 Request processed in 7857us (9933us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541020.629708:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788541020.629727:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788541020.629735:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981049856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541020.629791:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981049856:12345-0@lo:400:kworker.0 Request processed in 58us (8122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541020.629798:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788541020.629811:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788541020.629818:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981050368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541020.629846:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981050368:12345-0@lo:400:kworker.0 Request processed in 30us (8141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541020.629853:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1788541020.632159:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707baf100 x1875420981049856/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541036 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541020.632178:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981049856:0@lo:400:kworker.0 00010000:00080000:1.0:1788541020.632191:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6706879c00 x1875420981050368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541036 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541020.632200:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706879c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981050368:0@lo:400:kworker.0 00000100:00100000:0.0:1788541020.632824:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788541020.632840:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6811425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875420981049600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541020.632926:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6811425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875420981049600:12345-0@lo:400:kworker.0 Request processed in 93us (13060us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541020.632933:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788541020.632966:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788541020.632975:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875420981050112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541020.633010:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875420981050112:12345-0@lo:400:kworker.0 Request processed in 37us (13076us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541020.633033:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788541020.633046:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788541020.633052:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708083480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875420981049728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541020.633098:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708083480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875420981049728:12345-0@lo:400:kworker.0 Request processed in 46us (11539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541020.633104:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788541020.633117:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788541020.633124:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875420981050240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541020.633152:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875420981050240:12345-0@lo:400:kworker.0 Request processed in 29us (11555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541020.633158:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788541020.633169:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788541020.633176:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875420981049344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541020.633202:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875420981049344:12345-0@lo:400:kworker.0 Request processed in 27us (11565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541020.633220:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788541020.633557:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707baf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875420981049344:0@lo:400:kworker.0 00010000:00080000:1.0:1788541020.633570:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707badf80 x1875420981049728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541036 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541020.633592:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707badf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875420981049728:0@lo:400:kworker.0 00010000:00080000:1.0:1788541020.633605:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670687a680 x1875420981050240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541036 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541020.633613:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670687a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875420981050240:0@lo:400:kworker.0 00000100:00100000:3.0:1788541020.633811:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6811426a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875420981049088:12345-0@lo:400:kworker.0 Request processed in 4411us (13982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541020.633819:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:3.0:1788541020.633841:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788541020.633846:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788541020.648127:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707baed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981049472:0@lo:400:kworker.0 00010000:00080000:2.0:1788541020.648153:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707bac380 x1875420981049984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541036 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541020.648164:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707bac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981049984:0@lo:400:kworker.0 00010000:00080000:2.0:1788541020.648200:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707b71880 x1875420981050496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541036 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541020.648218:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981050496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788541020.648232:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707bad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875420981049088:0@lo:400:kworker.0 00000100:00100000:2.0:1788541020.648243:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707bae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875420981049600:0@lo:400:kworker.0 00000100:00100000:2.0:1788541020.648253:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706879500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875420981050112:0@lo:400:kworker.0 00010000:00010000:3.0:1788541021.644557:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541022.667012:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541023.525495:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541023.526891:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541023.526992:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541023.527038:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955813760 00000100:00100000:0.0:1788541023.527048:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955813760 00000100:00100000:0.0:1788541023.527111:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955813888 00000100:00100000:0.0:1788541023.527115:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955813888 00000100:00100000:0.0:1788541023.527141:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 111 00000100:00100000:0.0:1788541023.527152:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+6:2394:x1875420955813760:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541023.527240:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+6:2394:x1875420955813760:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 91us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541023.527248:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 111 00000100:00100000:0.0:1788541023.527266:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 112 00000100:00100000:0.0:1788541023.527273:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+5:2394:x1875420955813888:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541023.527302:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+5:2394:x1875420955813888:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 29us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541023.527308:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 112 00000100:00080000:0.0:1788541023.527323:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788541023.527338:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788541023.532544:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955813632 00000100:00100000:2.0:1788541023.532557:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955813632 00000100:00100000:2.0:1788541023.532615:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 285 00000100:00100000:2.0:1788541023.532624:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e77a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+10:2394:x1875420955813632:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1788541023.532688:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e77a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+10:2394:x1875420955813632:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 65us (7203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541023.532708:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 285 00010000:00010000:2.0:1788541023.694056:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541023.694205:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981050752:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788541023.694279:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541023.694359:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981050752 00000100:00100000:0.0:1788541023.694369:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981050752 00000100:00100000:0.0:1788541023.694441:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788541023.694452:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981050752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788541023.694484:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788541023.694526:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981050752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541023.694532:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1788541023.694551:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788541023.694579:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68045f5c00 x1875420981050752/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541039 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541023.694598:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981050752:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788541023.694704:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981050624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788541023.694734:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541023.694827:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981050624 00000100:00100000:0.0:1788541023.694839:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981050624 00000100:00100000:0.0:1788541023.694922:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788541023.694928:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981050624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788541023.694938:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788541023.694968:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981050624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541023.694974:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1788541023.694999:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6705aa4380 x1875420981050624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541039 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541023.695011:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981050624:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788541023.695117:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788541023.699646:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788541023.699675:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670687a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981050880:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788541023.699759:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541023.700115:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981050880 00000100:00100000:1.0:1788541023.700125:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981050880 00000100:00100000:1.0:1788541023.700189:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788541023.700199:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981050880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788541023.700238:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788541023.700297:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981050880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541023.700305:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788541023.700386:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670687a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981050880:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788541024.333463:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788541024.333489:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981051008:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788541024.333562:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541024.335987:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981051008 00000100:00100000:3.0:1788541024.336004:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981051008 00000100:00100000:3.0:1788541024.336070:0:10866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788541024.336081:0:10866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706879c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981051008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788541024.336118:0:10866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788541024.336221:0:10866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706879c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981051008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 141us (2657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541024.336228:0:10866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788541024.336459:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981051008:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788541024.714710:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541025.738065:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541025.738227:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788541025.738247:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981051136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788541025.738328:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541025.738943:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788541025.738954:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981051264:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788541025.738983:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541025.739012:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981051136 00000100:00100000:3.0:1788541025.739019:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981051136 00000100:00100000:3.0:1788541025.739066:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981051264 00000100:00100000:3.0:1788541025.739069:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981051264 00000100:00100000:3.0:1788541025.739085:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788541025.739092:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981051136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788541025.739119:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788541025.739162:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981051136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541025.739168:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788541025.739186:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788541025.739193:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981051264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788541025.739202:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788541025.739227:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981051264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 35us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541025.739232:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1788541025.739264:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707b71880 x1875420981051264/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541041 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541025.739283:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981051264:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1788541025.739321:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707b73b80 x1875420981051136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541041 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541025.739347:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981051136:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788541025.739420:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788541025.740657:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420981051392:0@lo:400:kworker.0 00000100:00100000:0.0:1788541025.740719:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541025.740782:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981051392 00000100:00100000:1.0:1788541025.740788:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981051392 00000100:00100000:1.0:1788541025.740825:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1788541025.740834:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e77a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+24:3642:x1875420981051392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541025.753651:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e77a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+24:3642:x1875420981051392:12345-0@lo:400:kworker.0 Request processed in 12810us (12923us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541025.753678:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1788541025.753852:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420981051392:0@lo:400:kworker.0 00000100:00100000:0.0:1788541025.753899:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788541025.753911:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875420981051776:0@lo:400:kworker.0 00000100:00100000:0.0:1788541025.753966:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541025.754202:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981051648:0@lo:400:kworker.0 00000100:00100000:2.0:1788541025.754235:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541025.754257:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875420981052160:0@lo:400:kworker.0 00000100:00100000:2.0:1788541025.754278:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541025.754294:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875420981052672:0@lo:400:kworker.0 00000100:00100000:2.0:1788541025.754326:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541025.754347:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788541025.754353:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875420981051520:0@lo:400:kworker.0 00000100:00100000:2.0:1788541025.754372:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541025.754388:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875420981052032:0@lo:400:kworker.0 00000100:00100000:2.0:1788541025.754419:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541025.754432:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875420981052544:0@lo:400:kworker.0 00000100:00100000:2.0:1788541025.754459:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541025.754482:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981051648 00000100:00100000:2.0:1788541025.754488:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981051648 00000100:00100000:2.0:1788541025.754533:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788541025.754542:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981051648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541025.754596:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981051648:12345-0@lo:400:kworker.0 Request processed in 54us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541025.754603:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788541025.754623:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981051776 00000100:00100000:2.0:1788541025.754627:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981051776 00000100:00100000:2.0:1788541025.754644:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981052160 00000100:00100000:2.0:1788541025.754647:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981052160 00000100:00100000:0.0:1788541025.754741:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981051904:0@lo:400:kworker.0 00000100:00100000:0.0:1788541025.754766:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541025.754782:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981052416:0@lo:400:kworker.0 00000100:00100000:0.0:1788541025.754803:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541025.754819:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788541025.754824:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981052288:0@lo:400:kworker.0 00000100:00100000:0.0:1788541025.754843:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541025.754865:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981052416 00000100:00100000:0.0:1788541025.754883:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981052416 00000100:00100000:2.0:1788541025.754945:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981052672 00000100:00100000:2.0:1788541025.754948:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981052672 00000100:00100000:1.0:1788541025.755383:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981051520 00000100:00100000:1.0:1788541025.755394:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981051520 00000100:00100000:1.0:1788541025.755413:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981052032 00000100:00100000:1.0:1788541025.755416:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981052032 00000100:00100000:0.0:1788541025.758808:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981052288 00000100:00100000:0.0:1788541025.758821:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981052288 00000100:00100000:0.0:1788541025.758857:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788541025.758886:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981052416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541025.758986:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981052416:12345-0@lo:400:kworker.0 Request processed in 120us (4180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541025.758994:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788541025.759011:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788541025.759019:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981052288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541025.759049:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981052288:12345-0@lo:400:kworker.0 Request processed in 32us (4205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541025.759055:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1788541025.759107:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707a24a80 x1875420981052288/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541025.759123:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981052288:0@lo:400:kworker.0 00010000:00080000:0.0:1788541025.759136:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707a26680 x1875420981052416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541025.759144:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981052416:0@lo:400:kworker.0 00000100:00100000:0.0:1788541025.759285:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981052544 00000100:00100000:0.0:1788541025.759290:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981052544 00000100:00100000:0.0:1788541025.759331:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788541025.759339:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875420981051776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541025.759378:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875420981051776:12345-0@lo:400:kworker.0 Request processed in 40us (5411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541025.759384:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788541025.759411:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788541025.759418:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875420981052160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541025.759453:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875420981052160:12345-0@lo:400:kworker.0 Request processed in 36us (5174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541025.759460:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788541025.759471:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788541025.759478:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875420981051520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541025.759505:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875420981051520:12345-0@lo:400:kworker.0 Request processed in 28us (5132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541025.759511:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788541025.759524:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788541025.759531:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707818380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875420981052544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541025.759557:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707818380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875420981052544:12345-0@lo:400:kworker.0 Request processed in 27us (5097us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541025.759562:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788541025.759592:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875420981051776:0@lo:400:kworker.0 00000100:00100000:2.0:1788541025.763556:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981051904 00000100:00100000:2.0:1788541025.763573:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981051904 00000100:00100000:2.0:1788541025.763624:0:10866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788541025.763634:0:10866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981051904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541025.763750:0:10866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981051904:12345-0@lo:400:kworker.0 Request processed in 117us (8981us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541025.763760:0:10866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:2.0:1788541025.763784:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788541025.763791:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788541025.763793:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788541025.763824:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981051904:0@lo:400:kworker.0 00000100:00100000:2.0:1788541025.763993:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875420981051520:0@lo:400:kworker.0 00000100:00100000:2.0:1788541025.764005:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875420981052544:0@lo:400:kworker.0 00000100:00100000:2.0:1788541025.764036:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981051648:0@lo:400:kworker.0 00010000:00080000:2.0:1788541025.764050:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707a25180 x1875420981052160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541025.764060:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875420981052160:0@lo:400:kworker.0 00000100:00100000:2.0:1788541025.764110:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788541025.764118:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875420981052672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541025.764155:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875420981052672:12345-0@lo:400:kworker.0 Request processed in 39us (9828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541025.764162:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00010000:00080000:2.0:1788541025.764187:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707a24e00 x1875420981052672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541025.764196:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875420981052672:0@lo:400:kworker.0 00000100:00100000:1.0:1788541025.764622:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788541025.764632:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670781a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875420981052032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541025.764674:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670781a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875420981052032:12345-0@lo:400:kworker.0 Request processed in 45us (10254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541025.764680:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788541025.764711:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875420981052032:0@lo:400:kworker.0 00010000:00010000:2.0:1788541026.762045:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541027.909695:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541028.645526:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541028.645576:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541028.646200:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955814016 00000100:00100000:2.0:1788541028.646217:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955814016 00000100:00100000:2.0:1788541028.646293:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 287 00000100:00100000:2.0:1788541028.646304:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e77a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+10:2395:x1875420955814016:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1788541028.646375:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e77a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+10:2395:x1875420955814016:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 73us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541028.646383:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 287 00000100:00100000:3.0:1788541028.646712:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955814144 00000100:00100000:3.0:1788541028.646718:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955814144 00000100:00100000:3.0:1788541028.646811:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 119 00000100:00100000:3.0:1788541028.646819:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+6:2395:x1875420955814144:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541028.646854:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+6:2395:x1875420955814144:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 37us (1277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541028.646861:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 119 00000100:00100000:0.0:1788541028.647152:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00080000:2.0:1788541028.647493:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788541028.647510:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955814272 00000100:00100000:2.0:1788541028.647515:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955814272 00000100:00100000:2.0:1788541028.647561:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 120 00000100:00100000:2.0:1788541028.647568:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+5:2394:x1875420955814272:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1788541028.647604:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+5:2394:x1875420955814272:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 37us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541028.647611:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 120 00000100:00080000:0.0:1788541028.648593:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788541028.811900:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706879f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981052800:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788541028.811972:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541028.813479:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788541028.813496:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670781b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981053056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788541028.813543:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541028.813576:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981053056 00000100:00100000:2.0:1788541028.813581:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981053056 00000100:00100000:2.0:1788541028.813623:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788541028.813790:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707819500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981053056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788541028.813818:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788541028.813893:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707819500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981053056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 262us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541028.813901:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1788541028.813920:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788541028.813931:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981052928:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788541028.813949:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541028.813970:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981052928 00000100:00100000:2.0:1788541028.813973:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981052928 00000100:00100000:2.0:1788541028.813988:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788541028.813992:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707818700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981052928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788541028.813999:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788541028.814026:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707818700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981052928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 34us (75us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541028.814030:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1788541028.814040:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788541028.814058:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707a24e00 x1875420981052928/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541044 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541028.814074:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981052928:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1788541028.814140:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670781b480 x1875420981053056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541044 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541028.814152:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670781b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981053056:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788541028.814437:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981052800 00000100:00100000:1.0:1788541028.814443:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981052800 00000100:00100000:1.0:1788541028.814517:0:10866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788541028.814525:0:10866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707818e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981052800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788541028.814549:0:10866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788541028.814597:0:10866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707818e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981052800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (2626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541028.814603:0:10866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788541028.814657:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706879f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981052800:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788541028.940954:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541029.834187:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788541029.834210:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670781aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981053184:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788541029.834291:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541029.834411:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981053184 00000100:00100000:1.0:1788541029.834419:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981053184 00000100:00100000:1.0:1788541029.834468:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788541029.834478:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981053184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788541029.834511:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788541029.834566:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981053184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541029.834572:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788541029.834737:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670781aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981053184:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788541029.964028:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541030.861076:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788541030.861100:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981053312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788541030.861164:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541030.861228:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981053312 00000100:00100000:3.0:1788541030.861236:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981053312 00000100:00100000:3.0:1788541030.861302:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788541030.861312:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981053312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788541030.861344:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788541030.861389:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981053312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541030.861396:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1788541030.861418:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788541030.861460:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707b71880 x1875420981053312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541046 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541030.861478:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981053312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788541030.862292:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670687a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981053440:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788541030.862328:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541030.862365:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981053440 00000100:00100000:3.0:1788541030.862369:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981053440 00000100:00100000:3.0:1788541030.862412:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788541030.862420:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981053440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788541030.862433:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788541030.862465:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981053440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541030.862472:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:3.0:1788541030.862487:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788541030.862508:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670687a300 x1875420981053440/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541046 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541030.862522:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670687a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981053440:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788541030.864934:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875420981053952:0@lo:400:kworker.0 00000100:00100000:0.0:1788541030.865008:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541030.865047:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981054464:0@lo:400:kworker.0 00000100:00100000:3.0:1788541030.865254:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420981053568:0@lo:400:kworker.0 00000100:00100000:3.0:1788541030.865301:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541030.865326:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981054080:0@lo:400:kworker.0 00000100:00100000:3.0:1788541030.865350:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541030.865365:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981054592:0@lo:400:kworker.0 00000100:00100000:3.0:1788541030.865399:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541030.865425:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788541030.865430:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875420981053696:0@lo:400:kworker.0 00000100:00100000:3.0:1788541030.865461:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541030.865480:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875420981054208:0@lo:400:kworker.0 00000100:00100000:3.0:1788541030.865500:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541030.865516:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875420981054720:0@lo:400:kworker.0 00000100:00100000:3.0:1788541030.865536:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541030.865560:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981053824:0@lo:400:kworker.0 00000100:00100000:3.0:1788541030.865597:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541030.865616:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875420981054336:0@lo:400:kworker.0 00000100:00100000:3.0:1788541030.865636:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541030.865645:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f0fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875420981054848:0@lo:400:kworker.0 00000100:00100000:3.0:1788541030.865679:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541030.865958:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981053568 00000100:00100000:3.0:1788541030.865966:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981053568 00000100:00100000:3.0:1788541030.866012:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1788541030.866020:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e778c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+24:3643:x1875420981053568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541030.866081:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e778c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+24:3643:x1875420981053568:12345-0@lo:400:kworker.0 Request processed in 62us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541030.866089:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1788541030.866121:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981054080 00000100:00100000:3.0:1788541030.866125:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981054080 00000100:00100000:3.0:1788541030.866150:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981053824 00000100:00100000:3.0:1788541030.866153:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981053824 00000100:00100000:3.0:1788541030.866167:0:10866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788541030.866173:0:10866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981054080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541030.866208:0:10866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981054080:12345-0@lo:400:kworker.0 Request processed in 36us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541030.866222:0:10866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788541030.866236:0:10866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788541030.866241:0:10866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981053824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541030.866296:0:10866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981053824:12345-0@lo:400:kworker.0 Request processed in 54us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541030.866301:0:10866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788541030.866317:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981053952 00000100:00100000:3.0:1788541030.866321:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981053952 00000100:00100000:3.0:1788541030.866337:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981053696 00000100:00100000:3.0:1788541030.866339:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981053696 00000100:00100000:3.0:1788541030.866348:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981054208 00000100:00100000:3.0:1788541030.866351:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981054208 00000100:00100000:3.0:1788541030.866369:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981054720 00000100:00100000:3.0:1788541030.866372:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981054720 00000100:00100000:3.0:1788541030.866500:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981054336 00000100:00100000:3.0:1788541030.866504:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981054336 00000100:00100000:3.0:1788541030.866517:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981054848 00000100:00100000:3.0:1788541030.866519:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981054848 00000100:00100000:3.0:1788541030.866532:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788541030.866538:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f0fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875420981053952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541030.866698:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f0fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875420981053952:12345-0@lo:400:kworker.0 Request processed in 160us (1690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541030.866705:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788541030.866825:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788541030.866833:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875420981053696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541030.866865:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875420981053696:12345-0@lo:400:kworker.0 Request processed in 34us (1403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541030.866946:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788541030.866955:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875420981054208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541030.866988:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875420981054208:12345-0@lo:400:kworker.0 Request processed in 35us (1487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541030.866994:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788541030.867008:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788541030.867015:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875420981054720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541030.867042:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875420981054720:12345-0@lo:400:kworker.0 Request processed in 28us (1505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541030.867048:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788541030.867070:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788541030.867077:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875420981054336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541030.867104:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875420981054336:12345-0@lo:400:kworker.0 Request processed in 28us (1467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541030.867109:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788541030.867120:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788541030.867134:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875420981054848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541030.867163:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875420981054848:12345-0@lo:400:kworker.0 Request processed in 31us (1484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541030.867170:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788541030.867206:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875420981053696:0@lo:400:kworker.0 00000100:00100000:2.0:1788541030.867217:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875420981054208:0@lo:400:kworker.0 00000100:00100000:2.0:1788541030.867226:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875420981054720:0@lo:400:kworker.0 00000100:00100000:2.0:1788541030.867235:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420981053568:0@lo:400:kworker.0 00000100:00100000:2.0:1788541030.867243:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981054080:0@lo:400:kworker.0 00000100:00100000:3.0:1788541030.867359:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788541030.867499:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541030.867533:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875420981053952:0@lo:400:kworker.0 00000100:00100000:0.0:1788541030.867558:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981054592 00000100:00100000:0.0:1788541030.867562:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981054592 00000100:00100000:0.0:1788541030.867659:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981054464 00000100:00100000:0.0:1788541030.867663:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981054464 00000100:00100000:0.0:1788541030.867685:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788541030.867692:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981054592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541030.868254:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981054592:12345-0@lo:400:kworker.0 Request processed in 561us (2853us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541030.868272:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788541030.868289:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788541030.868297:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f0fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981054464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541030.868331:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f0fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981054464:12345-0@lo:400:kworker.0 Request processed in 36us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541030.868336:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1788541030.868374:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707a24e00 x1875420981054592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788541030.868474:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788541030.868479:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788541030.868481:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788541030.868503:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981053824:0@lo:400:kworker.0 00010000:00080000:3.0:1788541030.868516:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707a26680 x1875420981054336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541030.868526:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875420981054336:0@lo:400:kworker.0 00010000:00080000:3.0:1788541030.868536:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a683f0fca80 x1875420981054848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541030.868545:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f0fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875420981054848:0@lo:400:kworker.0 00000100:00100000:0.0:1788541030.869320:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981054592:0@lo:400:kworker.0 00010000:00080000:0.0:1788541030.869353:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707a24a80 x1875420981054464/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541030.869363:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981054464:0@lo:400:kworker.0 00010000:00010000:2.0:1788541030.985968:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541032.023978:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541033.034927:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541033.761313:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541033.761371:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541033.761404:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541033.761594:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955814400 00000100:00100000:3.0:1788541033.761604:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955814400 00000100:00100000:3.0:1788541033.761658:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 289 00000100:00100000:3.0:1788541033.761666:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e77b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+10:2394:x1875420955814400:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541033.761729:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e77b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+10:2394:x1875420955814400:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 63us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541033.761736:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 289 00000100:00100000:3.0:1788541033.761764:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955814656 00000100:00100000:3.0:1788541033.761767:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955814656 00000100:00100000:3.0:1788541033.761811:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955814528 00000100:00100000:3.0:1788541033.761814:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955814528 00000100:00100000:3.0:1788541033.761831:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 127 00000100:00100000:3.0:1788541033.761837:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f0fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+5:2394:x1875420955814656:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541033.761863:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f0fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+5:2394:x1875420955814656:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 26us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541033.761905:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 127 00000100:00100000:3.0:1788541033.761918:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 128 00000100:00100000:3.0:1788541033.761924:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+6:2394:x1875420955814528:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541033.761947:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+6:2394:x1875420955814528:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 24us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541033.761953:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 128 00000100:00080000:3.0:1788541033.763140:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788541033.763145:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788541033.931340:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706878380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981054976:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788541033.931420:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541033.931489:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981054976 00000100:00100000:1.0:1788541033.931496:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981054976 00000100:00100000:1.0:1788541033.931537:0:10866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788541033.931545:0:10866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a681fef3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981054976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788541033.931576:0:10866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788541033.931616:0:10866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a681fef3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981054976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541033.931622:0:10866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788541033.931934:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706878380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981054976:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788541033.932461:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788541033.932471:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981055104:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788541033.932504:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541033.932530:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981055104 00000100:00100000:3.0:1788541033.932533:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981055104 00000100:00100000:3.0:1788541033.932566:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788541033.932572:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981055104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788541033.932590:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788541033.932620:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981055104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541033.932627:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1788541033.932641:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788541033.932662:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707b06680 x1875420981055104/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541049 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541033.932675:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981055104:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788541033.934137:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981055232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788541033.934182:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541033.934268:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981055232 00000100:00100000:3.0:1788541033.934274:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981055232 00000100:00100000:3.0:1788541033.934344:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788541033.934351:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981055232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788541033.934367:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788541033.934402:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981055232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541033.934408:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1788541033.935443:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788541033.935479:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707b06680 x1875420981055232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541049 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541033.935497:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981055232:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788541034.068617:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541034.954281:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707818000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981055360:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788541034.954378:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541034.954747:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981055360 00000100:00100000:2.0:1788541034.954756:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981055360 00000100:00100000:2.0:1788541034.954821:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788541034.954831:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706878380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981055360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788541034.954866:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788541034.954962:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706878380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981055360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 132us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541034.954969:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788541034.955117:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707818000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981055360:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788541035.087054:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541035.978187:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788541035.978219:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670687ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981055616:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788541035.978289:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541035.978477:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981055488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788541035.978507:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541035.978544:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981055616 00000100:00100000:0.0:1788541035.978552:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981055616 00000100:00100000:0.0:1788541035.978600:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981055488 00000100:00100000:0.0:1788541035.978603:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981055488 00000100:00100000:0.0:1788541035.978621:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788541035.978628:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670687b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981055616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788541035.978659:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788541035.978701:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670687b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981055616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541035.978708:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788541035.978724:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788541035.978730:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981055488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788541035.978740:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788541035.978766:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981055488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541035.978785:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:0.0:1788541035.978813:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788541035.978844:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707b04e00 x1875420981055488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541051 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541035.978863:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981055488:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788541035.979146:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670687ad80 x1875420981055616/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541051 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541035.979159:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670687ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981055616:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788541035.979283:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706879c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875420981055872:0@lo:400:kworker.0 00000100:00100000:1.0:1788541035.979315:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541035.979336:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706879f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875420981056384:0@lo:400:kworker.0 00000100:00100000:1.0:1788541035.979356:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541035.979373:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6805677b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875420981056896:0@lo:400:kworker.0 00000100:00100000:1.0:1788541035.979392:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541035.979426:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788541035.979429:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875420981056128:0@lo:400:kworker.0 00000100:00100000:1.0:1788541035.979432:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670687aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981056000:0@lo:400:kworker.0 00000100:00100000:1.0:1788541035.979454:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541035.979455:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541035.979505:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670687ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:425687b6-1d99-41d2-88d8-2fb230997596:3644:1875420981055744:0@lo:400:kworker.0 00000100:00100000:0.0:1788541035.979534:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541035.979556:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670687a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981056256:0@lo:400:kworker.0 00000100:00100000:0.0:1788541035.979576:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541035.979592:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6805674000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981056768:0@lo:400:kworker.0 00000100:00100000:0.0:1788541035.979610:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541035.979636:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981055744 00000100:00100000:0.0:1788541035.979640:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981055744 00000100:00100000:0.0:1788541035.979670:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1788541035.979677:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e77b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+24:3644:x1875420981055744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541035.979712:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e77b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+24:3644:x1875420981055744:12345-0@lo:400:kworker.0 Request processed in 35us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541035.979718:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1788541035.979746:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981056000 00000100:00100000:0.0:1788541035.979749:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981056000 00000100:00100000:0.0:1788541035.979770:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981056256 00000100:00100000:0.0:1788541035.979773:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981056256 00000100:00100000:0.0:1788541035.979786:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788541035.979791:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6805676d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981056000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541035.979841:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6805676d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981056000:12345-0@lo:400:kworker.0 Request processed in 50us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541035.979854:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788541035.979866:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788541035.979890:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981056256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541035.979920:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981056256:12345-0@lo:400:kworker.0 Request processed in 30us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541035.979926:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788541035.979942:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981056768 00000100:00100000:0.0:1788541035.979944:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981056768 00000100:00100000:1.0:1788541035.980272:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670687aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981056000:0@lo:400:kworker.0 00000100:00100000:1.0:1788541035.980280:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670687a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875420981056512:0@lo:400:kworker.0 00000100:00100000:0.0:1788541035.984948:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788541035.984979:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981056768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541035.985062:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981056768:12345-0@lo:400:kworker.0 Request processed in 90us (5450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541035.985069:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1788541035.985102:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788541035.985335:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670687ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:425687b6-1d99-41d2-88d8-2fb230997596:3644:1875420981055744:0@lo:400:kworker.0 00000100:00100000:0.0:1788541035.985356:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670687a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981056256:0@lo:400:kworker.0 00010000:00080000:0.0:1788541035.985370:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6805674000 x1875420981056768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541035.985381:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6805674000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981056768:0@lo:400:kworker.0 00000100:00100000:1.0:1788541035.998521:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981055872 00000100:00100000:1.0:1788541035.999290:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981055872 00000100:00100000:1.0:1788541035.999339:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541035.999384:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6805677100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875420981057024:0@lo:400:kworker.0 00000100:00100000:1.0:1788541035.999446:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541035.999530:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981056384 00000100:00100000:1.0:1788541035.999534:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981056384 00000100:00100000:1.0:1788541035.999572:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981056896 00000100:00100000:1.0:1788541035.999575:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981056896 00000100:00100000:1.0:1788541035.999586:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981056128 00000100:00100000:1.0:1788541035.999589:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981056128 00000100:00100000:1.0:1788541035.999598:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981056512 00000100:00100000:1.0:1788541035.999600:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981056512 00000100:00100000:1.0:1788541035.999611:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981057024 00000100:00100000:1.0:1788541035.999613:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981057024 00000100:00100000:1.0:1788541035.999628:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788541035.999637:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6805677480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875420981055872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541035.999696:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6805677480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875420981055872:12345-0@lo:400:kworker.0 Request processed in 59us (20379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541035.999704:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788541035.999748:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706879c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875420981055872:0@lo:400:kworker.0 00000100:00100000:1.0:1788541035.999764:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788541035.999771:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6805674380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875420981056384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541036.000749:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6805674380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875420981056384:12345-0@lo:400:kworker.0 Request processed in 975us (21388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541036.000758:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788541036.000810:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706879f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875420981056384:0@lo:400:kworker.0 00000100:00100000:1.0:1788541036.000837:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788541036.000847:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6805676a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875420981056896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541036.000900:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6805676a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875420981056896:12345-0@lo:400:kworker.0 Request processed in 56us (21507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541036.000906:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788541036.000929:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6805677b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875420981056896:0@lo:400:kworker.0 00000100:00100000:1.0:1788541036.000943:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788541036.000949:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875420981056128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541036.000975:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875420981056128:12345-0@lo:400:kworker.0 Request processed in 27us (21519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541036.000981:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788541036.000990:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788541036.000996:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6805675180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875420981056512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541036.001021:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6805675180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875420981056512:12345-0@lo:400:kworker.0 Request processed in 25us (1684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541036.001026:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00010000:00080000:1.0:1788541036.001047:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670687a680 x1875420981056512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541036.001058:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670687a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875420981056512:0@lo:400:kworker.0 00000100:00100000:1.0:1788541036.001087:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788541036.001094:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6805675c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875420981057024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541036.001122:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6805675c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875420981057024:12345-0@lo:400:kworker.0 Request processed in 29us (1676us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541036.001128:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00010000:00080000:1.0:1788541036.001146:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6805677100 x1875420981057024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541036.001156:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6805677100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875420981057024:0@lo:400:kworker.0 00000100:00080000:0.0:1788541036.007303:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788541036.007314:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788541036.010376:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875420981056128:0@lo:400:kworker.0 00000100:00100000:2.0:1788541036.010398:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706879500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981056640:0@lo:400:kworker.0 00000100:00100000:2.0:1788541036.010486:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541036.010683:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981056640 00000100:00100000:0.0:1788541036.010690:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981056640 00000100:00100000:0.0:1788541036.010770:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788541036.010786:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707819880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981056640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541036.010852:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707819880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981056640:12345-0@lo:400:kworker.0 Request processed in 74us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541036.010912:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1788541036.014504:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788541036.014565:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6706879500 x1875420981056640/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541052 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541036.014581:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706879500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981056640:0@lo:400:kworker.0 00010000:00010000:1.0:1788541036.106098:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788541036.815340:0:11992:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 12:57:14 (1788541034) === 00010000:00010000:2.0:1788541037.130001:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541037.614590:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541037.614944:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955814784 00000100:00100000:3.0:1788541037.614957:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955814784 00000100:00100000:3.0:1788541037.615040:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 291 00000100:00100000:3.0:1788541037.615053:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e779450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+10:8715:x1875420955814784:12345-192.168.202.56@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788541037.615088:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541037.615111:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6842172c00/0x2aac941e5f4a779e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16473202a33110a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541037.615144:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6842172c00/0x2aac941e5f4a779e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33110a expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541037.615157:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6842172c00/0x2aac941e5f4a779e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33110a expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541037.615166:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6842172c00, rc 0) 00000100:00100000:3.0:1788541037.615250:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e779450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+11:8715:x1875420955814784:12345-192.168.202.56@tcp:101:mount.lustre.0 Request processed in 200us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541037.615258:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 291 00000100:00100000:3.0:1788541037.622346:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541037.622499:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955814912 00000100:00100000:0.0:1788541037.622512:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955814912 00000100:00100000:0.0:1788541037.622578:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 292 00000100:00100000:0.0:1788541037.622590:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e779c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+11:8715:x1875420955814912:12345-192.168.202.56@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788541037.622788:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e779c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+11:8715:x1875420955814912:12345-192.168.202.56@tcp:501:mount.lustre.0 Request processed in 200us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541037.622797:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 292 00000100:00100000:1.0:1788541037.634059:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541037.634717:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955815040 00000100:00100000:0.0:1788541037.634728:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955815040 00000100:00100000:0.0:1788541037.634792:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 293 00000100:00100000:0.0:1788541037.634803:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e77ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+11:8715:x1875420955815040:12345-192.168.202.56@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788541037.635021:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e77ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+11:8715:x1875420955815040:12345-192.168.202.56@tcp:503:mount.lustre.0 Request processed in 218us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541037.635030:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 293 00000100:00100000:1.0:1788541037.650773:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541037.664323:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955815168 00000100:00100000:3.0:1788541037.664339:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955815168 00000100:00100000:3.0:1788541037.664419:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 294 00000100:00100000:3.0:1788541037.664429:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e779050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+11:8719:x1875420955815168:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788541037.664616:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e779050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+11:8719:x1875420955815168:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 187us (13869us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541037.664625:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 294 00000100:00100000:2.0:1788541037.707676:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541037.708614:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955815296 00000100:00100000:3.0:1788541037.708625:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955815296 00000100:00100000:3.0:1788541037.708696:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 295 00000100:00100000:3.0:1788541037.708707:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e779850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+11:8719:x1875420955815296:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788541037.708908:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e779850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+11:8719:x1875420955815296:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 166us (1204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541037.708919:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 295 00000100:00100000:1.0:1788541037.716484:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541037.716585:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955815424 00000100:00100000:0.0:1788541037.716595:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955815424 00000100:00100000:0.0:1788541037.716655:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 296 00000100:00100000:0.0:1788541037.716666:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e778450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+11:8719:x1875420955815424:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788541037.716844:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e778450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+11:8719:x1875420955815424:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 179us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541037.716861:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 296 00000100:00100000:1.0:1788541037.727350:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541037.727482:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955815552 00000100:00100000:0.0:1788541037.727493:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955815552 00000100:00100000:0.0:1788541037.727556:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 297 00000100:00100000:0.0:1788541037.727568:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680cee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+11:8715:x1875420955815552:12345-192.168.202.56@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788541037.727596:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541037.727619:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a682e75f400/0x2aac941e5f4a77a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16473202a33113b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541037.727649:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a682e75f400/0x2aac941e5f4a77a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33113b expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541037.727661:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a682e75f400/0x2aac941e5f4a77a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33113b expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541037.727670:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75f400, rc 0) 00000100:00100000:0.0:1788541037.727734:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680cee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+12:8715:x1875420955815552:12345-192.168.202.56@tcp:101:mount.lustre.0 Request processed in 168us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541037.727750:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 297 00000100:00100000:2.0:1788541037.731139:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541037.731242:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955815680 00000100:00100000:3.0:1788541037.731253:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955815680 00000100:00100000:3.0:1788541037.731313:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 298 00000100:00100000:3.0:1788541037.731325:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680cee4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+12:8715:x1875420955815680:12345-192.168.202.56@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788541037.731353:0:6509:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788541037.731380:0:6509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788541037.731385:0:6509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788541037.731392:0:6509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788541037.731397:0:6509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788541037.731400:0:6509:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1788541037.733425:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680cee4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+12:8715:x1875420955815680:12345-192.168.202.56@tcp:256:mount.lustre.0 Request processed in 2090us (2284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541037.733452:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 298 00000100:00100000:1.0:1788541037.745089:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541037.745382:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955815808 00000100:00100000:2.0:1788541037.745393:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955815808 00000100:00100000:2.0:1788541037.745462:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 299 00000100:00100000:2.0:1788541037.745473:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680cee5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+12:8715:x1875420955815808:12345-192.168.202.56@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788541037.745492:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541037.745512:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a683551b400/0x2aac941e5f4a77ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16473202a331142 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541037.745543:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a683551b400/0x2aac941e5f4a77ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331142 expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541037.745555:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a683551b400/0x2aac941e5f4a77ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331142 expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541037.745564:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a683551b400, rc 0) 00000100:00100000:2.0:1788541037.745631:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680cee5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:8715:x1875420955815808:12345-192.168.202.56@tcp:101:mount.lustre.0 Request processed in 160us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541037.745638:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 299 00000100:00100000:2.0:1788541037.748863:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541037.748978:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955815936 00000100:00100000:3.0:1788541037.748987:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955815936 00000100:00100000:3.0:1788541037.749048:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 300 00000100:00100000:3.0:1788541037.749058:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680cee7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:8715:x1875420955815936:12345-192.168.202.56@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788541037.749219:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680cee7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:8715:x1875420955815936:12345-192.168.202.56@tcp:501:mount.lustre.0 Request processed in 161us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541037.749227:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 300 00000100:00100000:1.0:1788541037.752318:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541037.752865:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955816064 00000100:00100000:0.0:1788541037.752903:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955816064 00000100:00100000:0.0:1788541037.752996:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 301 00000100:00100000:0.0:1788541037.753006:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680cee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:8715:x1875420955816064:12345-192.168.202.56@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788541037.753156:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680cee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:8715:x1875420955816064:12345-192.168.202.56@tcp:503:mount.lustre.0 Request processed in 150us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541037.753164:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 301 00000100:00100000:1.0:1788541037.758918:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541037.759395:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955816192 00000100:00100000:2.0:1788541037.759408:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955816192 00000100:00100000:2.0:1788541037.759485:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 302 00000100:00100000:2.0:1788541037.759495:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6805288050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:8722:x1875420955816192:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788541037.759643:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6805288050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:8722:x1875420955816192:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 148us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541037.759652:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 302 00000100:00100000:2.0:1788541037.766597:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541037.766687:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955816320 00000100:00100000:0.0:1788541037.766698:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955816320 00000100:00100000:0.0:1788541037.766763:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 303 00000100:00100000:0.0:1788541037.766773:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680528a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:8722:x1875420955816320:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788541037.766970:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680528a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:8722:x1875420955816320:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 197us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541037.766978:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 303 00000100:00100000:1.0:1788541037.770727:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541037.770776:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541037.770801:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541037.770855:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541037.770972:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955816448 00000100:00100000:2.0:1788541037.770983:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955816448 00000100:00100000:2.0:1788541037.771016:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955816704 00000100:00100000:2.0:1788541037.771019:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955816704 00000100:00100000:2.0:1788541037.771035:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955817088 00000100:00100000:2.0:1788541037.771038:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955817088 00000100:00100000:2.0:1788541037.771081:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955817216 00000100:00100000:2.0:1788541037.771085:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955817216 00000100:00100000:2.0:1788541037.771104:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 135 00000100:00100000:2.0:1788541037.771114:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6805674a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+6:2395:x1875420955817088:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1788541037.771186:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6805674a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+6:2395:x1875420955817088:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 73us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541037.771193:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 135 00000100:00100000:2.0:1788541037.771225:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 136 00000100:00100000:2.0:1788541037.771232:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6805675880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+5:2395:x1875420955817216:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1788541037.771259:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6805675880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+5:2395:x1875420955817216:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 27us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541037.771265:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 136 00000100:00100000:2.0:1788541037.771278:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 17 00000100:00100000:2.0:1788541037.771282:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6805677100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2393:x1875420955816448:12345-192.168.202.56@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788541037.771316:0:6519:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 73b94cba-5efa-45eb-b12c-fe84e695d78a@192.168.202.56@tcp t0 exp 0000000000000000 cur 318 last 0 00000020:00000080:2.0:1788541037.771349:0:6519:0:(genops.c:1385:class_connect()) connect: client 73b94cba-5efa-45eb-b12c-fe84e695d78a, cookie 0x2aac941e5f4a77b3 00000004:00100000:2.0:1788541037.771373:0:6519:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788541037.771477:0:6519:0:(import.c:65:import_set_state_nolock()) ffff9a6707749800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788541037.771505:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6805677100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:73b94cba-5efa-45eb-b12c-fe84e695d78a+6:2393:x1875420955816448:12345-192.168.202.56@tcp:38:mount.lustre.0 Request processed in 222us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541037.771512:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 17 00000100:00100000:2.0:1788541037.771525:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 18 00000100:00100000:2.0:1788541037.771529:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6805677b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2393:x1875420955816704:12345-192.168.202.56@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788541037.771543:0:6519:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 73b94cba-5efa-45eb-b12c-fe84e695d78a@192.168.202.56@tcp t0 exp 0000000000000000 cur 318 last 0 00000020:00000080:2.0:1788541037.771564:0:6519:0:(genops.c:1385:class_connect()) connect: client 73b94cba-5efa-45eb-b12c-fe84e695d78a, cookie 0x2aac941e5f4a77ba 00000004:00100000:2.0:1788541037.771576:0:6519:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788541037.771629:0:6519:0:(import.c:65:import_set_state_nolock()) ffff9a670774f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788541037.771652:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6805677b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:73b94cba-5efa-45eb-b12c-fe84e695d78a+6:2393:x1875420955816704:12345-192.168.202.56@tcp:38:mount.lustre.0 Request processed in 122us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541037.771659:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 18 00000100:00080000:1.0:1788541037.772579:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788541037.772586:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788541037.796459:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541037.796502:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541037.796531:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541037.796917:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955816960 00000100:00100000:0.0:1788541037.796929:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955816960 00000100:00100000:3.0:1788541037.796977:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955816832 00000100:00100000:3.0:1788541037.796983:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955816832 00000100:00100000:3.0:1788541037.797007:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955816576 00000100:00100000:3.0:1788541037.797009:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955816576 00000100:00100000:0.0:1788541037.797012:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 19 00000100:00100000:0.0:1788541037.797023:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6805674000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73b94cba-5efa-45eb-b12c-fe84e695d78a+7:8715:x1875420955816960:12345-192.168.202.56@tcp:41:mount.lustre.0 00000100:00100000:3.0:1788541037.797034:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 20 00000100:00100000:3.0:1788541037.797040:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6811425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73b94cba-5efa-45eb-b12c-fe84e695d78a+6:0:x1875420955816832:12345-192.168.202.56@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788541037.797064:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000004:00000024:0.0:1788541037.797070:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788541037.797150:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6811425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73b94cba-5efa-45eb-b12c-fe84e695d78a+6:0:x1875420955816832:12345-192.168.202.56@tcp:41:mount.lustre.0 Request processed in 108us (646us total) trans 0 rc 0/0 00000100:00080000:1.0:1788541037.797155:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788541037.797157:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 20 00000100:00080000:1.0:1788541037.797170:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788541037.797174:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 21 00000100:00100000:3.0:1788541037.797180:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6811427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73b94cba-5efa-45eb-b12c-fe84e695d78a+7:0:x1875420955816576:12345-192.168.202.56@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788541037.797191:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788541037.799254:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6805674000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73b94cba-5efa-45eb-b12c-fe84e695d78a+7:8715:x1875420955816960:12345-192.168.202.56@tcp:41:mount.lustre.0 Request processed in 2222us (2796us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541037.799267:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 19 00000100:00100000:2.0:1788541037.805932:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6811427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73b94cba-5efa-45eb-b12c-fe84e695d78a+6:0:x1875420955816576:12345-192.168.202.56@tcp:41:mount.lustre.0 Request processed in 8737us (9386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541037.805948:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 21 00000100:00100000:2.0:1788541037.814162:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541037.814433:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955817344 00000100:00100000:3.0:1788541037.814448:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955817344 00000100:00100000:3.0:1788541037.814855:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 22 00000100:00100000:3.0:1788541037.814867:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670781bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:73b94cba-5efa-45eb-b12c-fe84e695d78a+6:8715:x1875420955817344:12345-192.168.202.56@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788541037.815012:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670781bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:73b94cba-5efa-45eb-b12c-fe84e695d78a+6:8715:x1875420955817344:12345-192.168.202.56@tcp:40:mount.lustre.0 Request processed in 147us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541037.815031:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 22 00000100:00100000:1.0:1788541037.819321:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541037.819362:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541037.819457:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955817472 00000100:00100000:2.0:1788541037.819468:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955817472 00000100:00100000:2.0:1788541037.819514:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955817600 00000100:00100000:2.0:1788541037.819517:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955817600 00000100:00100000:2.0:1788541037.819535:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 20 00000100:00100000:2.0:1788541037.819544:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6811426680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2393:x1875420955817472:12345-192.168.202.56@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788541037.819611:0:8432:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 73b94cba-5efa-45eb-b12c-fe84e695d78a@192.168.202.56@tcp t0 exp 0000000000000000 cur 318 last 0 00000020:00000080:2.0:1788541037.819648:0:8432:0:(genops.c:1385:class_connect()) connect: client 73b94cba-5efa-45eb-b12c-fe84e695d78a, cookie 0x2aac941e5f4a77c1 00002000:00100000:2.0:1788541037.819662:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 73b94cba-5efa-45eb-b12c-fe84e695d78a/ffff9a670774a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788541037.819683:0:8432:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788541037.820044:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788541037.820089:0:8432:0:(import.c:65:import_set_state_nolock()) ffff9a6707a39000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788541037.820157:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6811426680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:73b94cba-5efa-45eb-b12c-fe84e695d78a+6:2393:x1875420955817472:12345-192.168.202.56@tcp:8:mount.lustre.0 Request processed in 613us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541037.820166:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 20 00000100:00100000:2.0:1788541037.820186:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 21 00000100:00100000:2.0:1788541037.820191:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6811424e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2393:x1875420955817600:12345-192.168.202.56@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788541037.820221:0:8432:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 73b94cba-5efa-45eb-b12c-fe84e695d78a@192.168.202.56@tcp t0 exp 0000000000000000 cur 318 last 0 00000020:00000080:2.0:1788541037.820239:0:8432:0:(genops.c:1385:class_connect()) connect: client 73b94cba-5efa-45eb-b12c-fe84e695d78a, cookie 0x2aac941e5f4a77c8 00002000:00100000:2.0:1788541037.820245:0:8432:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 73b94cba-5efa-45eb-b12c-fe84e695d78a/ffff9a6707a3d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788541037.820257:0:8432:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788541037.820292:0:8432:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788541037.820308:0:8432:0:(import.c:65:import_set_state_nolock()) ffff9a6707a3a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788541037.820333:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6811424e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:73b94cba-5efa-45eb-b12c-fe84e695d78a+6:2393:x1875420955817600:12345-192.168.202.56@tcp:8:mount.lustre.0 Request processed in 140us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541037.820341:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 21 00000100:00100000:1.0:1788541037.833554:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541037.836615:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955817728 00000100:00100000:3.0:1788541037.836630:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955817728 00000100:00100000:3.0:1788541037.836854:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 5 00000100:00100000:3.0:1788541037.836866:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6811424380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:73b94cba-5efa-45eb-b12c-fe84e695d78a+6:8715:x1875420955817728:12345-192.168.202.56@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788541037.836967:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6811424380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:73b94cba-5efa-45eb-b12c-fe84e695d78a+6:8715:x1875420955817728:12345-192.168.202.56@tcp:900:mount.lustre.0 Request processed in 104us (3422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541037.836974:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 5 00000100:00100000:2.0:1788541037.839443:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541037.839546:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955817856 00000100:00100000:3.0:1788541037.839557:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955817856 00000100:00100000:3.0:1788541037.839651:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1 00000100:00100000:3.0:1788541037.839661:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670781b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:73b94cba-5efa-45eb-b12c-fe84e695d78a+6:8715:x1875420955817856:12345-192.168.202.56@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788541037.839853:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788541037.840028:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670781b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:73b94cba-5efa-45eb-b12c-fe84e695d78a+6:8715:x1875420955817856:12345-192.168.202.56@tcp:33:mount.lustre.0 Request processed in 360us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541037.840036:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1 00010000:00010000:2.0:1788541038.154031:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541039.050287:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981057152:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788541039.050380:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541039.052490:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981057280:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788541039.052558:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541039.052942:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981057280 00000100:00100000:0.0:1788541039.052949:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981057280 00000100:00100000:0.0:1788541039.052991:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788541039.052999:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981057280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788541039.053049:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788541039.053100:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981057280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541039.053108:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788541039.053157:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981057280:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788541039.055118:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788541039.055139:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6811426d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981057408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788541039.055219:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541039.055272:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981057152 00000100:00100000:2.0:1788541039.055279:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981057152 00000100:00100000:2.0:1788541039.055324:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981057408 00000100:00100000:2.0:1788541039.055327:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981057408 00000100:00100000:2.0:1788541039.055342:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788541039.055350:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670781ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981057152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788541039.055371:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788541039.056823:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670781ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981057152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1465us (6435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541039.056835:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788541039.056863:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788541039.056901:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670781a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981057408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788541039.056925:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788541039.056976:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670781a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981057408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (1756us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541039.056983:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1788541039.057002:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788541039.057128:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6811426d80 x1875420981057408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541055 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541039.057150:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6811426d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981057408:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788541039.057755:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707b05500 x1875420981057152/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541055 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541039.057772:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981057152:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788541039.178510:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541040.074128:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788541040.074151:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981057536:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788541040.074240:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541040.074349:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981057536 00000100:00100000:2.0:1788541040.074358:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981057536 00000100:00100000:2.0:1788541040.074553:0:10866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788541040.074613:0:10866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6811425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981057536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788541040.074655:0:10866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788541040.074708:0:10866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6811425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981057536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541040.074715:0:10866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788541040.074811:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981057536:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788541040.202322:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541041.098343:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981057664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788541041.098446:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541041.098540:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981057664 00000100:00100000:3.0:1788541041.098550:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981057664 00000100:00100000:3.0:1788541041.098621:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788541041.098633:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981057664:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788541041.099096:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6811424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981057792:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788541041.099150:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541041.099521:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670781b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420981057920:0@lo:400:kworker.0 00000100:00100000:0.0:1788541041.099564:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541041.099604:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981058432:0@lo:400:kworker.0 00000100:00100000:0.0:1788541041.099632:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541041.100012:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981057920 00000100:00100000:2.0:1788541041.100021:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981057920 00000100:00100000:2.0:1788541041.100077:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1788541041.100087:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6805289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+24:3641:x1875420981057920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541041.100846:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670781b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981058944:0@lo:400:kworker.0 00000100:00100000:0.0:1788541041.100911:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541041.100942:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788541041.100950:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707819c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875420981058048:0@lo:400:kworker.0 00000100:00100000:0.0:1788541041.100979:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541041.101013:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707818000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875420981058560:0@lo:400:kworker.0 00000100:00100000:0.0:1788541041.101038:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541041.101059:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875420981059072:0@lo:400:kworker.0 00000100:00100000:0.0:1788541041.101080:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541041.101133:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707818a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875420981058304:0@lo:400:kworker.0 00000100:00100000:0.0:1788541041.101159:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541041.101194:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670781aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981058816:0@lo:400:kworker.0 00000100:00100000:0.0:1788541041.101218:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541041.101241:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788541041.101257:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707819180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981058176:0@lo:400:kworker.0 00000100:00100000:0.0:1788541041.101285:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541041.101305:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707818e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875420981058688:0@lo:400:kworker.0 00000100:00100000:0.0:1788541041.101326:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541041.101337:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875420981059200:0@lo:400:kworker.0 00000100:00100000:0.0:1788541041.101359:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541041.101392:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981058432 00000100:00100000:0.0:1788541041.101399:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981058432 00000100:00100000:0.0:1788541041.101440:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981058176 00000100:00100000:0.0:1788541041.101444:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981058176 00000100:00100000:0.0:1788541041.101461:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788541041.101470:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981058432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541041.101526:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981058432:12345-0@lo:400:kworker.0 Request processed in 56us (1892us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541041.101534:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788541041.101554:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788541041.101560:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706879c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981058176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541041.101595:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706879c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981058176:12345-0@lo:400:kworker.0 Request processed in 35us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541041.101602:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788541041.101622:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981058944 00000100:00100000:0.0:1788541041.101626:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981058944 00000100:00100000:0.0:1788541041.101669:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981058816 00000100:00100000:0.0:1788541041.101673:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981058816 00000100:00100000:0.0:1788541041.101694:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788541041.101701:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981058944:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1788541041.101912:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788541041.101966:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981057664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3335us (3520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541041.101974:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788541041.101990:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981057792 00000100:00100000:3.0:1788541041.101994:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981057792 00000100:00100000:3.0:1788541041.102018:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788541041.102025:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981057792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788541041.102036:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788541041.102064:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981057792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (2914us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541041.102071:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1788541041.102090:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788541041.102095:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788541041.102109:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981058048 00000100:00100000:3.0:1788541041.102114:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981058048 00000100:00100000:3.0:1788541041.102134:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981058560 00000100:00100000:3.0:1788541041.102137:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981058560 00000100:00100000:3.0:1788541041.102156:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981059072 00000100:00100000:3.0:1788541041.102160:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981059072 00000100:00100000:3.0:1788541041.102184:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981058304 00000100:00100000:3.0:1788541041.102187:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981058304 00000100:00100000:3.0:1788541041.102197:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981058688 00000100:00100000:3.0:1788541041.102200:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981058688 00000100:00100000:3.0:1788541041.102212:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981059200 00000100:00100000:3.0:1788541041.102215:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981059200 00000100:00100000:3.0:1788541041.102229:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788541041.102236:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875420981058048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541041.102271:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875420981058048:12345-0@lo:400:kworker.0 Request processed in 36us (1291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541041.102278:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788541041.102298:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788541041.102305:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706879500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875420981058560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541041.102336:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706879500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875420981058560:12345-0@lo:400:kworker.0 Request processed in 32us (1297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541041.102343:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788541041.102354:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788541041.102361:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706878700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875420981059072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541041.102390:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706878700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875420981059072:12345-0@lo:400:kworker.0 Request processed in 29us (1308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541041.102396:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788541041.102407:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788541041.102412:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670687a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875420981058304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541041.102441:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670687a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875420981058304:12345-0@lo:400:kworker.0 Request processed in 29us (1281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541041.102448:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788541041.102460:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788541041.102467:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670687aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875420981058688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541041.102495:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670687aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875420981058688:12345-0@lo:400:kworker.0 Request processed in 30us (1168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541041.102501:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788541041.102512:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788541041.102519:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670687a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875420981059200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541041.102548:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670687a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875420981059200:12345-0@lo:400:kworker.0 Request processed in 30us (1188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541041.102554:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:3.0:1788541041.102578:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788541041.102582:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788541041.102618:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707b06a00 x1875420981057664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541057 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541041.102642:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981057664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788541041.103024:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6805289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+24:3641:x1875420981057920:12345-0@lo:400:kworker.0 Request processed in 2938us (3458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541041.103035:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1788541041.104842:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981058944:12345-0@lo:400:kworker.0 Request processed in 3131us (3921us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541041.104898:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788541041.104935:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788541041.104950:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706879f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981058816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541041.105267:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706879f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981058816:12345-0@lo:400:kworker.0 Request processed in 323us (4047us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541041.105274:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788541041.105379:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707819180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981058176:0@lo:400:kworker.0 00010000:00080000:0.0:1788541041.105399:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707818e00 x1875420981058688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541041.105411:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707818e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875420981058688:0@lo:400:kworker.0 00010000:00080000:0.0:1788541041.105426:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6705aa4000 x1875420981059200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541041.105435:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875420981059200:0@lo:400:kworker.0 00000100:00100000:0.0:1788541041.105450:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707818a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875420981058304:0@lo:400:kworker.0 00010000:00080000:0.0:1788541041.105461:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670781aa00 x1875420981058816/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541041.105470:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670781aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981058816:0@lo:400:kworker.0 00010000:00080000:0.0:1788541041.105483:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6811424a80 x1875420981057792/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541057 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541041.105500:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6811424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981057792:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788541041.105561:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707819c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875420981058048:0@lo:400:kworker.0 00000100:00100000:0.0:1788541041.105586:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707818000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875420981058560:0@lo:400:kworker.0 00000100:00100000:0.0:1788541041.105599:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875420981059072:0@lo:400:kworker.0 00000100:00100000:0.0:1788541041.105610:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670781b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420981057920:0@lo:400:kworker.0 00000100:00100000:0.0:1788541041.105623:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981058432:0@lo:400:kworker.0 00010000:00080000:0.0:1788541041.105635:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670781b480 x1875420981058944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541057 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541041.105657:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670781b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981058944:0@lo:400:kworker.0 00010000:00010000:2.0:1788541041.226086:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541042.253918:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541042.978428:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541042.978485:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541042.978516:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541042.978531:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955817984 00000100:00100000:1.0:1788541042.978544:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541042.978546:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955817984 00000100:00100000:1.0:1788541042.978562:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541042.978578:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541042.978604:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541042.978732:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955818240 00000100:00100000:0.0:1788541042.978737:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955818240 00000100:00100000:0.0:1788541042.978804:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955818496 00000100:00100000:0.0:1788541042.978807:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955818496 00000100:00100000:0.0:1788541042.978823:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955818112 00000100:00100000:0.0:1788541042.978826:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955818112 00000100:00100000:2.0:1788541042.978827:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 305 00000100:00100000:0.0:1788541042.978837:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955818368 00000100:00100000:2.0:1788541042.978839:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6805288850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:2397:x1875420955817984:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541042.978839:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955818368 00000100:00100000:0.0:1788541042.978854:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 143 00000100:00100000:0.0:1788541042.978861:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6811424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+5:2397:x1875420955818240:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1788541042.978975:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6805288850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:2397:x1875420955817984:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 136us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541042.978983:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 305 00000100:00100000:3.0:1788541042.979112:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 144 00000100:00100000:3.0:1788541042.979124:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6811426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:73b94cba-5efa-45eb-b12c-fe84e695d78a+6:2397:x1875420955818496:12345-192.168.202.56@tcp:400:kworker.0 00000100:00080000:1.0:1788541042.979186:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788541042.979192:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788541042.979222:0:6517:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788541042.979234:0:6517:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1788541042.979254:0:6518:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788541042.979264:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 145 00000100:00100000:1.0:1788541042.979272:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+6:2397:x1875420955818112:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541042.979324:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6811424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+5:2397:x1875420955818240:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 462us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541042.979332:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 143 00000100:00100000:0.0:1788541042.979346:0:9339:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1788541042.979353:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 146 00000100:00100000:0.0:1788541042.979359:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b94cba-5efa-45eb-b12c-fe84e695d78a+6:2397:x1875420955818368:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541042.979386:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b94cba-5efa-45eb-b12c-fe84e695d78a+6:2397:x1875420955818368:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 27us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541042.979414:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 146 00000100:00100000:0.0:1788541042.979437:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955818752 00000100:00100000:0.0:1788541042.979441:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955818752 00000100:00100000:0.0:1788541042.979472:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955818624 00000100:00100000:0.0:1788541042.979476:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955818624 00000100:00100000:0.0:1788541042.979497:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 46 00000100:00100000:0.0:1788541042.979505:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:73b94cba-5efa-45eb-b12c-fe84e695d78a+6:2397:x1875420955818752:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541042.979534:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:73b94cba-5efa-45eb-b12c-fe84e695d78a+6:2397:x1875420955818752:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 30us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541042.979541:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 46 00000100:00100000:0.0:1788541042.979553:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 47 00000100:00100000:0.0:1788541042.979559:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:73b94cba-5efa-45eb-b12c-fe84e695d78a+6:2397:x1875420955818624:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541042.979584:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:73b94cba-5efa-45eb-b12c-fe84e695d78a+6:2397:x1875420955818624:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 25us (979us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541042.979590:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 47 00000100:00080000:0.0:1788541042.979619:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788541042.979622:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788541042.983417:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6811426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:73b94cba-5efa-45eb-b12c-fe84e695d78a+6:2397:x1875420955818496:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 4274us (4877us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541042.983438:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 144 00000100:00100000:1.0:1788541042.987625:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+6:2397:x1875420955818112:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 8335us (9042us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541042.987647:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 145 00000001:00100000:0.0:1788541043.155974:0:7448:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 73b94cba-5efa-45eb-b12c-fe84e695d78a 00000001:00100000:3.0:1788541043.156687:0:6496:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 73b94cba-5efa-45eb-b12c-fe84e695d78a 00010000:00010000:2.0:1788541043.275808:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541044.172407:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981059328:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788541044.172512:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541044.174453:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670687ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981059456:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788541044.179970:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981059328 00000100:00100000:2.0:1788541044.180024:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981059328 00000100:00100000:2.0:1788541044.181347:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788541044.181367:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981059328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788541044.181418:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788541044.182546:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541044.182619:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788541044.182633:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981059584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788541044.182689:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788541044.182969:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788541044.183226:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981059328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1862us (10709us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541044.183240:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788541044.183274:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981059584 00000100:00100000:2.0:1788541044.183283:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981059584 00000100:00100000:2.0:1788541044.183327:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788541044.183337:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707819f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981059584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788541044.183363:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788541044.183402:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981059456 00000100:00100000:0.0:1788541044.183413:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981059456 00000100:00100000:2.0:1788541044.183418:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707819f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981059584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541044.183425:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:2.0:1788541044.183445:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788541044.183549:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6705aa7800 x1875420981059328/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541060 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541044.184388:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788541044.184404:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670781b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981059456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788541044.184618:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788541044.184691:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670781b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981059456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 292us (2154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541044.184698:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:0.0:1788541044.185628:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68045e1880 x1875420981059584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541060 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541044.185655:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981059584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788541044.185673:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670687ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981059456:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788541044.186171:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981059328:0@lo:13:osp-pre-0-1.0 00000001:00100000:3.0:1788541044.189456:0:8426:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 73b94cba-5efa-45eb-b12c-fe84e695d78a 00000001:00100000:2.0:1788541044.191440:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 73b94cba-5efa-45eb-b12c-fe84e695d78a 00010000:00010000:1.0:1788541044.300220:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788541044.672547:0:12186:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg256-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:3.0:1788541045.194534:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981059712:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788541045.194610:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541045.194994:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981059712 00000100:00100000:0.0:1788541045.195003:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981059712 00000100:00100000:0.0:1788541045.195147:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788541045.195157:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981059712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788541045.195284:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788541045.195346:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981059712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 190us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541045.195353:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788541045.195429:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981059712:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788541045.322107:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541046.222129:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788541046.222161:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981059840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788541046.222247:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541046.222316:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981060224:0@lo:400:kworker.0 00000100:00100000:1.0:1788541046.222355:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541046.222385:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875420981060736:0@lo:400:kworker.0 00000100:00100000:2.0:1788541046.222388:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981059840 00000100:00100000:2.0:1788541046.222397:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981059840 00000100:00100000:1.0:1788541046.222416:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541046.222438:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875420981061248:0@lo:400:kworker.0 00000100:00100000:1.0:1788541046.222461:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541046.222468:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788541046.222483:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835abdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981059840:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788541046.222486:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788541046.222495:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875420981060352:0@lo:400:kworker.0 00000100:00100000:1.0:1788541046.222521:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1788541046.222523:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788541046.222544:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981060864:0@lo:400:kworker.0 00000100:00100000:1.0:1788541046.222580:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541046.222589:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835abdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981059840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541046.222609:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981061376:0@lo:400:kworker.0 00000100:00100000:2.0:1788541046.222610:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788541046.222638:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788541046.222686:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68045e2d80 x1875420981059840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541062 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541046.222710:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981059840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788541046.222752:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981060224 00000100:00100000:1.0:1788541046.222756:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981060224 00000100:00100000:1.0:1788541046.222796:0:10866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788541046.222805:0:10866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981060224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541046.222854:0:10866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981060224:12345-0@lo:400:kworker.0 Request processed in 51us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541046.222896:0:10866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788541046.222909:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420981059968:0@lo:400:kworker.0 00000100:00100000:1.0:1788541046.222924:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981060736 00000100:00100000:1.0:1788541046.222929:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981060736 00000100:00100000:2.0:1788541046.222946:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541046.222960:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981061248 00000100:00100000:1.0:1788541046.222964:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981061248 00000100:00100000:2.0:1788541046.222982:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981060480:0@lo:400:kworker.0 00000100:00100000:1.0:1788541046.222988:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981060352 00000100:00100000:1.0:1788541046.222993:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981060352 00000100:00100000:1.0:1788541046.223011:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788541046.223015:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541046.223023:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f0fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875420981060736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541046.223039:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981060992:0@lo:400:kworker.0 00000100:00100000:1.0:1788541046.223066:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f0fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875420981060736:12345-0@lo:400:kworker.0 Request processed in 44us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541046.223077:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788541046.223089:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788541046.223096:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f0fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875420981061248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541046.223139:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f0fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875420981061248:12345-0@lo:400:kworker.0 Request processed in 44us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541046.223145:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788541046.223158:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788541046.223164:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f0fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875420981060352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541046.223189:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f0fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875420981060352:12345-0@lo:400:kworker.0 Request processed in 27us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541046.223194:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788541046.223214:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981060864 00000100:00100000:1.0:1788541046.223217:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981060864 00000100:00100000:1.0:1788541046.223241:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981061376 00000100:00100000:1.0:1788541046.223244:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981061376 00000100:00100000:1.0:1788541046.223264:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788541046.223277:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f0fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981060864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541046.223308:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f0fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981060864:12345-0@lo:400:kworker.0 Request processed in 33us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541046.223314:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788541046.223327:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788541046.223333:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f0fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981061376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541046.223358:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f0fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981061376:12345-0@lo:400:kworker.0 Request processed in 26us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541046.223364:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788541046.223409:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875420981060352:0@lo:400:kworker.0 00010000:00080000:1.0:1788541046.223421:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707a26680 x1875420981060864/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541046.223430:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981060864:0@lo:400:kworker.0 00010000:00080000:1.0:1788541046.223441:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707a25180 x1875420981061376/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541046.223449:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981061376:0@lo:400:kworker.0 00010000:00080000:1.0:1788541046.223460:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707a24e00 x1875420981060736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541046.223468:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875420981060736:0@lo:400:kworker.0 00010000:00080000:1.0:1788541046.223477:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707a27100 x1875420981061248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541046.223485:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875420981061248:0@lo:400:kworker.0 00000100:00100000:1.0:1788541046.223495:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981060224:0@lo:400:kworker.0 00000100:00100000:2.0:1788541046.224626:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541046.224687:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788541046.224700:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875420981060096:0@lo:400:kworker.0 00000100:00080000:3.0:1788541046.225270:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788541046.225277:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788541046.225280:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788541046.225518:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541046.225555:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875420981060608:0@lo:400:kworker.0 00000100:00100000:2.0:1788541046.225583:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541046.225603:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875420981061120:0@lo:400:kworker.0 00000100:00100000:2.0:1788541046.225623:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541046.225658:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981060480 00000100:00100000:2.0:1788541046.225665:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981060480 00000100:00100000:2.0:1788541046.225712:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788541046.225721:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981060480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541046.225775:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981060480:12345-0@lo:400:kworker.0 Request processed in 55us (2764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541046.225782:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788541046.225805:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981059968 00000100:00100000:2.0:1788541046.225809:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981059968 00000100:00100000:2.0:1788541046.225835:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1788541046.225841:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6809078850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+24:3641:x1875420981059968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541046.225907:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6809078850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+24:3641:x1875420981059968:12345-0@lo:400:kworker.0 Request processed in 66us (2962us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541046.225914:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1788541046.225916:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981060096 00000100:00100000:3.0:1788541046.225922:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981060096 00000100:00100000:3.0:1788541046.225959:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981060608 00000100:00100000:3.0:1788541046.225963:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981060608 00000100:00100000:2.0:1788541046.225968:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420981059968:0@lo:400:kworker.0 00000100:00100000:3.0:1788541046.225986:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981061120 00000100:00100000:2.0:1788541046.225986:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981060480:0@lo:400:kworker.0 00000100:00100000:3.0:1788541046.225991:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981061120 00000100:00100000:3.0:1788541046.226011:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788541046.226020:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875420981060096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541046.226029:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788541046.226040:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875420981060608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541046.226080:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875420981060096:12345-0@lo:400:kworker.0 Request processed in 61us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541046.226087:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788541046.226113:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788541046.226129:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875420981061120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541046.226207:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981060992 00000100:00100000:1.0:1788541046.226211:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981060992 00000100:00100000:1.0:1788541046.226243:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788541046.226249:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981060992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541046.228418:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875420981060608:12345-0@lo:400:kworker.0 Request processed in 2369us (2823us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541046.228433:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:2.0:1788541046.230696:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788541046.230712:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788541046.231931:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875420981061120:12345-0@lo:400:kworker.0 Request processed in 5800us (6295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541046.231944:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788541046.232002:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670781b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981061504:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788541046.232083:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541046.232207:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981060992:12345-0@lo:400:kworker.0 Request processed in 5955us (9132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541046.232217:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788541046.233002:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875420981060096:0@lo:400:kworker.0 00000100:00100000:3.0:1788541046.233018:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875420981060608:0@lo:400:kworker.0 00000100:00100000:3.0:1788541046.233029:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875420981061120:0@lo:400:kworker.0 00010000:00080000:3.0:1788541046.233044:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707a24380 x1875420981060992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541046.233054:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981060992:0@lo:400:kworker.0 00000100:00100000:3.0:1788541046.233099:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981061504 00000100:00100000:3.0:1788541046.233106:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981061504 00000100:00100000:3.0:1788541046.233173:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788541046.233183:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981061504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788541046.233212:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788541046.233353:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981061504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 171us (1270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541046.233380:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:2.0:1788541046.238115:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670781b100 x1875420981061504/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541062 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541046.238175:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670781b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981061504:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788541046.347015:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541047.378202:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541048.109485:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541048.109525:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541048.109557:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541048.109594:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541048.109616:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541048.109632:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541048.109655:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541048.109681:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955818880 00000100:00100000:2.0:1788541048.109691:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955818880 00000100:00100000:2.0:1788541048.109760:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 307 00000100:00100000:2.0:1788541048.109769:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680907a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:2397:x1875420955818880:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1788541048.109841:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680907a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:2397:x1875420955818880:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 73us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541048.109848:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 307 00000100:00100000:1.0:1788541048.109957:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955819008 00000100:00100000:1.0:1788541048.109961:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955819008 00000100:00100000:1.0:1788541048.109998:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955819264 00000100:00100000:1.0:1788541048.110002:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955819264 00000100:00100000:1.0:1788541048.110013:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955819136 00000100:00100000:1.0:1788541048.110015:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955819136 00000100:00100000:1.0:1788541048.110026:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955819392 00000100:00100000:1.0:1788541048.110028:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955819392 00000100:00100000:1.0:1788541048.110041:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 153 00000100:00100000:1.0:1788541048.110046:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+6:2397:x1875420955819008:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1788541048.110078:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+6:2397:x1875420955819008:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 32us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541048.110084:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 153 00000100:00100000:1.0:1788541048.110099:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 154 00000100:00100000:1.0:1788541048.110117:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2397:x1875420955819264:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1788541048.110142:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2397:x1875420955819264:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 27us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541048.110149:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 154 00000100:00100000:1.0:1788541048.110160:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 155 00000100:00100000:1.0:1788541048.110175:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+5:2397:x1875420955819136:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1788541048.110200:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+5:2397:x1875420955819136:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 27us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541048.110206:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 155 00000100:00100000:1.0:1788541048.110219:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 156 00000100:00100000:1.0:1788541048.110225:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2397:x1875420955819392:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1788541048.110248:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2397:x1875420955819392:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 24us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541048.110255:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 156 00000100:00100000:1.0:1788541048.110274:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955819520 00000100:00100000:1.0:1788541048.110278:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955819520 00000100:00100000:1.0:1788541048.110300:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955819648 00000100:00100000:1.0:1788541048.110303:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955819648 00000100:00100000:1.0:1788541048.110324:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 51 00000100:00100000:1.0:1788541048.110330:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2397:x1875420955819520:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1788541048.110355:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2397:x1875420955819520:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 25us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541048.110361:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 51 00000100:00100000:1.0:1788541048.110373:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 52 00000100:00100000:1.0:1788541048.110379:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2397:x1875420955819648:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1788541048.110401:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2397:x1875420955819648:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 22us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541048.110407:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 52 00000100:00080000:0.0:1788541048.110672:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788541048.110677:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788541048.110679:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788541048.110681:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788541048.395313:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541049.290557:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707818000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981061632:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788541049.290636:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541049.290916:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f0ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981061760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788541049.291798:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541049.292122:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981061632 00000100:00100000:2.0:1788541049.292131:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981061632 00000100:00100000:2.0:1788541049.292175:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788541049.292184:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981061632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788541049.292219:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788541049.292273:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981061632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (1636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541049.292280:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788541049.292331:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707818000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981061632:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788541049.292408:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981061888:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788541049.292442:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541049.292848:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981061760 00000100:00100000:3.0:1788541049.292853:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981061760 00000100:00100000:3.0:1788541049.292912:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981061888 00000100:00100000:3.0:1788541049.292916:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981061888 00000100:00100000:3.0:1788541049.292934:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788541049.292943:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707819c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981061760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788541049.292966:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788541049.293013:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707819c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981061760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (1217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541049.293021:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788541049.293041:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00010000:00080000:1.0:1788541049.293044:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a683f0ff480 x1875420981061760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541065 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541049.293048:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670781aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981061888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788541049.293057:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788541049.293088:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f0ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981061760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788541049.293105:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670781aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981061888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541049.293112:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:0.0:1788541049.293283:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788541049.293306:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707a24a80 x1875420981061888/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541065 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541049.293320:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981061888:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788541049.418280:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541050.314044:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788541050.314068:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981062016:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788541050.314157:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541050.314220:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981062016 00000100:00100000:3.0:1788541050.314227:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981062016 00000100:00100000:3.0:1788541050.314271:0:10866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788541050.314280:0:10866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981062016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788541050.314313:0:10866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788541050.314358:0:10866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981062016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541050.314378:0:10866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788541050.314432:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981062016:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788541050.442111:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541051.338117:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f0ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981062144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788541051.338246:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541051.338310:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875420981062656:0@lo:400:kworker.0 00000100:00100000:3.0:1788541051.338336:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541051.338339:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f0fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875420981062400:0@lo:400:kworker.0 00000100:00100000:3.0:1788541051.338355:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981063168:0@lo:400:kworker.0 00000100:00100000:1.0:1788541051.338383:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541051.338385:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541051.338408:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875420981062912:0@lo:400:kworker.0 00000100:00100000:3.0:1788541051.338410:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981063680:0@lo:400:kworker.0 00000100:00100000:3.0:1788541051.338429:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541051.338429:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541051.338445:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875420981063424:0@lo:400:kworker.0 00000100:00100000:3.0:1788541051.338446:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788541051.338451:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981062528:0@lo:400:kworker.0 00000100:00100000:1.0:1788541051.338464:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541051.338482:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541051.338487:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788541051.338492:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f0fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:425687b6-1d99-41d2-88d8-2fb230997596:3644:1875420981062272:0@lo:400:kworker.0 00000100:00100000:3.0:1788541051.338497:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875420981063040:0@lo:400:kworker.0 00000100:00100000:2.0:1788541051.338725:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707818a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981063808:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788541051.338757:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541051.338825:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981062144 00000100:00100000:0.0:1788541051.338834:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981062144 00000100:00100000:0.0:1788541051.338914:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981063808 00000100:00100000:0.0:1788541051.338918:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981063808 00000100:00100000:0.0:1788541051.338947:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788541051.338956:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981062144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788541051.338989:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788541051.339032:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981062144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541051.339039:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788541051.339057:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788541051.339063:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981063808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788541051.339083:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788541051.339112:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981063808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541051.339117:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1788541051.339414:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788541051.339448:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707818a80 x1875420981063808/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541067 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541051.339466:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707818a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981063808:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788541051.339528:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541051.339560:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981062784:0@lo:400:kworker.0 00000100:00100000:1.0:1788541051.339588:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541051.339614:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981063296:0@lo:400:kworker.0 00000100:00100000:1.0:1788541051.339636:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541051.339669:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981062656 00000100:00100000:1.0:1788541051.339673:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981062656 00000100:00100000:1.0:1788541051.339703:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981062400 00000100:00100000:1.0:1788541051.339706:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981062400 00000100:00100000:1.0:1788541051.339717:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981062912 00000100:00100000:1.0:1788541051.339720:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981062912 00000100:00100000:1.0:1788541051.339736:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981063424 00000100:00100000:1.0:1788541051.339739:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981063424 00000100:00100000:1.0:1788541051.339752:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788541051.339758:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875420981062656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541051.339812:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875420981062656:12345-0@lo:400:kworker.0 Request processed in 53us (1474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541051.339818:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788541051.339832:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788541051.339838:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875420981062400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541051.339866:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875420981062400:12345-0@lo:400:kworker.0 Request processed in 29us (1483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541051.339894:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788541051.339905:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788541051.339911:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875420981062912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541051.340005:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875420981062912:12345-0@lo:400:kworker.0 Request processed in 94us (1575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541051.340011:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788541051.340023:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788541051.340030:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875420981063424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541051.340056:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875420981063424:12345-0@lo:400:kworker.0 Request processed in 27us (1591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541051.340062:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788541051.340098:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981063168 00000100:00100000:1.0:1788541051.340102:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981063168 00000100:00100000:1.0:1788541051.340126:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981063680 00000100:00100000:1.0:1788541051.340129:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981063680 00000100:00100000:1.0:1788541051.340138:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981063296 00000100:00100000:1.0:1788541051.340141:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981063296 00000100:00100000:1.0:1788541051.340152:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788541051.340158:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981063168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541051.340197:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981063168:12345-0@lo:400:kworker.0 Request processed in 39us (1810us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541051.340204:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788541051.340215:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788541051.340220:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981063680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541051.340247:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981063680:12345-0@lo:400:kworker.0 Request processed in 27us (1817us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541051.340253:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788541051.340263:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788541051.340268:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708080700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981063296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541051.340292:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708080700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981063296:12345-0@lo:400:kworker.0 Request processed in 23us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541051.340298:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1788541051.340313:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788541051.340316:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788541051.340334:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68355b6680 x1875420981063296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541051.340344:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981063296:0@lo:400:kworker.0 00000100:00100000:1.0:1788541051.340355:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f0fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875420981062400:0@lo:400:kworker.0 00000100:00100000:1.0:1788541051.340365:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875420981062912:0@lo:400:kworker.0 00000100:00100000:1.0:1788541051.340375:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875420981063424:0@lo:400:kworker.0 00000100:00100000:2.0:1788541051.340479:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981062272 00000100:00100000:2.0:1788541051.340483:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981062272 00000100:00100000:2.0:1788541051.340525:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1788541051.340531:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680907ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+24:3644:x1875420981062272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541051.340567:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680907ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+24:3644:x1875420981062272:12345-0@lo:400:kworker.0 Request processed in 36us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541051.340573:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1788541051.340605:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f0fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:425687b6-1d99-41d2-88d8-2fb230997596:3644:1875420981062272:0@lo:400:kworker.0 00000100:00100000:0.0:1788541051.340699:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981062528 00000100:00100000:0.0:1788541051.340704:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981062528 00000100:00100000:0.0:1788541051.340737:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981062784 00000100:00100000:0.0:1788541051.340740:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981062784 00000100:00100000:0.0:1788541051.340752:0:10866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788541051.340765:0:10866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981062528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541051.340800:0:10866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981062528:12345-0@lo:400:kworker.0 Request processed in 36us (2317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541051.340808:0:10866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788541051.340820:0:10866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788541051.340825:0:10866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981062784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541051.340864:0:10866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981062784:12345-0@lo:400:kworker.0 Request processed in 39us (1275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541051.340890:0:10866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788541051.340997:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981062784:0@lo:400:kworker.0 00000100:00100000:3.0:1788541051.341903:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541051.341935:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875420981063552:0@lo:400:kworker.0 00000100:00100000:2.0:1788541051.341941:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981063040 00000100:00100000:2.0:1788541051.341945:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981063040 00000100:00100000:3.0:1788541051.341969:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541051.341977:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981063552 00000100:00100000:2.0:1788541051.341980:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981063552 00000100:00100000:2.0:1788541051.341996:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00010000:00080000:3.0:1788541051.341999:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68355b6d80 x1875420981063680/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541051.342002:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875420981063040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541051.342010:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981063680:0@lo:400:kworker.0 00000100:00100000:3.0:1788541051.342022:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875420981062656:0@lo:400:kworker.0 00010000:00080000:3.0:1788541051.342033:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68355b7b80 x1875420981063168/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541051.342035:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875420981063040:12345-0@lo:400:kworker.0 Request processed in 34us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541051.342040:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788541051.342051:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981063168:0@lo:400:kworker.0 00000100:00100000:2.0:1788541051.342052:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788541051.342057:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875420981063552:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788541051.342065:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a683f0ff480 x1875420981062144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541067 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541051.342093:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f0ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981062144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788541051.342094:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875420981063552:12345-0@lo:400:kworker.0 Request processed in 37us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541051.342100:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788541051.342123:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981062528:0@lo:400:kworker.0 00010000:00080000:3.0:1788541051.342133:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68355b4700 x1875420981063040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541051.342141:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875420981063040:0@lo:400:kworker.0 00010000:00080000:3.0:1788541051.342150:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68355b5880 x1875420981063552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541051.342157:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875420981063552:0@lo:400:kworker.0 00000100:00080000:1.0:1788541051.342218:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788541051.469142:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541052.502440:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788541053.107440:0:12503:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788541053.107704:0:12503:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788541053.219196:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541053.219256:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541053.219435:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955819776 00000100:00100000:1.0:1788541053.219447:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955819776 00000100:00100000:1.0:1788541053.219510:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 309 00000100:00100000:1.0:1788541053.219520:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6809078450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:2395:x1875420955819776:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1788541053.219588:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6809078450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:2395:x1875420955819776:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 70us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541053.219596:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 309 00000100:00100000:3.0:1788541053.219685:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955819904 00000100:00100000:3.0:1788541053.219690:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955819904 00000100:00100000:3.0:1788541053.219744:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 163 00000100:00100000:3.0:1788541053.219752:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707818e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+6:2395:x1875420955819904:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541053.219784:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707818e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+6:2395:x1875420955819904:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 33us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541053.219790:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 163 00000100:00080000:1.0:1788541053.220158:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788541053.224715:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541053.224748:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541053.224776:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541053.224795:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541053.224819:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541053.224847:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955820032 00000100:00100000:0.0:1788541053.224856:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955820032 00000100:00100000:0.0:1788541053.224932:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955820288 00000100:00100000:0.0:1788541053.224936:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955820288 00000100:00100000:0.0:1788541053.224957:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955820160 00000100:00100000:0.0:1788541053.224960:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955820160 00000100:00100000:0.0:1788541053.224979:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 164 00000100:00100000:0.0:1788541053.224989:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707819180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+5:2397:x1875420955820032:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541053.225074:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707819180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+5:2397:x1875420955820032:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 86us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541053.225081:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 164 00000100:00100000:0.0:1788541053.225111:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 165 00000100:00100000:0.0:1788541053.225118:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707818a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2397:x1875420955820288:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541053.225141:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707818a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2397:x1875420955820288:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 25us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541053.225160:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 165 00000100:00100000:0.0:1788541053.225172:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 166 00000100:00100000:0.0:1788541053.225178:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670781b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2397:x1875420955820160:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541053.225197:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670781b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2397:x1875420955820160:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 20us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541053.225203:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 166 00000100:00100000:0.0:1788541053.225220:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955820544 00000100:00100000:0.0:1788541053.225223:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955820544 00000100:00100000:0.0:1788541053.225256:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955820416 00000100:00100000:0.0:1788541053.225260:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955820416 00000100:00100000:0.0:1788541053.225282:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 56 00000100:00100000:0.0:1788541053.225288:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707818000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2397:x1875420955820544:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541053.225314:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707818000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2397:x1875420955820544:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 26us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541053.225320:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 56 00000100:00100000:0.0:1788541053.225332:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 57 00000100:00100000:0.0:1788541053.225338:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707819500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2397:x1875420955820416:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541053.225361:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707819500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2397:x1875420955820416:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 24us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541053.225367:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 57 00000100:00080000:0.0:1788541053.225406:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788541053.225410:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788541053.225413:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788541053.225414:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788541053.516357:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541054.410073:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788541054.410096:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6805674e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981063936:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788541054.410168:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541054.410267:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981063936 00000100:00100000:0.0:1788541054.410275:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981063936 00000100:00100000:0.0:1788541054.410343:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788541054.410354:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981063936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788541054.410386:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788541054.410436:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981063936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541054.410443:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:0.0:1788541054.410488:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6805674e00 x1875420981063936/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541070 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541054.410508:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6805674e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981063936:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788541054.410557:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788541054.413174:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981064064:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788541054.413238:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541054.413293:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981064064 00000100:00100000:1.0:1788541054.413300:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981064064 00000100:00100000:1.0:1788541054.413342:0:10866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788541054.413349:0:10866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981064064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788541054.413383:0:10866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788541054.413427:0:10866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981064064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541054.413435:0:10866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788541054.413485:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708082a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981064064:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788541054.416712:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707818700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981064192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788541054.416786:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541054.417426:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981064192 00000100:00100000:0.0:1788541054.417436:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981064192 00000100:00100000:0.0:1788541054.417501:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788541054.417511:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708082a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981064192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788541054.417536:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788541054.417599:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708082a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981064192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541054.417606:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1788541054.417658:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788541054.417809:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707818700 x1875420981064192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541070 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541054.417831:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707818700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981064192:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788541054.545339:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788541055.294262:0:12600:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788541055.294606:0:12600:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788541055.438433:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788541055.438456:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708080380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981064320:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788541055.438529:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541055.438608:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981064320 00000100:00100000:1.0:1788541055.438616:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981064320 00000100:00100000:1.0:1788541055.438672:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788541055.438682:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708082300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981064320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788541055.438717:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788541055.438809:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708082300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981064320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 128us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541055.438817:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788541055.438896:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708080380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981064320:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788541055.562212:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541056.458233:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708080380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:425687b6-1d99-41d2-88d8-2fb230997596:3644:1875420981064448:0@lo:400:kworker.0 00000100:00100000:2.0:1788541056.458319:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541056.458376:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981064576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788541056.458406:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541056.458418:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875420981064960:0@lo:400:kworker.0 00000100:00100000:2.0:1788541056.458436:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981065088:0@lo:400:kworker.0 00000100:00100000:2.0:1788541056.458590:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541056.458646:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f0fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981065600:0@lo:400:kworker.0 00000100:00100000:2.0:1788541056.458682:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541056.458700:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981066112:0@lo:400:kworker.0 00000100:00100000:2.0:1788541056.458728:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541056.458758:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981064576 00000100:00100000:2.0:1788541056.458765:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981064576 00000100:00100000:2.0:1788541056.458811:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788541056.458820:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981064576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788541056.459198:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788541056.459248:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981064576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 429us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541056.459256:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788541056.460460:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981065600 00000100:00100000:2.0:1788541056.460471:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981065600 00000100:00100000:2.0:1788541056.460514:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981066112 00000100:00100000:2.0:1788541056.460517:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981066112 00000100:00100000:2.0:1788541056.460537:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788541056.460545:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981065600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541056.460822:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981065600:12345-0@lo:400:kworker.0 Request processed in 277us (2139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541056.460830:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788541056.461054:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981065088 00000100:00100000:3.0:1788541056.461060:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981065088 00000100:00100000:2.0:1788541056.461190:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788541056.461198:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981066112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541056.461232:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981066112:12345-0@lo:400:kworker.0 Request processed in 37us (2514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541056.461238:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:2.0:1788541056.461263:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788541056.461267:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788541056.462427:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788541056.462440:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981065088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541056.462521:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981065088:12345-0@lo:400:kworker.0 Request processed in 84us (3930us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541056.462529:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788541056.464362:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981065088:0@lo:400:kworker.0 00010000:00080000:2.0:1788541056.464382:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a683f0fd500 x1875420981065600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541056.464393:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f0fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981065600:0@lo:400:kworker.0 00010000:00080000:2.0:1788541056.464405:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68355b6d80 x1875420981066112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541056.464412:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981066112:0@lo:400:kworker.0 00010000:00080000:2.0:1788541056.464422:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707b04380 x1875420981064576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541072 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541056.464439:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981064576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788541056.464983:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981064832:0@lo:400:kworker.0 00000100:00100000:2.0:1788541056.465056:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541056.465214:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f0ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875420981065344:0@lo:400:kworker.0 00000100:00100000:2.0:1788541056.465260:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541056.465285:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875420981065856:0@lo:400:kworker.0 00000100:00100000:2.0:1788541056.465306:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541056.465334:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1788541056.465342:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708081500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875420981064704:0@lo:400:kworker.0 00000100:00100000:2.0:1788541056.465363:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541056.465382:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875420981065216:0@lo:400:kworker.0 00000100:00100000:2.0:1788541056.465400:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541056.465417:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875420981065728:0@lo:400:kworker.0 00000100:00100000:2.0:1788541056.465436:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541056.465450:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981066240:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788541056.465471:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541056.465510:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981065344 00000100:00100000:2.0:1788541056.465517:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981065344 00000100:00100000:2.0:1788541056.465561:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981065856 00000100:00100000:2.0:1788541056.465565:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981065856 00000100:00100000:2.0:1788541056.465591:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981064704 00000100:00100000:2.0:1788541056.465594:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981064704 00000100:00100000:2.0:1788541056.465605:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981065216 00000100:00100000:2.0:1788541056.465608:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981065216 00000100:00100000:2.0:1788541056.465618:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981065728 00000100:00100000:2.0:1788541056.465620:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981065728 00000100:00100000:2.0:1788541056.465635:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788541056.465644:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875420981065344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541056.465708:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875420981065344:12345-0@lo:400:kworker.0 Request processed in 65us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541056.465714:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788541056.465816:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788541056.465823:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875420981065856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541056.465940:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875420981065856:12345-0@lo:400:kworker.0 Request processed in 117us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541056.465946:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788541056.465959:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788541056.465965:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875420981064704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541056.466335:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981064832 00000100:00100000:3.0:1788541056.466341:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981064832 00000100:00100000:3.0:1788541056.466371:0:10866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788541056.466377:0:10866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f0fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981064832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541056.466421:0:10866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f0fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981064832:12345-0@lo:400:kworker.0 Request processed in 44us (1364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541056.466428:0:10866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788541056.466448:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788541056.466456:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875420981065216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541056.466487:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875420981065216:12345-0@lo:400:kworker.0 Request processed in 32us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541056.466493:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788541056.466506:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788541056.466512:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875420981065728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541056.466539:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875420981065728:12345-0@lo:400:kworker.0 Request processed in 28us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541056.466544:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788541056.466619:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875420981064704:12345-0@lo:400:kworker.0 Request processed in 654us (1254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541056.466625:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:2.0:1788541056.466654:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788541056.466658:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788541056.466668:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981066240 00000100:00100000:2.0:1788541056.466672:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981066240 00000100:00100000:2.0:1788541056.466714:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1788541056.467227:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788541056.467343:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981066240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788541056.467364:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788541056.467407:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981066240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 688us (1935us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541056.467414:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788541056.467465:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708081500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875420981064704:0@lo:400:kworker.0 00000100:00100000:2.0:1788541056.467479:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875420981065216:0@lo:400:kworker.0 00000100:00100000:2.0:1788541056.467489:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875420981065728:0@lo:400:kworker.0 00010000:00080000:2.0:1788541056.467501:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707b04000 x1875420981066240/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541072 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541056.467539:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981066240:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788541056.467556:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981064832:0@lo:400:kworker.0 00010000:00080000:2.0:1788541056.467581:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a683f0ff480 x1875420981065344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541056.467590:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f0ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875420981065344:0@lo:400:kworker.0 00010000:00080000:2.0:1788541056.467605:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68355b4700 x1875420981065856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541056.467613:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875420981065856:0@lo:400:kworker.0 00000100:00100000:1.0:1788541056.469305:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541056.469360:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f0fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981065472:0@lo:400:kworker.0 00000100:00100000:1.0:1788541056.469412:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541056.469420:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981064960 00000100:00100000:3.0:1788541056.469428:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981064960 00000100:00100000:1.0:1788541056.469435:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981065984:0@lo:400:kworker.0 00000100:00100000:3.0:1788541056.469480:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788541056.469489:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875420981064960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541056.469540:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875420981064960:12345-0@lo:400:kworker.0 Request processed in 52us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541056.469560:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788541056.469699:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981065472 00000100:00100000:2.0:1788541056.469703:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981065472 00000100:00100000:2.0:1788541056.469828:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788541056.469846:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981065472:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788541056.469948:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788541056.477120:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541056.477171:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981065984 00000100:00100000:1.0:1788541056.477180:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981065984 00000100:00100000:1.0:1788541056.477230:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788541056.477241:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981065984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541056.477303:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981065984:12345-0@lo:400:kworker.0 Request processed in 65us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541056.477311:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788541056.477347:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981064448 00000100:00100000:1.0:1788541056.477351:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981064448 00000100:00100000:1.0:1788541056.477376:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1788541056.477382:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807634850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+24:3644:x1875420981064448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541056.477418:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807634850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+24:3644:x1875420981064448:12345-0@lo:400:kworker.0 Request processed in 35us (19099us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541056.477424:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1788541056.477492:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708080380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:425687b6-1d99-41d2-88d8-2fb230997596:3644:1875420981064448:0@lo:400:kworker.0 00010000:00080000:1.0:1788541056.477529:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68355b7b80 x1875420981065984/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541056.477541:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981065984:0@lo:400:kworker.0 00000100:00100000:1.0:1788541056.477559:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875420981064960:0@lo:400:kworker.0 00010000:00080000:1.0:1788541056.477569:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a683f0fc380 x1875420981065472/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541056.477577:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f0fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981065472:0@lo:400:kworker.0 00000100:00100000:2.0:1788541056.489250:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981065472:12345-0@lo:400:kworker.0 Request processed in 19400us (19822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541056.489268:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00010000:0.0:1788541056.587345:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541057.614223:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788541057.701484:0:12697:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788541057.701728:0:12697:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788541058.345301:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541058.345341:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541058.345363:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541058.345380:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541058.345401:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541058.345426:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955820928 00000100:00100000:3.0:1788541058.345435:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955820928 00000100:00100000:2.0:1788541058.345637:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955820672 00000100:00100000:2.0:1788541058.345642:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955820672 00000100:00100000:2.0:1788541058.345692:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 311 00000100:00100000:2.0:1788541058.345825:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:2396:x1875420955820672:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1788541058.345994:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:2396:x1875420955820672:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 292us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541058.346027:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 311 00000100:00100000:2.0:1788541058.346063:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955821184 00000100:00100000:2.0:1788541058.346067:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955821184 00000100:00100000:3.0:1788541058.347065:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955820800 00000100:00100000:3.0:1788541058.347071:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955820800 00000100:00100000:0.0:1788541058.347974:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541058.348403:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541058.348444:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955821056 00000100:00100000:0.0:1788541058.348451:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955821056 00000100:00100000:2.0:1788541058.348594:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 173 00000100:00100000:2.0:1788541058.348605:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+5:2396:x1875420955820928:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1788541058.348672:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+5:2396:x1875420955820928:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 68us (3329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541058.348680:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 173 00000100:00100000:2.0:1788541058.348696:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 174 00000100:00100000:2.0:1788541058.348703:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2396:x1875420955821184:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1788541058.348738:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2396:x1875420955821184:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 35us (3374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541058.348744:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 174 00000100:00100000:3.0:1788541058.349703:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 175 00000100:00100000:3.0:1788541058.349722:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+6:2396:x1875420955820800:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541058.349777:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+6:2396:x1875420955820800:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 66us (4395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541058.349784:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 175 00000100:00100000:3.0:1788541058.349810:0:8973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955821312 00000100:00100000:3.0:1788541058.349816:0:8973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955821312 00000100:00100000:3.0:1788541058.349857:0:8973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955821440 00000100:00100000:3.0:1788541058.349861:0:8973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955821440 00000100:00100000:3.0:1788541058.349903:0:8973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 22 00000100:00100000:3.0:1788541058.349910:0:8973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670781ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2393:x1875420955821312:12345-192.168.202.56@tcp:9:kworker.0 00000020:00000080:3.0:1788541058.349930:0:8973:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a77c1 00000100:00080000:3.0:1788541058.349938:0:8973:0:(import.c:65:import_set_state_nolock()) ffff9a6707a39000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788541058.349985:0:8973:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788541058.350117:0:8973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670781ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:73b94cba-5efa-45eb-b12c-fe84e695d78a+2:2393:x1875420955821312:12345-192.168.202.56@tcp:9:kworker.0 Request processed in 206us (2149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541058.350137:0:8973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 22 00000100:00100000:3.0:1788541058.350150:0:8973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 23 00000100:00100000:3.0:1788541058.350156:0:8973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670781a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2393:x1875420955821440:12345-192.168.202.56@tcp:9:kworker.0 00000020:00000080:3.0:1788541058.350167:0:8973:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a77c8 00000100:00080000:3.0:1788541058.350173:0:8973:0:(import.c:65:import_set_state_nolock()) ffff9a6707a3a800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788541058.350198:0:8973:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788541058.350549:0:8973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670781a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:73b94cba-5efa-45eb-b12c-fe84e695d78a+2:2393:x1875420955821440:12345-192.168.202.56@tcp:9:kworker.0 Request processed in 392us (2146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541058.350556:0:8973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 23 00010000:00010000:3.0:1788541058.350578:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541058.350584:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788541058.350860:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788541058.350865:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788541058.350878:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788541058.350880:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788541058.357478:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 176 00000100:00100000:0.0:1788541058.357495:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2396:x1875420955821056:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541058.357587:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2396:x1875420955821056:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 96us (12185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541058.357596:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 176 00010000:00010000:0.0:1788541058.634364:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541059.532335:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981066368:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788541059.532406:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541059.532486:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981066368 00000100:00100000:1.0:1788541059.532494:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981066368 00000100:00100000:1.0:1788541059.532548:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788541059.532557:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981066368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788541059.532605:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788541059.532652:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981066368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541059.532659:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1788541059.532679:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788541059.532707:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68355b7b80 x1875420981066368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541075 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541059.532737:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981066368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788541059.532956:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788541059.532966:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981066496:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788541059.533010:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541059.533046:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981066496 00000100:00100000:3.0:1788541059.533050:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981066496 00000100:00100000:3.0:1788541059.533077:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788541059.533083:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981066496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788541059.533107:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788541059.533143:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981066496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541059.533150:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788541059.533193:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981066496:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788541059.538525:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981066624:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788541059.538595:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541059.538742:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981066624 00000100:00100000:0.0:1788541059.538751:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981066624 00000100:00100000:0.0:1788541059.538818:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788541059.538838:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981066624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788541059.538861:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1788541059.538946:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788541059.553919:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981066624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 15073us (15314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541059.553934:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:3.0:1788541059.554229:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707b04000 x1875420981066624/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541075 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541059.554270:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981066624:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788541059.658705:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788541059.903726:0:12794:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788541059.904028:0:12794:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788541060.560467:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981066752:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788541060.560547:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541060.560634:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981066752 00000100:00100000:0.0:1788541060.560641:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981066752 00000100:00100000:0.0:1788541060.560691:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788541060.560700:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981066752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788541060.560744:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788541060.574631:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981066752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 13919us (14070us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541060.574645:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788541060.576698:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981066752:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788541060.683077:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541061.578952:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420981066880:0@lo:400:kworker.0 00000100:00100000:3.0:1788541061.579039:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541061.579059:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875420981067264:0@lo:400:kworker.0 00000100:00100000:1.0:1788541061.579092:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541061.579094:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981067392:0@lo:400:kworker.0 00000100:00100000:1.0:1788541061.579111:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670691ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981067776:0@lo:400:kworker.0 00000100:00100000:3.0:1788541061.579118:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541061.579133:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541061.579134:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670691a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981067904:0@lo:400:kworker.0 00000100:00100000:1.0:1788541061.579149:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706919f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981068288:0@lo:400:kworker.0 00000100:00100000:3.0:1788541061.579163:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541061.579188:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670691aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981068416:0@lo:400:kworker.0 00000100:00100000:1.0:1788541061.579192:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541061.579210:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541061.579236:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706919500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875420981067008:0@lo:400:kworker.0 00000100:00100000:3.0:1788541061.579259:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541061.579288:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706918380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875420981067520:0@lo:400:kworker.0 00000100:00100000:3.0:1788541061.579309:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541061.579335:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670691b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875420981068032:0@lo:400:kworker.0 00000100:00100000:3.0:1788541061.579355:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541061.579370:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788541061.579389:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670691b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981067136:0@lo:400:kworker.0 00000100:00100000:3.0:1788541061.579426:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541061.579442:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670691bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875420981067648:0@lo:400:kworker.0 00000100:00100000:3.0:1788541061.579461:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541061.579475:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706919180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875420981068160:0@lo:400:kworker.0 00000100:00100000:0.0:1788541061.579489:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981067264 00000100:00100000:0.0:1788541061.579497:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981067264 00000100:00100000:3.0:1788541061.579501:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541061.579524:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981066880 00000100:00100000:3.0:1788541061.579527:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981066880 00000100:00100000:0.0:1788541061.579531:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981067008 00000100:00100000:0.0:1788541061.579539:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981067008 00000100:00100000:0.0:1788541061.579551:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981067520 00000100:00100000:3.0:1788541061.579553:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1788541061.579553:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981067520 00000100:00100000:3.0:1788541061.579561:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+24:3642:x1875420981066880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541061.579572:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981068032 00000100:00100000:0.0:1788541061.579574:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981068032 00000100:00100000:0.0:1788541061.579586:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981067648 00000100:00100000:0.0:1788541061.579589:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981067648 00000100:00100000:0.0:1788541061.579600:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981068160 00000100:00100000:0.0:1788541061.579613:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981068160 00000100:00100000:0.0:1788541061.579631:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788541061.579637:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875420981067264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541061.579699:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875420981067264:12345-0@lo:400:kworker.0 Request processed in 61us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541061.579706:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788541061.579727:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788541061.579733:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875420981067008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541061.579765:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875420981067008:12345-0@lo:400:kworker.0 Request processed in 33us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541061.579771:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788541061.579781:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788541061.579788:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875420981067520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541061.579812:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875420981067520:12345-0@lo:400:kworker.0 Request processed in 25us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541061.579818:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788541061.579829:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788541061.579834:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707ade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875420981068032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541061.579857:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707ade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875420981068032:12345-0@lo:400:kworker.0 Request processed in 23us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541061.579891:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788541061.579903:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788541061.579908:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875420981067648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541061.579935:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875420981067648:12345-0@lo:400:kworker.0 Request processed in 28us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541061.579940:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788541061.579950:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788541061.579955:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875420981068160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541061.579991:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875420981068160:12345-0@lo:400:kworker.0 Request processed in 25us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541061.579997:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00080000:0.0:1788541061.580021:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788541061.580025:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788541061.580045:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+24:3642:x1875420981066880:12345-0@lo:400:kworker.0 Request processed in 484us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541061.580052:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1788541061.580064:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875420981067264:0@lo:400:kworker.0 00000100:00100000:3.0:1788541061.580083:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981067392 00000100:00100000:3.0:1788541061.580087:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981067392 00010000:00080000:0.0:1788541061.580093:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670691bb80 x1875420981067648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541061.580104:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670691bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875420981067648:0@lo:400:kworker.0 00000100:00100000:3.0:1788541061.580107:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981067136 00000100:00100000:3.0:1788541061.580109:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981067136 00010000:00080000:0.0:1788541061.580115:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6706919180 x1875420981068160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541061.580120:0:10866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788541061.580123:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706919180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875420981068160:0@lo:400:kworker.0 00000100:00100000:3.0:1788541061.580126:0:10866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981067392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541061.580133:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706919500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875420981067008:0@lo:400:kworker.0 00000100:00100000:0.0:1788541061.580141:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706918380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875420981067520:0@lo:400:kworker.0 00000100:00100000:0.0:1788541061.580150:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670691b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875420981068032:0@lo:400:kworker.0 00000100:00100000:0.0:1788541061.580187:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788541061.580195:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981067136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541061.580217:0:10866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981067392:12345-0@lo:400:kworker.0 Request processed in 90us (1097us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541061.580223:0:10866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788541061.580228:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981067136:12345-0@lo:400:kworker.0 Request processed in 36us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541061.580234:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788541061.580893:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670691b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981067136:0@lo:400:kworker.0 00000100:00100000:0.0:1788541061.581335:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788541061.581347:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981068544:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788541061.581396:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541061.581437:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981068544 00000100:00100000:0.0:1788541061.581444:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981068544 00000100:00100000:0.0:1788541061.581485:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788541061.581494:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707818700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981068544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788541061.581520:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788541061.581561:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707818700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981068544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541061.581567:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:0.0:1788541061.581587:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788541061.581622:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707819f80 x1875420981068544/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541077 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541061.581638:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981068544:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788541061.582351:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981067776 00000100:00100000:1.0:1788541061.582359:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981067776 00000100:00100000:1.0:1788541061.582396:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981067904 00000100:00100000:1.0:1788541061.582400:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981067904 00000100:00100000:1.0:1788541061.582411:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981068288 00000100:00100000:1.0:1788541061.582413:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981068288 00000100:00100000:1.0:1788541061.582423:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981068416 00000100:00100000:1.0:1788541061.582434:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981068416 00000100:00100000:1.0:1788541061.582455:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788541061.582462:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981067776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541061.582518:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981067776:12345-0@lo:400:kworker.0 Request processed in 57us (3384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541061.582525:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788541061.582540:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788541061.582546:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981067904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541061.582573:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981067904:12345-0@lo:400:kworker.0 Request processed in 28us (3410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541061.582579:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788541061.582590:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788541061.582596:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981068288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541061.582622:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981068288:12345-0@lo:400:kworker.0 Request processed in 27us (3429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541061.582628:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788541061.582639:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788541061.582645:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707addc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981068416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541061.587008:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707addc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981068416:12345-0@lo:400:kworker.0 Request processed in 26us (3459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541061.587040:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1788541061.587154:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788541061.587161:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788541061.587261:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670691ad80 x1875420981067776/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541061.587276:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670691ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981067776:0@lo:400:kworker.0 00010000:00080000:1.0:1788541061.587289:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6706919f80 x1875420981068288/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541061.587314:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706919f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981068288:0@lo:400:kworker.0 00000100:00100000:3.0:1788541061.587481:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981067392:0@lo:400:kworker.0 00010000:00080000:3.0:1788541061.587496:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670691a300 x1875420981067904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541061.587505:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670691a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981067904:0@lo:400:kworker.0 00010000:00080000:3.0:1788541061.587516:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670691aa00 x1875420981068416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541061.587523:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670691aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981068416:0@lo:400:kworker.0 00000100:00100000:3.0:1788541061.587534:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420981066880:0@lo:400:kworker.0 00000100:00100000:3.0:1788541061.593973:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788541061.594013:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981068672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788541061.594087:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541061.594135:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981068672 00000100:00100000:3.0:1788541061.594143:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981068672 00000100:00100000:3.0:1788541061.594192:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788541061.594202:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707add500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981068672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788541061.594228:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788541061.594287:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707add500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981068672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541061.594295:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:2.0:1788541061.594974:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6705aa4380 x1875420981068672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541077 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541061.595007:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981068672:0@lo:13:osp-pre-1-0.0 00000020:00000004:0.0:1788541061.619280:0:12892:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788541061.619583:0:12892:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788541061.707059:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541062.742534:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541063.471023:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541063.471063:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541063.471201:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955821568 00000100:00100000:1.0:1788541063.471210:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955821568 00000100:00100000:1.0:1788541063.471267:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 313 00000100:00100000:1.0:1788541063.471277:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807636c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:2395:x1875420955821568:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1788541063.471342:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807636c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:2395:x1875420955821568:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 66us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541063.471349:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 313 00000100:00100000:0.0:1788541063.474756:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955821696 00000100:00100000:0.0:1788541063.474780:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955821696 00000100:00080000:3.0:1788541063.475014:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788541063.475254:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541063.475287:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541063.475306:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541063.475324:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955821952 00000100:00100000:1.0:1788541063.475328:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955821952 00000100:00100000:3.0:1788541063.475413:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955821824 00000100:00100000:3.0:1788541063.475418:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955821824 00000100:00100000:0.0:1788541063.475471:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 183 00000100:00100000:0.0:1788541063.475486:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707adc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+6:2395:x1875420955821696:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541063.475556:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707adc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+6:2395:x1875420955821696:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 74us (4492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541063.476356:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955822080 00000100:00100000:1.0:1788541063.476362:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955822080 00000100:00100000:1.0:1788541063.476389:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 184 00000100:00100000:1.0:1788541063.476396:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2394:x1875420955821952:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1788541063.476435:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2394:x1875420955821952:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 39us (1182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541063.476442:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 184 00000100:00100000:1.0:1788541063.476457:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 185 00000100:00100000:1.0:1788541063.476464:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2394:x1875420955822080:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1788541063.476487:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2394:x1875420955822080:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 24us (1180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541063.476500:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 185 00000100:00080000:1.0:1788541063.476523:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788541063.476526:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788541063.476606:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 183 00000100:00100000:0.0:1788541063.476622:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 186 00000100:00100000:0.0:1788541063.476629:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+5:2394:x1875420955821824:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541063.476652:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+5:2394:x1875420955821824:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 25us (1365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541063.476657:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 186 00010000:00010000:3.0:1788541063.765011:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788541064.141740:0:8426:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 73b94cba-5efa-45eb-b12c-fe84e695d78a 00000020:00000080:3.0:1788541064.141751:0:8426:0:(genops.c:885:class_export_put()) final put ffff9a670774a000/73b94cba-5efa-45eb-b12c-fe84e695d78a 00000020:00000080:0.0:1788541064.141920:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a670774a000/73b94cba-5efa-45eb-b12c-fe84e695d78a for lustre-OST0000 00000020:00000080:0.0:1788541064.141983:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a6707a39000 for lustre-OST0000 00000001:00100000:2.0:1788541064.144425:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 73b94cba-5efa-45eb-b12c-fe84e695d78a 00000020:00000080:2.0:1788541064.144433:0:9510:0:(genops.c:885:class_export_put()) final put ffff9a6707a3d000/73b94cba-5efa-45eb-b12c-fe84e695d78a 00000020:00000080:3.0:1788541064.144763:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6707a3d000/73b94cba-5efa-45eb-b12c-fe84e695d78a for lustre-OST0001 00000020:00000080:3.0:1788541064.151137:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a6707a3a800 for lustre-OST0001 00000100:00100000:1.0:1788541064.650062:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981068800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788541064.650149:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541064.650215:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981068800 00000100:00100000:1.0:1788541064.650216:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981068928:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788541064.650226:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981068800 00000100:00100000:1.0:1788541064.650243:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541064.650278:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788541064.650282:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981068928 00000100:00100000:0.0:1788541064.650287:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981068928 00000100:00100000:1.0:1788541064.650288:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981069056:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788541064.650314:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788541064.650320:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541064.650326:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981068800:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788541064.650345:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1788541064.650357:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788541064.650376:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981069056 00000100:00100000:1.0:1788541064.650381:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981069056 00000100:00100000:0.0:1788541064.650408:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981068800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541064.650416:0:10866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788541064.650420:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788541064.650428:0:10866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981069056:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788541064.650441:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788541064.650449:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981068928:12345-0@lo:13:osp-pre-0-1.0 00000004:00000024:1.0:1788541064.650454:0:10866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00002000:00000024:0.0:1788541064.650464:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788541064.651733:0:10866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981069056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1302us (1407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541064.651743:0:10866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788541064.651805:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981069056:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788541064.651818:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981068928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1367us (1572us total) trans 0 rc 0/0 00010000:00080000:1.0:1788541064.651826:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68045f4a80 x1875420981068800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541080 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541064.651831:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788541064.651846:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981068800:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1788541064.651859:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707adea00 x1875420981068928/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541080 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541064.651904:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981068928:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788541064.780848:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788541065.560580:0:13036:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1788541065.683572:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788541065.683595:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981069184:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788541065.683659:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541065.683714:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981069184 00000100:00100000:3.0:1788541065.683720:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981069184 00000100:00100000:3.0:1788541065.683766:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788541065.683780:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981069184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788541065.683811:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788541065.683857:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981069184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541065.683863:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788541065.683924:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981069184:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788541065.804378:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541066.702394:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788541066.702420:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981069312:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788541066.702517:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541066.702610:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981069312 00000100:00100000:0.0:1788541066.702619:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981069312 00000100:00100000:0.0:1788541066.702682:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788541066.702693:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670691aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981069312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788541066.702729:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788541066.702783:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670691aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981069312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541066.702790:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:0.0:1788541066.702814:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788541066.702850:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707819f80 x1875420981069312/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541082 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541066.702889:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981069312:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788541066.705996:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788541066.706024:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875420981069568:0@lo:400:kworker.0 00000100:00100000:1.0:1788541066.706105:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541066.706109:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707ade300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981069952:0@lo:400:kworker.0 00000100:00100000:3.0:1788541066.706144:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541066.706151:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420981069440:0@lo:400:kworker.0 00000100:00100000:1.0:1788541066.706177:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541066.706180:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708053480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981070464:0@lo:400:kworker.0 00000100:00100000:3.0:1788541066.706202:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541066.706202:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707addf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875420981070080:0@lo:400:kworker.0 00000100:00100000:1.0:1788541066.706222:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541066.706231:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875420981069824:0@lo:400:kworker.0 00000100:00100000:1.0:1788541066.706238:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708051500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875420981070592:0@lo:400:kworker.0 00000100:00100000:3.0:1788541066.706253:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541066.706380:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981070976:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788541066.707007:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541066.707045:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981070976 00000100:00100000:0.0:1788541066.707053:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981070976 00000100:00100000:0.0:1788541066.707102:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788541066.707110:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670691a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981070976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788541066.707135:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788541066.707197:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670691a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981070976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541066.707205:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:0.0:1788541066.707227:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788541066.707252:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6705aa4380 x1875420981070976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541082 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541066.707271:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981070976:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788541066.707367:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981070336:0@lo:400:kworker.0 00000100:00100000:3.0:1788541066.707395:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541066.707507:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708052a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981070848:0@lo:400:kworker.0 00000100:00100000:3.0:1788541066.707530:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541066.707605:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788541066.707611:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981069696:0@lo:400:kworker.0 00000100:00100000:3.0:1788541066.707633:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541066.707648:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875420981070208:0@lo:400:kworker.0 00000100:00100000:3.0:1788541066.707666:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541066.707760:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981070464 00000100:00100000:0.0:1788541066.707765:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981070464 00000100:00100000:0.0:1788541066.707802:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981070336 00000100:00100000:0.0:1788541066.707804:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981070336 00000100:00100000:2.0:1788541066.707810:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981070848 00000100:00100000:2.0:1788541066.707813:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981070848 00000100:00100000:0.0:1788541066.707818:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788541066.707823:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708051880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981070464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541066.707829:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788541066.707835:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708053800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981070336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541066.707862:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708051880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981070464:12345-0@lo:400:kworker.0 Request processed in 38us (1659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541066.707887:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788541066.707888:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708053800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981070336:12345-0@lo:400:kworker.0 Request processed in 54us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541066.707893:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788541066.707899:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788541066.707904:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708052d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981070848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541066.707932:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708052d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981070848:12345-0@lo:400:kworker.0 Request processed in 28us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541066.707948:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1788541066.707963:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788541066.707986:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6708053480 x1875420981070464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541066.707998:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708053480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981070464:0@lo:400:kworker.0 00000100:00100000:3.0:1788541066.708921:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708050700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875420981070720:0@lo:400:kworker.0 00000100:00100000:3.0:1788541066.708970:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541066.709558:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981069440 00000100:00100000:2.0:1788541066.709568:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981069440 00000100:00100000:2.0:1788541066.709612:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1788541066.709621:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807634450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+24:3642:x1875420981069440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541066.709674:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807634450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+24:3642:x1875420981069440:12345-0@lo:400:kworker.0 Request processed in 53us (3495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541066.709680:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1788541066.709714:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981069952 00000100:00100000:2.0:1788541066.709718:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981069952 00000100:00100000:2.0:1788541066.709740:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981069696 00000100:00100000:2.0:1788541066.709743:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981069696 00000100:00100000:2.0:1788541066.709756:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788541066.709763:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981069952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541066.709802:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981069952:12345-0@lo:400:kworker.0 Request processed in 40us (3658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541066.709808:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788541066.709820:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788541066.709825:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708052300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981069696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541066.709850:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708052300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981069696:12345-0@lo:400:kworker.0 Request processed in 26us (2216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541066.709856:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00010000:00080000:3.0:1788541066.714817:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68355b6d80 x1875420981070336/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541066.714838:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981070336:0@lo:400:kworker.0 00010000:00080000:3.0:1788541066.714852:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6708052a00 x1875420981070848/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541066.714862:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708052a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981070848:0@lo:400:kworker.0 00000100:00100000:3.0:1788541066.714913:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707adf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981069696:0@lo:400:kworker.0 00000100:00100000:3.0:1788541066.715060:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541066.715113:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981069568 00000100:00100000:2.0:1788541066.715129:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981070080 00000100:00100000:2.0:1788541066.715136:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981070080 00000100:00100000:0.0:1788541066.715136:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981069568 00000100:00100000:2.0:1788541066.715184:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981069824 00000100:00100000:2.0:1788541066.715195:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981069824 00000100:00100000:2.0:1788541066.715211:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981070208 00000100:00100000:2.0:1788541066.715214:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981070208 00000100:00100000:2.0:1788541066.715228:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981070720 00000100:00100000:2.0:1788541066.715231:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981070720 00000100:00100000:2.0:1788541066.715248:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788541066.715256:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875420981070080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541066.715263:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788541066.715269:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708053b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875420981069824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541066.715381:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875420981070080:12345-0@lo:400:kworker.0 Request processed in 125us (9157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541066.715389:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788541066.715407:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788541066.715414:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708051f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875420981070208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541066.715450:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708051f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875420981070208:12345-0@lo:400:kworker.0 Request processed in 37us (7782us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541066.715455:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788541066.715466:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788541066.715472:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708053100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875420981070720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541066.715496:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708053100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875420981070720:12345-0@lo:400:kworker.0 Request processed in 25us (6526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541066.715502:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788541066.715511:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788541066.715517:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875420981069568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541066.715540:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875420981069568:12345-0@lo:400:kworker.0 Request processed in 24us (9436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541066.715546:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00010000:00080000:2.0:1788541066.715601:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707adea00 x1875420981070208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541066.715624:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875420981070208:0@lo:400:kworker.0 00010000:00080000:2.0:1788541066.715637:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6708050700 x1875420981070720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541066.715645:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708050700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875420981070720:0@lo:400:kworker.0 00000100:00080000:2.0:1788541066.715702:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788541066.715706:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788541066.715724:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707ade300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981069952:0@lo:400:kworker.0 00000100:00100000:0.0:1788541066.720242:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708053b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875420981069824:12345-0@lo:400:kworker.0 Request processed in 4887us (13901us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541066.720260:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788541066.723332:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875420981069824:0@lo:400:kworker.0 00000100:00100000:3.0:1788541066.726558:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875420981069568:0@lo:400:kworker.0 00000100:00100000:3.0:1788541066.726900:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420981069440:0@lo:400:kworker.0 00000100:00100000:3.0:1788541066.726950:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707addf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875420981070080:0@lo:400:kworker.0 00000100:00100000:0.0:1788541066.727050:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981070592 00000100:00100000:0.0:1788541066.727058:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981070592 00000100:00100000:0.0:1788541066.727125:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788541066.727133:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708052a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875420981070592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541066.727288:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708052a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875420981070592:12345-0@lo:400:kworker.0 Request processed in 155us (12228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541066.727296:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788541066.727410:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708051500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875420981070592:0@lo:400:kworker.0 00000100:00080000:3.0:1788541066.727850:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788541066.830039:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541067.850391:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541068.584729:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541068.584900:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541068.584936:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541068.584957:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541068.584976:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541068.585002:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955822464 00000100:00100000:1.0:1788541068.585011:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955822464 00000100:00100000:1.0:1788541068.585064:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955822720 00000100:00100000:1.0:1788541068.585067:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955822720 00000100:00100000:1.0:1788541068.585080:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955822336 00000100:00100000:1.0:1788541068.585082:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955822336 00000100:00100000:1.0:1788541068.585093:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955822592 00000100:00100000:1.0:1788541068.585095:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955822592 00000100:00100000:1.0:1788541068.585111:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 193 00000100:00100000:1.0:1788541068.585120:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+5:2397:x1875420955822464:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1788541068.585199:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+5:2397:x1875420955822464:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 80us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541068.585207:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 193 00000100:00100000:1.0:1788541068.585225:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 194 00000100:00100000:1.0:1788541068.585233:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2397:x1875420955822720:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1788541068.585257:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2397:x1875420955822720:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 25us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541068.585264:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 194 00000100:00100000:1.0:1788541068.585277:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 195 00000100:00100000:1.0:1788541068.585283:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+6:2397:x1875420955822336:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1788541068.585322:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+6:2397:x1875420955822336:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 39us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541068.585329:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 195 00000100:00100000:0.0:1788541068.585447:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 196 00000100:00100000:0.0:1788541068.585457:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2397:x1875420955822592:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541068.585486:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2397:x1875420955822592:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 31us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541068.585492:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 196 00000100:00100000:3.0:1788541068.586530:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955822208 00000100:00100000:3.0:1788541068.586541:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955822208 00000100:00100000:3.0:1788541068.587121:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 315 00000100:00100000:3.0:1788541068.587133:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807634050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:2397:x1875420955822208:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541068.587231:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807634050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:2397:x1875420955822208:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 101us (2511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541068.587238:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 315 00000100:00080000:3.0:1788541068.588192:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788541068.588200:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788541068.874555:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788541069.650826:0:13185:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcdd108ab0 20000000:00000080:1.0:1788541069.650845:0:13185:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a67075d0400 uarg=0000000000000000 20000000:01000000:1.0:1788541069.651083:0:13185:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788541069.651090:0:13185:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788541069.651094:0:13185:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788541069.652294:0:13186:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1788541069.652541:0:13185:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788541069.663832:0:13185:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788541069.663864:0:13185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a68354db800/0x2aac941e5f4a77cf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541069.663922:0:13185:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a683551b600/0x2aac941e5f4a7766 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a775f expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541069.663953:0:13185:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a682e75fc00/0x2aac941e5f4a7774 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a776d expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541069.663960:0:13185:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6842172000/0x2aac941e5f4a7782 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a777b expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541069.663967:0:13185:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a683551a600/0x2aac941e5f4a7790 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a7789 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541069.666301:0:13185:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6842173800/0x2aac941e5f4a7797 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331103 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541069.666319:0:13185:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a683551b400/0x2aac941e5f4a77ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331142 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541069.667060:0:13185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a68354db800/0x2aac941e5f4a77cf lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541069.667110:0:13185:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a683551b400/0x2aac941e5f4a77ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331142 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541069.667126:0:13185:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a683551b400/0x2aac941e5f4a77ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331142 expref: 12 pid: 6511 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541069.667143:0:13185:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b71500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13185:1875420981071104:192.168.202.56@tcp:104: 00010000:00010000:1.0:1788541069.667839:0:13185:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6842173800/0x2aac941e5f4a7797 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331103 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541069.667849:0:13185:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6842173800/0x2aac941e5f4a7797 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331103 expref: 12 pid: 6509 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541069.667888:0:13185:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13185:1875420981071232:192.168.202.56@tcp:104: 00010000:00010000:1.0:1788541069.667942:0:13185:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a683551a600/0x2aac941e5f4a7790 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a7789 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541069.667951:0:13185:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a683551a600/0x2aac941e5f4a7790 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a7789 expref: 23 pid: 6512 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541069.667961:0:13185:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707bace00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13185:1875420981071360:0@lo:104: 00000100:00100000:1.0:1788541069.669652:0:13185:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788541069.669719:0:13185:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6842172000/0x2aac941e5f4a7782 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a777b expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541069.669731:0:13185:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6842172000/0x2aac941e5f4a7782 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a777b expref: 23 pid: 6511 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541069.669743:0:13185:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707bac700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13185:1875420981071488:0@lo:104: 00000100:00100000:1.0:1788541069.669775:0:13185:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788541069.669809:0:13185:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a682e75fc00/0x2aac941e5f4a7774 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a776d expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541069.669816:0:13185:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a682e75fc00/0x2aac941e5f4a7774 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a776d expref: 23 pid: 6512 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541069.669824:0:13185:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707bad500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13185:1875420981071616:0@lo:104: 00000100:00100000:1.0:1788541069.669843:0:13185:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788541069.669859:0:13185:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a683551b600/0x2aac941e5f4a7766 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a775f expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541069.669901:0:13185:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a683551b600/0x2aac941e5f4a7766 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a775f expref: 23 pid: 6511 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541069.669916:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981071360 00000100:00100000:1.0:1788541069.669920:0:13185:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707bae300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13185:1875420981071744:0@lo:104: 00000100:00100000:2.0:1788541069.669924:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981071360 00000100:00100000:1.0:1788541069.669940:0:13185:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541069.669951:0:13185:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707871c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788541069.669964:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981071488 00000100:00100000:2.0:1788541069.669966:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981071488 00000100:00100000:2.0:1788541069.669977:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981071616 00000100:00100000:2.0:1788541069.669979:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981071616 00000100:00100000:2.0:1788541069.669988:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981071744 00000100:00100000:2.0:1788541069.669990:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981071744 00000100:00100000:2.0:1788541069.670001:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788541069.670009:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707baf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+6:13185:x1875420981071360:12345-0@lo:104: 00010000:00010000:2.0:1788541069.670022:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a683551b800/0x2aac941e5f4a7789 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a7790 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541069.670086:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788541069.670092:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707baf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+6:13185:x1875420981071360:12345-0@lo:104: Request processed in 83us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541069.670108:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788541069.670125:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788541069.670131:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707badc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+5:13185:x1875420981071488:12345-0@lo:104: 00010000:00010000:2.0:1788541069.670138:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a683551a000/0x2aac941e5f4a777b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a7782 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541069.670172:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788541069.670176:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707badc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+5:13185:x1875420981071488:12345-0@lo:104: Request processed in 47us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541069.670182:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788541069.670193:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788541069.670198:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707baea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+4:13185:x1875420981071616:12345-0@lo:104: 00010000:00010000:2.0:1788541069.670205:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a682e75ee00/0x2aac941e5f4a776d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a7774 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541069.670233:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788541069.670238:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707baea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+4:13185:x1875420981071616:12345-0@lo:104: Request processed in 41us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541069.670244:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788541069.670256:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788541069.670262:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+3:13185:x1875420981071744:12345-0@lo:104: 00010000:00010000:2.0:1788541069.670269:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a775f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a7766 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541069.670295:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788541069.670299:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+3:13185:x1875420981071744:12345-0@lo:104: Request processed in 39us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541069.670312:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:2.0:1788541069.670341:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788541069.670347:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a683551b800/0x2aac941e5f4a7789 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a7790 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541069.670353:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551b800 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:2.0:1788541069.670358:0:8446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a683551b800/0x2aac941e5f4a7789 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a7790 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541069.670366:0:8446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a683551b800/0x2aac941e5f4a7789 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a7790 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788541069.670374:0:8446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a683551b800/0x2aac941e5f4a7789 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a7790 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788541069.670380:0:8446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788541069.670408:0:8446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a683551b800/0x2aac941e5f4a7789 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7790 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541069.670415:0:8446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788541069.670433:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a683551b800/0x2aac941e5f4a7789 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7790 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541069.670440:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a683551b800/0x2aac941e5f4a7789 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7790 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541069.670462:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788541069.670465:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a683551a000/0x2aac941e5f4a777b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a7782 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541069.670482:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551a000 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:2.0:1788541069.670484:0:8446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a683551a000/0x2aac941e5f4a777b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a7782 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541069.670489:0:8446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a683551a000/0x2aac941e5f4a777b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a7782 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788541069.670495:0:8446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a683551a000/0x2aac941e5f4a777b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a7782 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788541069.670499:0:8446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788541069.670622:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788541069.670628:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a682e75ee00/0x2aac941e5f4a776d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a7774 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541069.670635:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75ee00 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:0.0:1788541069.670638:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a682e75ee00/0x2aac941e5f4a776d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a7774 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541069.670645:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a682e75ee00/0x2aac941e5f4a776d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a7774 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788541069.670659:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a682e75ee00/0x2aac941e5f4a776d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a7774 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788541069.670665:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788541069.670680:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a682e75ee00/0x2aac941e5f4a776d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7774 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541069.670686:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788541069.670702:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a682e75ee00/0x2aac941e5f4a776d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7774 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541069.670709:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a682e75ee00/0x2aac941e5f4a776d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7774 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541069.670718:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541069.670722:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a775f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a7766 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541069.670727:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75e200 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:0.0:1788541069.670729:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a775f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a7766 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541069.670735:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a775f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a7766 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788541069.670739:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a775f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a7766 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788541069.670744:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788541069.670765:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a775f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7766 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541069.670770:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788541069.670776:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a775f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7766 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541069.670782:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a775f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7766 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541069.670789:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541069.670791:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541069.670792:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541069.670805:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420981072128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788541069.670835:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541069.670864:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788541069.670883:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706919f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420981072256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788541069.670904:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541069.670917:0:13185:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707bace00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13185:1875420981071360:0@lo:104: 00000100:00100000:1.0:1788541069.670945:0:13185:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707bac700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13185:1875420981071488:0@lo:104: 00000100:00100000:0.0:1788541069.670951:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981072128 00000100:00100000:1.0:1788541069.670953:0:13185:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707bad500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13185:1875420981071616:0@lo:104: 00000100:00100000:0.0:1788541069.670955:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981072128 00000100:00100000:1.0:1788541069.670959:0:13185:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707bae300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13185:1875420981071744:0@lo:104: 00010000:00010000:0.0:1788541069.670975:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a682e75fc00/0x2aac941e5f4a7774 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a776d expref: 24 pid: 6512 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541069.671021:0:8446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a683551a000/0x2aac941e5f4a777b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7782 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541069.671029:0:8446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788541069.671037:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a683551a000/0x2aac941e5f4a777b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7782 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541069.671044:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a683551a000/0x2aac941e5f4a777b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7782 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541069.671057:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541069.671059:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541069.671061:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541069.671080:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420981071872:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788541069.671108:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788541069.671171:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541069.676991:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788541069.677011:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f0fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420981072000:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788541069.677090:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541069.678883:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981072256 00000100:00100000:0.0:1788541069.678894:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981072256 00010000:00010000:0.0:1788541069.678944:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a683551b600/0x2aac941e5f4a7766 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a775f expref: 25 pid: 6511 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541069.678972:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981071872 00000100:00100000:0.0:1788541069.678975:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981071872 00010000:00010000:0.0:1788541069.678987:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a683551a600/0x2aac941e5f4a7790 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a7789 expref: 26 pid: 6512 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541069.679017:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788541069.679026:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670691ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:425687b6-1d99-41d2-88d8-2fb230997596+26:3643:x1875420981072128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788541069.679041:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541069.679046:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a682e75fc00/0x2aac941e5f4a7774 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a776d expref: 26 pid: 6512 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541069.679055:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a682e75fc00/0x2aac941e5f4a7774 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a776d expref: 26 pid: 6512 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541069.679071:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a682e75fc00/0x2aac941e5f4a7774 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a776d expref: 26 pid: 6512 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541069.679087:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541069.679145:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670691ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:425687b6-1d99-41d2-88d8-2fb230997596+25:3643:x1875420981072128:12345-0@lo:103:ldlm_bl.0 Request processed in 121us (8308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541069.679151:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788541069.679167:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788541069.679172:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670691b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:425687b6-1d99-41d2-88d8-2fb230997596+24:3643:x1875420981072256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788541069.679179:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541069.679183:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a683551b600/0x2aac941e5f4a7766 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a775f expref: 24 pid: 6511 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541069.679190:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a683551b600/0x2aac941e5f4a7766 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a775f expref: 24 pid: 6511 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541069.679199:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a683551b600/0x2aac941e5f4a7766 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a775f expref: 24 pid: 6511 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541069.679217:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541069.679242:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670691b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:425687b6-1d99-41d2-88d8-2fb230997596+23:3643:x1875420981072256:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (8337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541069.679248:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788541069.679261:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788541069.679267:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f0ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:425687b6-1d99-41d2-88d8-2fb230997596+22:3642:x1875420981071872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788541069.679274:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541069.679279:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a683551a600/0x2aac941e5f4a7790 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a7789 expref: 22 pid: 6512 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541069.679287:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a683551a600/0x2aac941e5f4a7790 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a7789 expref: 22 pid: 6512 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541069.679296:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a683551a600/0x2aac941e5f4a7790 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a7789 expref: 22 pid: 6512 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541069.679318:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541069.679349:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f0ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:425687b6-1d99-41d2-88d8-2fb230997596+21:3642:x1875420981071872:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (8241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541069.679374:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788541069.679421:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706919f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420981072256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788541069.679432:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420981072128:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788541069.680305:0:13185:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b71500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13185:1875420981071104:192.168.202.56@tcp:104: 00000100:00100000:1.0:1788541069.680320:0:13185:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13185:1875420981071232:192.168.202.56@tcp:104: 00010000:00010000:1.0:1788541069.680531:0:13185:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a68354db800/0x2aac941e5f4a77cf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541069.681357:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420981071872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788541069.681477:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981072000 00000100:00100000:0.0:1788541069.681486:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981072000 00010000:00010000:0.0:1788541069.681627:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6842172000/0x2aac941e5f4a7782 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a777b expref: 21 pid: 6511 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541069.681688:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788541069.681698:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:425687b6-1d99-41d2-88d8-2fb230997596+21:3642:x1875420981072000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788541069.681711:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541069.681716:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6842172000/0x2aac941e5f4a7782 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a777b expref: 21 pid: 6511 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541069.681725:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6842172000/0x2aac941e5f4a7782 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a777b expref: 21 pid: 6511 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541069.681752:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6842172000/0x2aac941e5f4a7782 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a777b expref: 21 pid: 6511 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541069.681767:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541069.681813:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:425687b6-1d99-41d2-88d8-2fb230997596+20:3642:x1875420981072000:12345-0@lo:103:ldlm_bl.0 Request processed in 118us (4723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541069.681820:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788541069.682002:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f0fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420981072000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788541069.682075:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541069.682172:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541069.682820:0:9520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955822848 00000100:00100000:0.0:1788541069.682827:0:9520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955822848 00010000:00010000:0.0:1788541069.682864:0:9520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a683551b400/0x2aac941e5f4a77ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331142 expref: 13 pid: 6511 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541069.682917:0:9520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955822976 00000100:00100000:0.0:1788541069.682921:0:9520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955822976 00010000:00010000:0.0:1788541069.682933:0:9520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6842173800/0x2aac941e5f4a7797 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331103 expref: 14 pid: 6509 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541069.682947:0:9520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 44 00000100:00100000:0.0:1788541069.682965:0:9520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:de51b185-1fb8-4395-8428-f3d8fb602cc3+14:2396:x1875420955822848:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788541069.682976:0:9520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541069.682981:0:9520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a683551b400/0x2aac941e5f4a77ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331142 expref: 14 pid: 6511 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541069.682991:0:9520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a683551b400/0x2aac941e5f4a77ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331142 expref: 14 pid: 6511 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541069.683006:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a683551b400/0x2aac941e5f4a77ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331142 expref: 14 pid: 6511 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541069.683021:0:9520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541069.683072:0:9520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:2396:x1875420955822848:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 108us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541069.683080:0:9520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 44 00000100:00100000:0.0:1788541069.683097:0:9520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 45 00000100:00100000:0.0:1788541069.683103:0:9520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680763f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:de51b185-1fb8-4395-8428-f3d8fb602cc3+12:2394:x1875420955822976:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788541069.683111:0:9520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541069.683115:0:9520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6842173800/0x2aac941e5f4a7797 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331103 expref: 12 pid: 6509 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541069.683123:0:9520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6842173800/0x2aac941e5f4a7797 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331103 expref: 12 pid: 6509 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541069.683132:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6842173800/0x2aac941e5f4a7797 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331103 expref: 12 pid: 6509 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541069.683143:0:9520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a68354db800/0x2aac941e5f4a77cf lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541069.683159:0:9520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68354db800/0x2aac941e5f4a77cf lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541069.683174:0:9520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a68354db800/0x2aac941e5f4a77cf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541069.683181:0:9520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a68354db800/0x2aac941e5f4a77cf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541069.683188:0:9520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a68354db800/0x2aac941e5f4a77cf lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541069.683194:0:9520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a68354db800/0x2aac941e5f4a77cf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541069.683199:0:9520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68354db800 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788541069.683204:0:9520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a68354db800/0x2aac941e5f4a77cf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541069.683212:0:9520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a68354db800/0x2aac941e5f4a77cf lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541069.683225:0:9520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a68354db800/0x2aac941e5f4a77cf lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541069.683235:0:9520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541069.683255:0:9520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680763f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:de51b185-1fb8-4395-8428-f3d8fb602cc3+11:2394:x1875420955822976:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 152us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541069.683262:0:9520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 45 00010000:00010000:1.0:1788541069.683709:0:13185:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a68354db800/0x2aac941e5f4a77cf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541069.683719:0:13185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a68354db800/0x2aac941e5f4a77cf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541069.683726:0:13185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a68354db800/0x2aac941e5f4a77cf lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541069.779337:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788541069.779369:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707bad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981072384:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788541069.779440:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541069.779545:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981072512:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788541069.779598:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541069.779914:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981072384 00000100:00100000:2.0:1788541069.779924:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981072384 00000100:00100000:2.0:1788541069.779983:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981072512 00000100:00100000:2.0:1788541069.779987:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981072512 00000100:00100000:2.0:1788541069.780019:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788541069.780027:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981072384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788541069.780061:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788541069.780110:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981072384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541069.780117:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788541069.780119:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670691ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981072640:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788541069.780134:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788541069.780139:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981072512:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788541069.780156:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1788541069.780162:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788541069.780187:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981072512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541069.780192:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:0.0:1788541069.780208:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68045e0e00 x1875420981072512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541085 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541069.780223:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981072640 00000100:00100000:2.0:1788541069.780226:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981072640 00000100:00100000:0.0:1788541069.780226:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981072512:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788541069.780250:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788541069.780256:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670691b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981072640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788541069.780278:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788541069.780329:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670691b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981072640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541069.780335:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00010000:00080000:2.0:1788541069.780378:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707bad500 x1875420981072384/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541085 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541069.780391:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707bad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981072384:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788541069.780455:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670691ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981072640:0@lo:41:osp-pre-1-0.0 00000100:00080000:1.0:1788541069.780715:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788541069.900425:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541070.801946:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788541070.801973:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707bace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981072768:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788541070.802040:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541070.802108:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981072768 00000100:00100000:1.0:1788541070.802116:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981072768 00000100:00100000:1.0:1788541070.802164:0:10866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788541070.802173:0:10866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981072768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788541070.802220:0:10866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788541070.802273:0:10866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981072768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541070.802279:0:10866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788541070.802332:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707bace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981072768:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788541070.921990:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788541070.986383:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788541070.986391:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a67067e3800 from 7 10000000:01000000:2.0:1788541070.986397:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788541070.986444:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551b800/0x2aac941e5f4a77d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541070.986457:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a683551b800/0x2aac941e5f4a77d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541070.986468:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a683551b800/0x2aac941e5f4a77d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541070.986495:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981072896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788541070.986561:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541070.986621:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707873480 going to sleep for 11 seconds 00000100:00100000:3.0:1788541070.986747:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981072896 00000100:00100000:3.0:1788541070.986755:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981072896 00000100:00100000:3.0:1788541070.986808:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1788541070.986817:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807635c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+20:6514:x1875420981072896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788541070.986829:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541070.986844:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6800031600/0x2aac941e5f4a77dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a77d6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541070.986868:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6800031600/0x2aac941e5f4a77dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a77d6 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541070.986907:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6800031600/0x2aac941e5f4a77dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a77d6 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541070.986916:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6800031600, rc 0) 00000100:00100000:3.0:1788541070.986958:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807635c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+21:6514:x1875420981072896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541070.986976:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1788541070.987477:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981072896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788541070.987493:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a683551b800/0x2aac941e5f4a77d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a77dd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541070.987502:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a683551b800/0x2aac941e5f4a77d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a77dd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541070.987591:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981073024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788541070.987622:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541070.987651:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707873480 going to sleep for 11 seconds 00000100:00100000:3.0:1788541070.987795:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981073024 00000100:00100000:3.0:1788541070.987800:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981073024 00000100:00100000:3.0:1788541070.987836:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1788541070.987842:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+21:6514:x1875420981073024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788541070.987988:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+21:6514:x1875420981073024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 145us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541070.987995:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1788541070.988427:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981073024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788541070.988464:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981073152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788541070.988507:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541070.988536:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707873480 going to sleep for 11 seconds 00000100:00100000:3.0:1788541070.993383:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981073152 00000100:00100000:3.0:1788541070.993399:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981073152 00000100:00100000:3.0:1788541070.993464:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788541070.993476:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+21:6514:x1875420981073152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788541070.993676:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+21:6514:x1875420981073152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 201us (5167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541070.993684:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788541070.993760:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981073152:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788541070.994435:0:13210:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788541070.994490:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788541070.994515:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788541070.994525:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551b800/0x2aac941e5f4a77d6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a77dd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541070.994536:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a683551b800/0x2aac941e5f4a77d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a77dd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541070.994546:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788541070.994549:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a683533b800 from 7 10000000:01000000:3.0:1788541070.994553:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788541070.994585:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6800030a00/0x2aac941e5f4a77e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541070.994593:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a6800030a00/0x2aac941e5f4a77e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541070.994603:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a6800030a00/0x2aac941e5f4a77e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541070.994626:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708051c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981073280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788541070.994675:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541070.994699:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68076193c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788541070.995092:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981073280 00000100:00100000:2.0:1788541070.995099:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981073280 00000100:00100000:2.0:1788541070.995136:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1788541070.995144:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807636850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+21:6514:x1875420981073280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788541070.995154:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541070.995166:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a683551aa00/0x2aac941e5f4a77eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a77e4 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541070.995188:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a683551aa00/0x2aac941e5f4a77eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a77e4 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541070.995199:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a683551aa00/0x2aac941e5f4a77eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a77e4 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541070.995208:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a683551aa00, rc 0) 00000100:00100000:2.0:1788541070.995241:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807636850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+22:6514:x1875420981073280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541070.995247:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1788541070.995777:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708051c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981073280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788541070.995793:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a6800030a00/0x2aac941e5f4a77e4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a77eb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541070.995803:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a6800030a00/0x2aac941e5f4a77e4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a77eb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541070.995859:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708051c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981073408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788541070.996066:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541070.996116:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68076193c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788541071.003532:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981073408 00000100:00100000:2.0:1788541071.003548:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981073408 00000100:00100000:2.0:1788541071.003632:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1788541071.003643:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e78a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+22:6514:x1875420981073408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788541071.003934:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e78a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+22:6514:x1875420981073408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 292us (7867us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541071.003942:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1788541071.010766:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708051c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981073408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788541071.010844:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707bace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981073536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788541071.010959:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541071.011164:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68352ef480 going to sleep for 11 seconds 00000100:00100000:3.0:1788541071.011229:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981073536 00000100:00100000:3.0:1788541071.011237:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981073536 00000100:00100000:3.0:1788541071.011294:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1788541071.011303:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e78bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+22:6514:x1875420981073536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788541071.011415:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e78bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+22:6514:x1875420981073536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 112us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541071.011423:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1788541071.011559:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707bace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981073536:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788541071.013672:0:13211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788541071.014095:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788541071.014122:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788541071.014134:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6800030a00/0x2aac941e5f4a77e4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a77eb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541071.014146:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a6800030a00/0x2aac941e5f4a77e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a77eb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788541071.014158:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788541071.014160:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a6839117000 from 7 10000000:01000000:2.0:1788541071.014163:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788541071.014201:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551a000/0x2aac941e5f4a77f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541071.014209:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a683551a000/0x2aac941e5f4a77f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541071.014219:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a683551a000/0x2aac941e5f4a77f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541071.014243:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981073664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788541071.014307:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541071.014406:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67078730c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788541071.015436:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981073664 00000100:00100000:3.0:1788541071.015445:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981073664 00000100:00100000:3.0:1788541071.015490:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1788541071.015499:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e78a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+22:6514:x1875420981073664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788541071.015512:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541071.015525:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6800031c00/0x2aac941e5f4a77f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a77f2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.015548:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6800031c00/0x2aac941e5f4a77f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a77f2 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.015571:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6800031c00/0x2aac941e5f4a77f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a77f2 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.015590:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6800031c00, rc 0) 00000100:00100000:3.0:1788541071.015648:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e78a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+23:6514:x1875420981073664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (1339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541071.015654:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1788541071.015905:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981073664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788541071.015923:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a683551a000/0x2aac941e5f4a77f2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a77f9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541071.015932:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a683551a000/0x2aac941e5f4a77f2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a77f9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541071.016018:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707bace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981073792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788541071.016051:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541071.016074:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68352ef180 going to sleep for 11 seconds 00000100:00100000:3.0:1788541071.016184:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981073792 00000100:00100000:3.0:1788541071.016189:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981073792 00000100:00100000:3.0:1788541071.016220:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1788541071.016227:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e78a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+23:6514:x1875420981073792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788541071.016340:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e78a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+23:6514:x1875420981073792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541071.016347:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1788541071.017018:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707bace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981073792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788541071.017052:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707bace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981073920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788541071.017099:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541071.017121:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68352ef180 going to sleep for 11 seconds 00000100:00100000:1.0:1788541071.017138:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981073920 00000100:00100000:1.0:1788541071.017142:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981073920 00000100:00100000:1.0:1788541071.017171:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1788541071.017178:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e788c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+23:6514:x1875420981073920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788541071.017260:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e788c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+23:6514:x1875420981073920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541071.017266:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1788541071.017307:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707bace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981073920:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788541071.020229:0:13212:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788541071.020416:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788541071.020439:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788541071.020451:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551a000/0x2aac941e5f4a77f2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a77f9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541071.020464:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a683551a000/0x2aac941e5f4a77f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a77f9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788541071.020475:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788541071.020477:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a68112dc000 from 7 10000000:01000000:2.0:1788541071.020481:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788541071.020518:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551b400/0x2aac941e5f4a7800 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541071.020525:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a683551b400/0x2aac941e5f4a7800 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541071.020536:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a683551b400/0x2aac941e5f4a7800 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541071.020560:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981074048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788541071.020638:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541071.020677:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67078730c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788541071.021419:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981074048 00000100:00100000:1.0:1788541071.021427:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981074048 00000100:00100000:1.0:1788541071.021478:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1788541071.021488:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e78b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+23:6514:x1875420981074048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788541071.021500:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541071.021514:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a68354daa00/0x2aac941e5f4a7807 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a7800 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541071.021557:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68354daa00/0x2aac941e5f4a7807 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a7800 expref: 24 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541071.021568:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a68354daa00/0x2aac941e5f4a7807 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a7800 expref: 24 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541071.022052:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68354daa00, rc 0) 00000100:00100000:1.0:1788541071.022123:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e78b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+24:6514:x1875420981074048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 636us (1484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541071.022130:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1788541071.022443:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981074048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788541071.022463:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a683551b400/0x2aac941e5f4a7800 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7807 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.022474:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a683551b400/0x2aac941e5f4a7800 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a7807 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541071.022544:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708051180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981074176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788541071.023042:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541071.023078:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6807619c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788541071.023129:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981074176 00000100:00100000:2.0:1788541071.023135:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981074176 00000100:00100000:2.0:1788541071.023167:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1788541071.023174:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e78b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+24:6514:x1875420981074176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788541071.024681:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e78b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+24:6514:x1875420981074176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1500us (2099us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541071.024707:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1788541071.034216:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708051180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981074176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788541071.035129:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708051180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981074304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788541071.035226:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541071.035279:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6807619c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788541071.036091:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981074304 00000100:00100000:2.0:1788541071.036106:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981074304 00000100:00100000:2.0:1788541071.036170:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1788541071.036181:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e789450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+24:6514:x1875420981074304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788541071.036847:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e789450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+24:6514:x1875420981074304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 666us (1619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541071.036855:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1788541071.037944:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708051180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981074304:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788541071.043891:0:13213:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788541071.045174:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788541071.045204:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788541071.045215:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551b400/0x2aac941e5f4a7800 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7807 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541071.045227:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a683551b400/0x2aac941e5f4a7800 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7807 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541071.397104:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541071.397456:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955823104 00000100:00100000:3.0:1788541071.397468:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955823104 00000100:00100000:3.0:1788541071.397538:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 328 00000100:00100000:3.0:1788541071.397549:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e789c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+11:6168:x1875420955823104:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788541071.397579:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541071.397620:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6800031e00/0x2aac941e5f4a780e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16473202a331173 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.397655:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6800031e00/0x2aac941e5f4a780e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331173 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.397668:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6800031e00/0x2aac941e5f4a780e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331173 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541071.397678:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6800031e00, rc 0) 00000100:00100000:3.0:1788541071.397766:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e789c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+12:6168:x1875420955823104:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 Request processed in 219us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541071.397774:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 328 00000100:00100000:3.0:1788541071.400919:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541071.404810:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955823232 00000100:00100000:2.0:1788541071.404826:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955823232 00000100:00100000:2.0:1788541071.404960:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 329 00000100:00100000:2.0:1788541071.404975:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+12:6168:x1875420955823232:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788541071.405170:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+12:6168:x1875420955823232:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 Request processed in 200us (4260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541071.405179:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 329 00000100:00100000:0.0:1788541071.414511:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541071.414595:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955823360 00000100:00100000:3.0:1788541071.414615:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955823360 00000100:00100000:3.0:1788541071.414684:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 330 00000100:00100000:3.0:1788541071.414711:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+12:6168:x1875420955823360:12345-192.168.202.56@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788541071.414862:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+12:6168:x1875420955823360:12345-192.168.202.56@tcp:503:ll_cfg_requeue.0 Request processed in 152us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541071.414902:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 330 00000100:00100000:3.0:1788541071.426762:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541071.426983:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955823488 00000100:00100000:1.0:1788541071.426995:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955823488 00000100:00100000:1.0:1788541071.427044:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 331 00000100:00100000:1.0:1788541071.427055:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+12:6168:x1875420955823488:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788541071.427072:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541071.427093:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a68354dbe00/0x2aac941e5f4a7815 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16473202a33117a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541071.427122:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68354dbe00/0x2aac941e5f4a7815 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33117a expref: 13 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541071.427142:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a68354dbe00/0x2aac941e5f4a7815 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33117a expref: 13 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541071.427152:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68354dbe00, rc 0) 00000100:00100000:1.0:1788541071.427204:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:6168:x1875420955823488:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 Request processed in 151us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541071.427211:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 331 00000100:00100000:3.0:1788541071.429974:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541071.439932:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955823616 00000100:00100000:0.0:1788541071.439951:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955823616 00000100:00100000:0.0:1788541071.440023:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 332 00000100:00100000:0.0:1788541071.440036:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:6168:x1875420955823616:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788541071.440223:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:6168:x1875420955823616:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 Request processed in 189us (10258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541071.440231:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 332 00000100:00100000:1.0:1788541071.464179:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541071.464628:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955823744 00000100:00100000:3.0:1788541071.464638:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955823744 00000100:00100000:3.0:1788541071.464695:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 333 00000100:00100000:3.0:1788541071.464706:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:6168:x1875420955823744:12345-192.168.202.56@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788541071.465034:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:6168:x1875420955823744:12345-192.168.202.56@tcp:503:ll_cfg_requeue.0 Request processed in 166us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541071.465047:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 333 00000100:00100000:3.0:1788541071.821539:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708050a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875420981074560:0@lo:400:kworker.0 00000100:00100000:3.0:1788541071.821619:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541071.821669:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708051c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875420981075072:0@lo:400:kworker.0 00000100:00100000:3.0:1788541071.821692:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541071.821715:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707addf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875420981075584:0@lo:400:kworker.0 00000100:00100000:3.0:1788541071.821736:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541071.821759:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788541071.821765:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708052680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981074688:0@lo:400:kworker.0 00000100:00100000:3.0:1788541071.821792:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541071.821811:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708051500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875420981075200:0@lo:400:kworker.0 00000100:00100000:3.0:1788541071.821854:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541071.821917:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875420981075712:0@lo:400:kworker.0 00000100:00100000:3.0:1788541071.821940:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541071.821972:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981074560 00000100:00100000:3.0:1788541071.821980:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981074560 00000100:00100000:3.0:1788541071.822131:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981075072 00000100:00100000:3.0:1788541071.822135:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981075072 00000100:00100000:3.0:1788541071.822159:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981075584 00000100:00100000:3.0:1788541071.822163:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981075584 00000100:00100000:3.0:1788541071.822176:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981075200 00000100:00100000:3.0:1788541071.822179:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981075200 00000100:00100000:3.0:1788541071.822190:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981075712 00000100:00100000:3.0:1788541071.822192:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981075712 00000100:00100000:3.0:1788541071.822205:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788541071.822213:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707ade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875420981074560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541071.822232:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708050380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875420981074816:0@lo:400:kworker.0 00000100:00100000:2.0:1788541071.822259:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541071.822269:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707ade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875420981074560:12345-0@lo:400:kworker.0 Request processed in 57us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541071.822272:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708050700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981075328:0@lo:400:kworker.0 00000100:00100000:3.0:1788541071.822277:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788541071.822291:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541071.822292:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981074816 00000100:00100000:3.0:1788541071.822295:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981074816 00000100:00100000:3.0:1788541071.822308:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788541071.822313:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875420981075072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541071.822321:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981075840:0@lo:400:kworker.0 00000100:00100000:3.0:1788541071.822341:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875420981075072:12345-0@lo:400:kworker.0 Request processed in 28us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541071.822341:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541071.822347:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788541071.822358:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788541071.822358:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1788541071.822364:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875420981075584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541071.822364:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708051180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420981074432:0@lo:400:kworker.0 00000100:00100000:3.0:1788541071.826171:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875420981075584:12345-0@lo:400:kworker.0 Request processed in 3796us (4423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541071.826197:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788541071.826236:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788541071.826247:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875420981075200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541071.826307:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875420981075200:12345-0@lo:400:kworker.0 Request processed in 65us (4453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541071.826314:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788541071.826327:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788541071.826334:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875420981075712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541071.826365:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875420981075712:12345-0@lo:400:kworker.0 Request processed in 32us (4424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541071.826371:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788541071.826399:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788541071.826406:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875420981074816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541071.826437:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875420981074816:12345-0@lo:400:kworker.0 Request processed in 32us (4177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541071.826443:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788541071.826479:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981074688 00000100:00100000:3.0:1788541071.826488:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981074688 00000100:00100000:3.0:1788541071.826531:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788541071.826537:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981074688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541071.826575:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981074688:12345-0@lo:400:kworker.0 Request processed in 38us (4782us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541071.826581:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788541071.826599:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788541071.826613:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670691ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981076096:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788541071.826656:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541071.826694:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981076096 00000100:00100000:3.0:1788541071.826698:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981076096 00000100:00100000:3.0:1788541071.826735:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788541071.826742:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981076096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788541071.826781:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788541071.826817:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981076096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541071.826824:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:3.0:1788541071.826859:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670691ad80 x1875420981076096/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541087 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541071.826905:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670691ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981076096:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788541071.826940:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708052680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981074688:0@lo:400:kworker.0 00010000:00080000:3.0:1788541071.826954:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6708051500 x1875420981075200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541071.826962:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708051500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875420981075200:0@lo:400:kworker.0 00010000:00080000:3.0:1788541071.826973:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707adc000 x1875420981075712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541071.826981:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875420981075712:0@lo:400:kworker.0 00000100:00100000:3.0:1788541071.826994:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708050a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875420981074560:0@lo:400:kworker.0 00000100:00100000:3.0:1788541071.827005:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708051c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875420981075072:0@lo:400:kworker.0 00000100:00100000:3.0:1788541071.827015:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707addf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875420981075584:0@lo:400:kworker.0 00000100:00100000:2.0:1788541071.827019:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541071.827052:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981074432 00000100:00100000:3.0:1788541071.827056:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981074432 00000100:00100000:2.0:1788541071.827069:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981075328 00000100:00100000:2.0:1788541071.827072:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981075328 00000100:00100000:3.0:1788541071.827078:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1788541071.827083:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+24:3641:x1875420981074432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541071.827097:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981075840 00000100:00100000:2.0:1788541071.827100:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981075840 00000100:00100000:3.0:1788541071.827114:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+24:3641:x1875420981074432:12345-0@lo:400:kworker.0 Request processed in 31us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541071.827116:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788541071.827121:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1788541071.827123:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981075328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541071.827153:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981075328:12345-0@lo:400:kworker.0 Request processed in 31us (4861us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541071.827159:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788541071.827170:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788541071.827175:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981075840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541071.827199:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981075840:12345-0@lo:400:kworker.0 Request processed in 24us (4858us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541071.827204:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788541071.827205:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981076224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788541071.827228:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541071.827245:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708051180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420981074432:0@lo:400:kworker.0 00000100:00100000:3.0:1788541071.827249:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981076224 00000100:00100000:3.0:1788541071.827251:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981076224 00000100:00100000:2.0:1788541071.827253:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708050e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981074944:0@lo:400:kworker.0 00000100:00100000:3.0:1788541071.827278:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788541071.827278:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541071.827284:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981076224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788541071.827294:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788541071.827301:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708053480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981075456:0@lo:400:kworker.0 00000100:00100000:3.0:1788541071.827322:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981076224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541071.827328:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788541071.827339:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788541071.827350:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67080d5c00 x1875420981076224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541087 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541071.827356:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981075456 00000100:00100000:2.0:1788541071.827358:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981075456 00000100:00100000:3.0:1788541071.827362:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981076224:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788541071.827381:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788541071.827387:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981075968:0@lo:400:kworker.0 00000100:00100000:2.0:1788541071.827387:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708081500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981075456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541071.827408:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541071.827411:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708081500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981075456:12345-0@lo:400:kworker.0 Request processed in 25us (73us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541071.827418:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788541071.827429:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708050380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875420981074816:0@lo:400:kworker.0 00010000:00080000:3.0:1788541071.827439:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6708050700 x1875420981075328/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541071.827454:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708050700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981075328:0@lo:400:kworker.0 00010000:00080000:3.0:1788541071.827467:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707adfb80 x1875420981075840/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541071.827475:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707adfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981075840:0@lo:400:kworker.0 00010000:00080000:3.0:1788541071.827496:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6708053480 x1875420981075456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541071.827504:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708053480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981075456:0@lo:400:kworker.0 00000100:00100000:1.0:1788541071.828619:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981074944 00000100:00100000:1.0:1788541071.828629:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981074944 00000100:00100000:1.0:1788541071.828673:0:10866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788541071.828681:0:10866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981074944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541071.828765:0:10866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981074944:12345-0@lo:400:kworker.0 Request processed in 84us (1485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541071.828771:0:10866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:1.0:1788541071.828805:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788541071.828810:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788541071.828812:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788541071.828815:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788541071.828856:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708050e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981074944:0@lo:400:kworker.0 00000100:00100000:3.0:1788541071.829918:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981075968 00000100:00100000:3.0:1788541071.829926:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981075968 00000100:00100000:1.0:1788541071.830292:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788541071.830300:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981075968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541071.830364:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981075968:12345-0@lo:400:kworker.0 Request processed in 64us (2955us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541071.830371:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:1.0:1788541071.830477:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707aded80 x1875420981075968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541071.830492:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707aded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981075968:0@lo:400:kworker.0 00010000:00010000:3.0:1788541071.947140:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541072.971245:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541073.705568:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541073.705605:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541073.705626:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541073.705648:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541073.705673:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541073.705700:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955824128 00000100:00100000:1.0:1788541073.705710:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955824128 00000100:00100000:1.0:1788541073.705764:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955824384 00000100:00100000:1.0:1788541073.705767:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955824384 00000100:00100000:1.0:1788541073.705781:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955824000 00000100:00100000:1.0:1788541073.705783:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955824000 00000100:00100000:1.0:1788541073.705793:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955824256 00000100:00100000:1.0:1788541073.705796:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955824256 00000100:00100000:1.0:1788541073.705813:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 203 00000100:00100000:1.0:1788541073.705822:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+5:2395:x1875420955824128:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1788541073.705924:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+5:2395:x1875420955824128:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 102us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541073.705932:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 203 00000100:00100000:1.0:1788541073.705950:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 204 00000100:00100000:1.0:1788541073.705956:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707baed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2395:x1875420955824384:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1788541073.705996:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707baed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2395:x1875420955824384:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 28us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541073.706003:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 204 00000100:00100000:1.0:1788541073.706016:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 205 00000100:00100000:1.0:1788541073.706033:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+6:2395:x1875420955824000:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1788541073.706059:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+6:2395:x1875420955824000:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 27us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541073.706065:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 205 00000100:00100000:1.0:1788541073.706079:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 206 00000100:00100000:1.0:1788541073.706085:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707badf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2395:x1875420955824256:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1788541073.706106:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707badf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2395:x1875420955824256:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 22us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541073.706111:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 206 00000100:00080000:1.0:1788541073.706134:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788541073.706137:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788541073.707387:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955823872 00000100:00100000:3.0:1788541073.707399:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955823872 00000100:00100000:3.0:1788541073.707467:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 335 00000100:00100000:3.0:1788541073.707477:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:2395:x1875420955823872:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541073.707538:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:2395:x1875420955823872:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 63us (1979us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541073.707545:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 335 00010000:00010000:2.0:1788541073.994049:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788541074.495590:0:13384:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg256-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788541074.890206:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788541074.890235:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981076352:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788541074.890315:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541074.890464:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981076352 00000100:00100000:0.0:1788541074.890475:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981076352 00000100:00100000:0.0:1788541074.890538:0:10866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788541074.890549:0:10866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981076352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788541074.890589:0:10866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788541074.890645:0:10866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981076352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541074.890651:0:10866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788541074.890724:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981076352:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788541074.890973:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788541074.890986:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981076480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788541074.891023:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541074.891151:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981076480 00000100:00100000:2.0:1788541074.891156:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981076480 00000100:00100000:2.0:1788541074.891205:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788541074.891213:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707baf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981076480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788541074.891237:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788541074.891275:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707baf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981076480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541074.891282:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788541074.891459:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981076608:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788541074.891486:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788541074.891568:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788541074.891597:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707b7ce00 x1875420981076480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541090 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541074.891612:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981076480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788541074.891672:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981076608 00000100:00100000:0.0:1788541074.891677:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981076608 00000100:00100000:0.0:1788541074.891716:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788541074.891723:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981076608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788541074.891735:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788541074.891768:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981076608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 46us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541074.891774:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:0.0:1788541074.891798:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6706919c00 x1875420981076608/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541090 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541074.891812:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706919c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981076608:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788541074.891935:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788541075.018732:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541075.914207:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788541075.914232:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981076736:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788541075.914304:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541075.914525:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981076736 00000100:00100000:1.0:1788541075.914533:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981076736 00000100:00100000:1.0:1788541075.914587:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788541075.914596:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981076736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788541075.914631:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788541075.914688:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981076736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541075.914708:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788541075.914801:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981076736:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788541076.042049:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541076.938519:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788541076.938543:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981076864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788541076.938629:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541076.938705:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981076864 00000100:00100000:3.0:1788541076.938713:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981076864 00000100:00100000:3.0:1788541076.938766:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788541076.938776:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981076864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788541076.938804:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788541076.938899:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981076864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541076.938907:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:3.0:1788541076.938927:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788541076.938969:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67080d4380 x1875420981076864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541092 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541076.938988:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981076864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788541076.941041:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707bad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981077248:0@lo:400:kworker.0 00000100:00100000:1.0:1788541076.941094:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541076.941119:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708030380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875420981077760:0@lo:400:kworker.0 00000100:00100000:1.0:1788541076.941155:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541076.941182:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708030e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875420981078272:0@lo:400:kworker.0 00000100:00100000:1.0:1788541076.941203:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541076.941231:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788541076.941237:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875420981077120:0@lo:400:kworker.0 00000100:00100000:1.0:1788541076.941257:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541076.941275:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875420981077632:0@lo:400:kworker.0 00000100:00100000:1.0:1788541076.941295:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541076.941314:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708032680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875420981078144:0@lo:400:kworker.0 00000100:00100000:1.0:1788541076.941335:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541076.941380:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981077760 00000100:00100000:1.0:1788541076.941386:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981077760 00000100:00100000:1.0:1788541076.941428:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981078272 00000100:00100000:1.0:1788541076.941431:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981078272 00000100:00100000:1.0:1788541076.941445:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981077120 00000100:00100000:1.0:1788541076.941448:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981077120 00000100:00100000:1.0:1788541076.941458:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981077632 00000100:00100000:1.0:1788541076.941460:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981077632 00000100:00100000:1.0:1788541076.941470:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981078144 00000100:00100000:1.0:1788541076.941473:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981078144 00000100:00100000:1.0:1788541076.941487:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788541076.941494:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708030a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875420981077760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541076.941560:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708030a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875420981077760:12345-0@lo:400:kworker.0 Request processed in 66us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541076.941568:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788541076.941585:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788541076.941592:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708032a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875420981078272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541076.941619:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708032a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875420981078272:12345-0@lo:400:kworker.0 Request processed in 28us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541076.941625:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788541076.941636:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788541076.941641:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708030000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875420981077120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541076.941665:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708030000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875420981077120:12345-0@lo:400:kworker.0 Request processed in 24us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541076.941670:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788541076.941681:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1788541076.941687:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708030700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875420981077632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541076.941711:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708030700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875420981077632:12345-0@lo:400:kworker.0 Request processed in 25us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541076.941716:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1788541076.941725:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1788541076.941731:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708031500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875420981078144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541076.941755:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708031500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875420981078144:12345-0@lo:400:kworker.0 Request processed in 24us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541076.941761:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1788541076.941810:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707baf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875420981077120:0@lo:400:kworker.0 00000100:00100000:1.0:1788541076.941833:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875420981077632:0@lo:400:kworker.0 00000100:00100000:1.0:1788541076.941853:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708032680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875420981078144:0@lo:400:kworker.0 00010000:00080000:1.0:1788541076.941866:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6708030380 x1875420981077760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541076.941903:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708030380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875420981077760:0@lo:400:kworker.0 00010000:00080000:1.0:1788541076.941915:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6708030e00 x1875420981078272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541076.941923:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708030e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875420981078272:0@lo:400:kworker.0 00000100:00100000:3.0:1788541076.945212:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981077248 00000100:00100000:3.0:1788541076.945227:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981077248 00000100:00100000:3.0:1788541076.945288:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788541076.945295:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708031c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981077248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541076.945636:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707bafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420981076992:0@lo:400:kworker.0 00000100:00100000:2.0:1788541076.945701:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707bae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875420981077376:0@lo:400:kworker.0 00000100:00080000:0.0:1788541076.946051:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788541076.946055:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788541076.946147:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541076.946195:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981077504:0@lo:400:kworker.0 00000100:00100000:1.0:1788541076.946222:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541076.946238:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708031180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981078016:0@lo:400:kworker.0 00000100:00100000:1.0:1788541076.946253:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541076.946278:0:8973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981078016 00000100:00100000:1.0:1788541076.946281:0:8973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981078016 00000100:00100000:1.0:1788541076.946311:0:8973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788541076.946318:0:8973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708030380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981078016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541076.946432:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981076992 00000100:00100000:0.0:1788541076.946437:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981076992 00000100:00100000:0.0:1788541076.946468:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1788541076.946476:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+24:3642:x1875420981076992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541076.946899:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+24:3642:x1875420981076992:12345-0@lo:400:kworker.0 Request processed in 423us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541076.946908:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00080000:0.0:1788541076.946938:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788541076.946963:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707bafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420981076992:0@lo:400:kworker.0 00000100:00100000:0.0:1788541076.947026:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981077504 00000100:00100000:0.0:1788541076.947032:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981077504 00000100:00100000:0.0:1788541076.947058:0:10866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788541076.947065:0:10866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708030e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981077504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541076.947104:0:10866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708030e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981077504:12345-0@lo:400:kworker.0 Request processed in 39us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541076.947111:0:10866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788541076.947139:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981077504:0@lo:400:kworker.0 00000100:00100000:1.0:1788541076.947536:0:8973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708030380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981078016:12345-0@lo:400:kworker.0 Request processed in 1217us (1278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541076.947544:0:8973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:0.0:1788541076.947673:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6708031180 x1875420981078016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541076.947684:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708031180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981078016:0@lo:400:kworker.0 00000100:00100000:2.0:1788541076.947756:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541076.947789:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708032d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981077888:0@lo:400:kworker.0 00000100:00100000:2.0:1788541076.947816:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541076.947852:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708033480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981078400:0@lo:400:kworker.0 00000100:00100000:2.0:1788541076.947889:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541076.947920:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981077888 00000100:00100000:2.0:1788541076.947924:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981077888 00000100:00100000:2.0:1788541076.947957:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981078400 00000100:00100000:2.0:1788541076.947960:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981078400 00000100:00100000:2.0:1788541076.947981:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788541076.947988:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981077888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541076.948025:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981077888:12345-0@lo:400:kworker.0 Request processed in 37us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541076.948031:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788541076.948043:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788541076.948049:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981078400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541076.948077:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981078400:12345-0@lo:400:kworker.0 Request processed in 28us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541076.948091:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1788541076.948108:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788541076.948112:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788541076.948129:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6708032d80 x1875420981077888/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541076.948139:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708032d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981077888:0@lo:400:kworker.0 00010000:00080000:2.0:1788541076.948150:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6708033480 x1875420981078400/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541076.948158:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708033480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981078400:0@lo:400:kworker.0 00000100:00100000:2.0:1788541076.948218:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788541076.948226:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981078528:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788541076.948251:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541076.948286:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981078528 00000100:00100000:2.0:1788541076.948291:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981078528 00000100:00100000:2.0:1788541076.948467:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788541076.948474:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981078528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788541076.948490:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788541076.948530:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981078528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541076.948536:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:2.0:1788541076.948560:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707b7ea00 x1875420981078528/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541092 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541076.948574:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981078528:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788541076.948711:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981077376 00000100:00100000:1.0:1788541076.948716:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981077376 00000100:00100000:1.0:1788541076.948760:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1788541076.948767:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875420981077376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541076.948814:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875420981077376:12345-0@lo:400:kworker.0 Request processed in 47us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541076.948820:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1788541076.948934:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707bae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875420981077376:0@lo:400:kworker.0 00000100:00100000:3.0:1788541076.949026:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708031c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981077248:12345-0@lo:400:kworker.0 Request processed in 3729us (7927us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541076.949034:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788541076.949106:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707bad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981077248:0@lo:400:kworker.0 00010000:00010000:2.0:1788541077.066044:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541078.094209:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541078.817721:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541078.817807:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541078.817932:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955824640 00000100:00100000:0.0:1788541078.817942:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955824640 00000100:00100000:0.0:1788541078.818001:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 213 00000100:00100000:0.0:1788541078.818010:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708032680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+6:2397:x1875420955824640:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541078.818088:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708032680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+6:2397:x1875420955824640:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 79us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541078.818096:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 213 00000100:00080000:1.0:1788541078.818839:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788541078.819124:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955824512 00000100:00100000:2.0:1788541078.819132:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955824512 00000100:00100000:2.0:1788541078.819178:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 337 00000100:00100000:2.0:1788541078.819185:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:2397:x1875420955824512:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1788541078.819229:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:2397:x1875420955824512:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 45us (1521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541078.819469:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 337 00000100:00100000:1.0:1788541078.819762:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541078.819797:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541078.819844:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541078.819932:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955824896 00000100:00100000:0.0:1788541078.819938:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955824896 00000100:00100000:0.0:1788541078.819985:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955824768 00000100:00100000:0.0:1788541078.819989:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955824768 00000100:00100000:0.0:1788541078.820008:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955825024 00000100:00100000:0.0:1788541078.820011:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955825024 00000100:00100000:0.0:1788541078.820027:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 214 00000100:00100000:0.0:1788541078.820051:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708033480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2396:x1875420955824896:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541078.820100:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708033480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2396:x1875420955824896:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 50us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541078.820108:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 214 00000100:00100000:0.0:1788541078.820122:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 215 00000100:00100000:0.0:1788541078.820128:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708032d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+5:2396:x1875420955824768:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541078.820153:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708032d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+5:2396:x1875420955824768:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 25us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541078.820159:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 215 00000100:00100000:0.0:1788541078.820171:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 216 00000100:00100000:0.0:1788541078.820177:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708031180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2396:x1875420955825024:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541078.820201:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708031180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2396:x1875420955825024:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 23us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541078.820207:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 216 00000100:00080000:1.0:1788541078.820734:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788541078.820739:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788541079.114363:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541080.010308:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788541080.010333:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706919f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981078656:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788541080.010414:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541080.010538:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981078656 00000100:00100000:0.0:1788541080.010547:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981078656 00000100:00100000:0.0:1788541080.010616:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788541080.010626:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981078656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788541080.010657:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788541080.010708:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981078656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541080.010715:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:0.0:1788541080.010760:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6706919f80 x1875420981078656/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541096 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541080.010800:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706919f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981078656:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788541080.011010:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981078784:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788541080.011040:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788541080.011125:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788541080.011174:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981078784 00000100:00100000:3.0:1788541080.011180:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981078784 00000100:00100000:3.0:1788541080.011218:0:10866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788541080.011226:0:10866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981078784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788541080.011260:0:10866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788541080.011313:0:10866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981078784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541080.011320:0:10866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788541080.011400:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981078784:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788541080.011729:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981078912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788541080.011760:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541080.011846:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981078912 00000100:00100000:2.0:1788541080.011851:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981078912 00000100:00100000:2.0:1788541080.011918:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788541080.011926:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670691b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981078912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788541080.011938:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788541080.011972:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670691b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981078912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541080.011979:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:0.0:1788541080.012049:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707b7d880 x1875420981078912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541096 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541080.012063:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981078912:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788541080.012287:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788541080.139221:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788541080.355468:0:13533:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 12:57:58 (1788541078) === 00000100:00100000:1.0:1788541080.675258:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541080.675589:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955825280 00000100:00100000:0.0:1788541080.675600:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955825280 00000100:00100000:0.0:1788541080.675677:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 2 00000100:00100000:0.0:1788541080.675688:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:384f52e3-0481-4979-9299-157aff7472d2+6:10487:x1875420955825280:12345-192.168.202.56@tcp:700:mkdir.0 00000100:00080000:3.0:1788541080.675703:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788541080.675778:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:384f52e3-0481-4979-9299-157aff7472d2+6:10487:x1875420955825280:12345-192.168.202.56@tcp:700:mkdir.0 Request processed in 91us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541080.675786:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 2 00000100:00100000:3.0:1788541080.675909:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541080.676911:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955825152 00000100:00100000:0.0:1788541080.676930:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955825152 00000100:00100000:0.0:1788541080.676987:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 23 00000100:00100000:0.0:1788541080.676995:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+6:2396:x1875420955825152:12345-192.168.202.56@tcp:41:mkdir.0 00000004:00000024:0.0:1788541080.677026:0:9339:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788541080.677103:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+6:2396:x1875420955825152:12345-192.168.202.56@tcp:41:mkdir.0 Request processed in 109us (1194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541080.677109:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 23 00000100:00100000:3.0:1788541080.709688:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541080.709905:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955825536 00000100:00100000:0.0:1788541080.709915:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955825536 00000100:00100000:0.0:1788541080.709982:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 24 00000100:00100000:0.0:1788541080.709991:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+6:10487:x1875420955825536:12345-192.168.202.56@tcp:36:mkdir.0 00010000:00010000:0.0:1788541080.710050:0:12149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541080.710100:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da200/0x2aac941e5f4a76be lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3310ee expref: 6 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.710124:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6811269500) 00010000:00010000:0.0:1788541080.710135:0:12149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788541080.710220:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a781c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.710235:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a781c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.710247:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a781c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.710274:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7823 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.710282:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7823 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.710288:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7823 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.711254:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e200/0x2aac941e5f4a782a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.711281:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e200/0x2aac941e5f4a782a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.711291:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e200/0x2aac941e5f4a782a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788541080.711552:0:12149:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000075c5bad8 reply state 00000000b8f8ba37 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e200/0x2aac941e5f4a782a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.711567:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e200/0x2aac941e5f4a782a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.711577:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a67078a1500) 00010000:00010000:0.0:1788541080.711741:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788541080.711747:0:12149:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788541080.711753:0:12149:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788541080.711762:0:12149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a781c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.711770:0:12149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a781c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.711778:0:12149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a781c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.711784:0:12149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75f200 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541080.711789:0:12149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a781c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.711797:0:12149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a781c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.711828:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a67078a1600) 00010000:00010000:0.0:1788541080.711830:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541080.711835:0:12149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a781c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.711841:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a781c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788541080.711861:0:12149:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000075c5bad8 reply state 00000000b8f8ba37 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7823 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.712066:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7823 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.712076:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a67078a1e00) 00010000:00010000:0.0:1788541080.712079:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788541080.712081:0:12149:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788541080.712183:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+7:10487:x1875420955825536:12345-192.168.202.56@tcp:36:mkdir.0 Request processed in 2190us (2502us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788541080.712193:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 24 00000100:00100000:1.0:1788541080.741242:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541080.741341:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955825664 00000100:00100000:2.0:1788541080.741362:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955825664 00000100:00100000:2.0:1788541080.741423:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 25 00000100:00100000:2.0:1788541080.741433:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+7:10488:x1875420955825664:12345-192.168.202.56@tcp:101:chmod.0 00010000:00010000:2.0:1788541080.741471:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541080.741495:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a7831 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331181 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541080.741561:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a7838 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541080.741576:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a7838 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541080.741588:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a7838 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541080.741788:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788541080.741793:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788541080.741840:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a7838 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541080.741912:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a7831 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331181 expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541080.742034:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a7838 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331181 expref: 8 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541080.742043:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68350c0400) 00010000:00010000:2.0:1788541080.742045:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788541080.742048:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a683551b600, rc 0) 00000100:00100000:2.0:1788541080.742112:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+8:10488:x1875420955825664:12345-192.168.202.56@tcp:101:chmod.0 Request processed in 680us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541080.742118:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 25 00000100:00100000:1.0:1788541080.748624:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541080.750045:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955825920 00000100:00100000:3.0:1788541080.750061:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955825920 00000100:00100000:3.0:1788541080.750137:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 26 00000100:00100000:3.0:1788541080.750148:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+8:10488:x1875420955825920:12345-192.168.202.56@tcp:36:chmod.0 00010000:00010000:3.0:1788541080.750207:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541080.750240:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a7838 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331181 expref: 8 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541080.750266:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68350c0400) 00010000:00010000:3.0:1788541080.750281:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788541080.750313:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030400/0x2aac941e5f4a783f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541080.750328:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030400/0x2aac941e5f4a783f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541080.750339:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030400/0x2aac941e5f4a783f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788541080.750610:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000069af76cc reply state 0000000081feb486 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030400/0x2aac941e5f4a783f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541080.750769:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030400/0x2aac941e5f4a783f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541080.750778:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a683531b300) 00010000:00010000:3.0:1788541080.750780:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788541080.750783:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788541080.750792:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788541080.751025:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+9:10488:x1875420955825920:12345-192.168.202.56@tcp:36:chmod.0 Request processed in 877us (2411us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788541080.751033:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 26 00000100:00100000:3.0:1788541080.798061:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541080.798180:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955826048 00000100:00100000:0.0:1788541080.798191:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955826048 00000100:00100000:0.0:1788541080.798266:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 27 00000100:00100000:0.0:1788541080.798276:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+9:10489:x1875420955826048:12345-192.168.202.56@tcp:101:chown.0 00010000:00010000:0.0:1788541080.798299:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541080.798323:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7846 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331188 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.798403:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a784d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.798436:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a784d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.798448:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a784d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541080.798496:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788541080.798500:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788541080.799370:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a784d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.799409:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7846 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331188 expref: 11 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.799430:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a784d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331188 expref: 10 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.799438:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a683531b300) 00010000:00010000:0.0:1788541080.799442:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788541080.799445:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75fc00, rc 0) 00000100:00100000:0.0:1788541080.799515:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+10:10489:x1875420955826048:12345-192.168.202.56@tcp:101:chown.0 Request processed in 1241us (1465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541080.799768:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 27 00000100:00100000:1.0:1788541080.802966:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541080.803093:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955826176 00000100:00100000:2.0:1788541080.803106:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955826176 00000100:00100000:2.0:1788541080.803181:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 28 00000100:00100000:2.0:1788541080.803194:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+10:10489:x1875420955826176:12345-192.168.202.56@tcp:101:chown.0 00010000:00010000:2.0:1788541080.803232:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541080.803259:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a7854 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a33118f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541080.803329:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a600/0x2aac941e5f4a785b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541080.803344:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a600/0x2aac941e5f4a785b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541080.803366:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a600/0x2aac941e5f4a785b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541080.803381:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a7862 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541080.803389:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a7862 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541080.803396:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a7862 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541080.803499:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551ba00/0x2aac941e5f4a7869 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541080.803509:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551ba00/0x2aac941e5f4a7869 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541080.803822:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551ba00/0x2aac941e5f4a7869 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541080.803908:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788541080.803913:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788541080.803938:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551ba00/0x2aac941e5f4a7869 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541080.803951:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a600/0x2aac941e5f4a785b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541080.803957:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a600/0x2aac941e5f4a785b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541080.803963:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a600/0x2aac941e5f4a785b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541080.803970:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551a600 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:2.0:1788541080.803974:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a600/0x2aac941e5f4a785b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541080.803982:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a600/0x2aac941e5f4a785b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541080.803993:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a683531b300) 00010000:00010000:2.0:1788541080.803996:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541080.804000:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a600/0x2aac941e5f4a785b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541080.804006:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a600/0x2aac941e5f4a785b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541080.804030:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a7862 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541080.804036:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a7862 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541080.804042:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a7862 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541080.804047:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551b600 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:2.0:1788541080.804050:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a7862 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541080.804056:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a7862 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541080.804063:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a67078a1e00) 00010000:00010000:2.0:1788541080.804066:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541080.804069:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a7862 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541080.804074:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a7862 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541080.804104:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a7854 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33118f expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541080.804118:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551ba00/0x2aac941e5f4a7869 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33118f expref: 11 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541080.804137:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a67078a1500) 00010000:00010000:2.0:1788541080.804139:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788541080.804141:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a683551ba00, rc 0) 00000100:00100000:2.0:1788541080.804312:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+11:10489:x1875420955826176:12345-192.168.202.56@tcp:101:chown.0 Request processed in 1018us (1258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541080.804320:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 28 00000100:00100000:1.0:1788541080.812381:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541080.816494:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955826304 00000100:00100000:3.0:1788541080.816513:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955826304 00000100:00100000:3.0:1788541080.816598:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 6 00000100:00100000:3.0:1788541080.816610:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707baf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:384f52e3-0481-4979-9299-157aff7472d2+11:10489:x1875420955826304:12345-192.168.202.56@tcp:900:chown.0 00000100:00100000:3.0:1788541080.816857:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707baf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:384f52e3-0481-4979-9299-157aff7472d2+11:10489:x1875420955826304:12345-192.168.202.56@tcp:900:chown.0 Request processed in 247us (4485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541080.816865:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 6 00000100:00100000:3.0:1788541080.824153:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541080.824459:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955826560 00000100:00100000:0.0:1788541080.824471:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955826560 00000100:00100000:0.0:1788541080.824543:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 29 00000100:00100000:0.0:1788541080.824554:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+11:10489:x1875420955826560:12345-192.168.202.56@tcp:36:chown.0 00010000:00010000:0.0:1788541080.824608:0:12149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541080.824662:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551ba00/0x2aac941e5f4a7869 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33118f expref: 11 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.824684:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a67078a1500) 00010000:00010000:0.0:1788541080.824690:0:12149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788541080.824984:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7870 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.824999:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7870 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.825012:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7870 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788541080.831291:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:1.0:1788541080.831523:0:12149:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000951b7c53 reply state 0000000000fbd286 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7870 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541080.831547:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7870 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541080.831557:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a67078a1500) 00010000:00010000:1.0:1788541080.831573:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788541080.831578:0:12149:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788541080.831590:0:12149:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:1.0:1788541080.831692:0:12149:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1788541080.831716:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+9:10489:x1875420955826560:12345-192.168.202.56@tcp:36:chown.0 Request processed in 7159us (7571us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788541080.831725:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 29 00010000:00010000:3.0:1788541080.831920:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7870 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541080.831931:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7870 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541080.831940:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7870 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541080.831956:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75fe00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541080.831961:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7870 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541080.831969:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7870 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541080.831982:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a67078a1500) 00010000:00010000:3.0:1788541080.831985:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788541080.831990:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7870 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541080.831997:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7870 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.833073:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7823 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.833087:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7823 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.833094:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7823 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.833099:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75ee00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541080.833104:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7823 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.833111:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7823 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.833124:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a67078a1e00) 00010000:00010000:0.0:1788541080.833127:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541080.833141:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7823 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.833147:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7823 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.833163:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e200/0x2aac941e5f4a782a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.833170:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e200/0x2aac941e5f4a782a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.833175:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e200/0x2aac941e5f4a782a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.833180:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75e200 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541080.833183:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e200/0x2aac941e5f4a782a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.833189:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e200/0x2aac941e5f4a782a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.833197:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a67078a1500) 00010000:00010000:0.0:1788541080.833199:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541080.833202:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e200/0x2aac941e5f4a782a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.833207:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e200/0x2aac941e5f4a782a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.833220:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030400/0x2aac941e5f4a783f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.833227:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030400/0x2aac941e5f4a783f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.833240:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030400/0x2aac941e5f4a783f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.833245:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6800030400 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541080.833249:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030400/0x2aac941e5f4a783f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.833255:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030400/0x2aac941e5f4a783f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.833263:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a683531b300) 00010000:00010000:0.0:1788541080.833265:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788541080.833269:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030400/0x2aac941e5f4a783f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.833275:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030400/0x2aac941e5f4a783f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541080.846323:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541080.846496:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955826688 00000100:00100000:3.0:1788541080.846507:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955826688 00000100:00100000:3.0:1788541080.846583:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 30 00000100:00100000:3.0:1788541080.846595:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+6:10490:x1875420955826688:12345-192.168.202.56@tcp:101:touch.500 00010000:00010000:3.0:1788541080.846619:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541080.846643:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a7877 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331196 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788541080.849461:0:6518:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2762us 00010000:00010000:0.0:1788541080.875938:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e200/0x2aac941e5f4a787e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.875963:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e200/0x2aac941e5f4a787e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.875975:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e200/0x2aac941e5f4a787e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.875991:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7885 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.876006:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7885 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.876013:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7885 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.876127:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fa00/0x2aac941e5f4a788c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.876136:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fa00/0x2aac941e5f4a788c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.876143:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fa00/0x2aac941e5f4a788c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541080.876172:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788541080.876177:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788541080.876217:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fa00/0x2aac941e5f4a788c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.876230:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e200/0x2aac941e5f4a787e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.876237:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e200/0x2aac941e5f4a787e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.876242:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e200/0x2aac941e5f4a787e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.876248:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75e200 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541080.876252:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e200/0x2aac941e5f4a787e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.876266:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e200/0x2aac941e5f4a787e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.876278:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a683531b300) 00010000:00010000:0.0:1788541080.876281:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541080.876285:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e200/0x2aac941e5f4a787e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.876292:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e200/0x2aac941e5f4a787e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.876304:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7885 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.876309:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7885 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.876314:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7885 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.876319:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75ee00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541080.876322:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7885 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.876329:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7885 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.876335:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a67078a1500) 00010000:00010000:0.0:1788541080.876338:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541080.876340:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7885 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.876434:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7885 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.876491:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a7877 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331196 expref: 8 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.876509:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fa00/0x2aac941e5f4a788c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331196 expref: 7 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.876516:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a67078a1e00) 00010000:00010000:0.0:1788541080.876519:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788541080.876521:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75fa00, rc 0) 00000100:00100000:0.0:1788541080.876910:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+7:10490:x1875420955826688:12345-192.168.202.56@tcp:101:touch.500 Request processed in 30314us (30596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541080.876920:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 30 00000100:00100000:2.0:1788541080.885995:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541080.886393:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955826944 00000100:00100000:3.0:1788541080.886405:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955826944 00000100:00100000:3.0:1788541080.886470:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 31 00000100:00100000:3.0:1788541080.886489:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+7:10490:x1875420955826944:12345-192.168.202.56@tcp:101:touch.500 00010000:00010000:3.0:1788541080.886511:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541080.886551:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a7893 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a33119d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541080.886696:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a789a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541080.886723:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a789a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541080.886736:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a789a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541080.886853:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ade00/0x2aac941e5f4a78a1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x4003f5df bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541080.886863:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ade00/0x2aac941e5f4a78a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541080.886906:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ade00/0x2aac941e5f4a78a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788541080.887354:0:6519:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:3.0:1788541080.887510:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac800/0x2aac941e5f4a78a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541080.887520:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac800/0x2aac941e5f4a78a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541080.887528:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac800/0x2aac941e5f4a78a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541080.887561:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a789a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541080.887579:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a789a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541080.887585:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a789a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541080.887591:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842173200 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541080.887595:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a789a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541080.887603:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a789a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541080.887615:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a67078a1e00) 00010000:00010000:3.0:1788541080.887618:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541080.887623:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a789a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541080.887630:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a789a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788541080.887644:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ddf0b456 reply state 0000000063bb40b2 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ade00/0x2aac941e5f4a78a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541080.887655:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ade00/0x2aac941e5f4a78a1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541080.887661:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x4003f5df (ffff9a6803a25300) 00010000:00010000:3.0:1788541080.887664:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788541080.887666:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788541080.887699:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a7893 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33119d expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541080.887725:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac800/0x2aac941e5f4a78a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33119d expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541080.887732:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9a6803a25b00) 00010000:00010000:3.0:1788541080.887735:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788541080.887737:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075ac800, rc 0) 00000100:00100000:3.0:1788541080.888051:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+10:10490:x1875420955826944:12345-192.168.202.56@tcp:101:touch.500 Request processed in 1570us (2065us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788541080.888059:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 31 00000100:00100000:3.0:1788541080.893088:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541080.893190:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955827200 00000100:00100000:1.0:1788541080.893203:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955827200 00000100:00100000:1.0:1788541080.893264:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 32 00000100:00100000:1.0:1788541080.893276:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+10:10490:x1875420955827200:12345-192.168.202.56@tcp:36:touch.500 00010000:00010000:1.0:1788541080.893338:0:12149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541080.893377:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac800/0x2aac941e5f4a78a8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33119d expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541080.893395:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9a6803a25b00) 00010000:00010000:1.0:1788541080.893404:0:12149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788541080.893461:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dac00/0x2aac941e5f4a78b6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541080.893475:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dac00/0x2aac941e5f4a78b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541080.893484:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dac00/0x2aac941e5f4a78b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788541080.893592:0:12149:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000731df93e reply state 0000000063a039c6 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dac00/0x2aac941e5f4a78b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541080.893605:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dac00/0x2aac941e5f4a78b6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541080.893641:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9a6811269400) 00010000:00010000:1.0:1788541080.893644:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788541080.893647:0:12149:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788541080.893750:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+11:10490:x1875420955827200:12345-192.168.202.56@tcp:36:touch.500 Request processed in 475us (674us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788541080.893759:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 32 00000100:00100000:2.0:1788541080.898438:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541080.898544:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955827328 00000100:00100000:0.0:1788541080.898556:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955827328 00000100:00100000:0.0:1788541080.898639:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 33 00000100:00100000:0.0:1788541080.898651:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+11:10490:x1875420955827328:12345-192.168.202.56@tcp:101:touch.500 00010000:00010000:0.0:1788541080.898681:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541080.898711:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a78bd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3311a4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.898792:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a78bd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3311a4 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.898820:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a78bd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3311a4 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541080.898860:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9a6811269400) 00010000:00010000:0.0:1788541080.898864:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788541080.898915:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75ee00, rc 0) 00000100:00100000:0.0:1788541080.898970:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+12:10490:x1875420955827328:12345-192.168.202.56@tcp:101:touch.500 Request processed in 322us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541080.898977:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 33 00000100:00100000:2.0:1788541080.902828:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541080.902951:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955827456 00000100:00100000:0.0:1788541080.902962:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955827456 00000100:00100000:0.0:1788541080.903021:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 24 00000100:00100000:0.0:1788541080.903030:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2393:x1875420955827456:12345-192.168.202.56@tcp:8:touch.500 00010000:00080000:0.0:1788541080.903069:0:8430:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 384f52e3-0481-4979-9299-157aff7472d2@192.168.202.56@tcp t0 exp 0000000000000000 cur 361 last 0 00000020:00000080:0.0:1788541080.903105:0:8430:0:(genops.c:1385:class_connect()) connect: client 384f52e3-0481-4979-9299-157aff7472d2, cookie 0x2aac941e5f4a78c4 00002000:00100000:0.0:1788541080.903116:0:8430:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 384f52e3-0481-4979-9299-157aff7472d2/ffff9a6705afc000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788541080.903135:0:8430:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788541080.903216:0:8430:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788541080.903246:0:8430:0:(import.c:65:import_set_state_nolock()) ffff9a6705afd000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788541080.903421:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:384f52e3-0481-4979-9299-157aff7472d2+6:2393:x1875420955827456:12345-192.168.202.56@tcp:8:touch.500 Request processed in 388us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541080.903429:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 24 00000100:00100000:3.0:1788541080.919183:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541080.919356:0:8973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955827584 00000100:00100000:2.0:1788541080.919368:0:8973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955827584 00000100:00100000:2.0:1788541080.919433:0:8973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 25 00000100:00100000:2.0:1788541080.919443:0:8973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:384f52e3-0481-4979-9299-157aff7472d2+6:0:x1875420955827584:12345-192.168.202.56@tcp:2:touch.500 00000100:00080000:3.0:1788541080.920003:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1788541080.923685:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:1.0:1788541080.923700:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 384f52e3-0481-4979-9299-157aff7472d2 00000100:00100000:2.0:1788541080.924034:0:8973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:384f52e3-0481-4979-9299-157aff7472d2+5:0:x1875420955827584:12345-192.168.202.56@tcp:2:touch.500 Request processed in 4585us (4854us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788541080.924047:0:8973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 25 00000100:00100000:0.0:1788541080.945024:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541080.945246:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955827840 00000100:00100000:3.0:1788541080.945256:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955827840 00000100:00100000:3.0:1788541080.945314:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 2 00000100:00100000:3.0:1788541080.945325:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+12:10490:x1875420955827840:12345-192.168.202.56@tcp:35:touch.500 00000100:00100000:3.0:1788541080.946035:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+13:10490:x1875420955827840:12345-192.168.202.56@tcp:35:touch.500 Request processed in 710us (1021us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788541080.946043:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 2 00000100:00100000:1.0:1788541080.975169:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541080.975424:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955827968 00000100:00100000:3.0:1788541080.975436:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955827968 00000100:00100000:3.0:1788541080.975513:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 34 00000100:00100000:3.0:1788541080.975786:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+13:10491:x1875420955827968:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:3.0:1788541080.975821:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541080.975845:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad600/0x2aac941e5f4a78cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3311ab expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541080.975942:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a78d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541080.975958:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a78d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541080.975970:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a78d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541080.976011:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788541080.976015:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788541080.976054:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a78d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541080.976082:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad600/0x2aac941e5f4a78cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3311ab expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541080.976112:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a78d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3311ab expref: 14 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541080.976121:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a67078a1e00) 00010000:00010000:3.0:1788541080.976123:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788541080.976127:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075aca00, rc 0) 00000100:00100000:3.0:1788541080.976199:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+14:10491:x1875420955827968:12345-192.168.202.56@tcp:101:rm.0 Request processed in 418us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541080.986738:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541080.989735:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955828224 00000100:00100000:0.0:1788541080.989753:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955828224 00000100:00100000:2.0:1788541080.996453:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 35 00000100:00100000:3.0:1788541080.996931:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 34 00000100:00100000:2.0:1788541080.997245:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+14:10491:x1875420955828224:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:2.0:1788541080.997271:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541080.997297:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a78d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3311b2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541080.998429:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788541080.998586:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a78d9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3311b2 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541080.998954:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a683531b300) 00010000:00010000:2.0:1788541080.998959:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788541080.998966:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a78d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3311b2 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541080.998985:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a683551b200, rc 0) 00000100:00100000:2.0:1788541080.999080:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+15:10491:x1875420955828224:12345-192.168.202.56@tcp:101:rm.0 Request processed in 2611us (12352us total) trans 4294967305 rc 301/301 00000100:00100000:2.0:1788541080.999246:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 35 00000100:00100000:2.0:1788541081.010005:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541081.010111:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955828352 00000100:00100000:0.0:1788541081.010121:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955828352 00000100:00100000:0.0:1788541081.010190:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 3 00000100:00100000:0.0:1788541081.010222:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+15:10491:x1875420955828352:12345-192.168.202.56@tcp:37:rm.0 00000100:00100000:1.0:1788541081.020688:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+15:10491:x1875420955828352:12345-192.168.202.56@tcp:37:rm.0 Request processed in 10460us (10687us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541081.020706:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 3 00000100:00100000:0.0:1788541081.035291:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541081.035379:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955828608 00000100:00100000:3.0:1788541081.035393:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955828608 00000100:00100000:3.0:1788541081.035473:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 4 00000100:00100000:3.0:1788541081.035484:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6811400450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+15:10491:x1875420955828608:12345-192.168.202.56@tcp:35:rm.0 00000100:00100000:3.0:1788541081.035863:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6811400450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+16:10491:x1875420955828608:12345-192.168.202.56@tcp:35:rm.0 Request processed in 379us (582us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788541081.036150:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 4 00000100:00100000:2.0:1788541081.038339:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788541081.038363:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707bb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981079040:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788541081.038448:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541081.038652:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981079040 00000100:00100000:3.0:1788541081.038660:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981079040 00000100:00100000:3.0:1788541081.038711:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788541081.038721:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981079040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788541081.038752:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788541081.038823:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981079040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541081.038831:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788541081.039347:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707bb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981079040:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788541081.065665:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541081.066704:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955828864 00000100:00100000:3.0:1788541081.066717:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955828864 00000100:00100000:3.0:1788541081.066787:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 36 00000100:00100000:3.0:1788541081.066800:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+16:10491:x1875420955828864:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:3.0:1788541081.066842:0:9339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541081.066916:0:9339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad600/0x2aac941e5f4a78e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3311b9 expref: -99 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541081.067030:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac200/0x2aac941e5f4a78ee lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541081.067048:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac200/0x2aac941e5f4a78ee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541081.067060:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac200/0x2aac941e5f4a78ee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541081.067084:0:9339:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788541081.067231:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad600/0x2aac941e5f4a78e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3311b9 expref: 19 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541081.067249:0:9339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac200/0x2aac941e5f4a78ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3311b9 expref: 18 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541081.067258:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a67078a1e00) 00010000:00010000:3.0:1788541081.067261:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788541081.067265:0:9339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075ac200, rc 0) 00000100:00100000:3.0:1788541081.067328:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+18:10491:x1875420955828864:12345-192.168.202.56@tcp:101:rm.0 Request processed in 531us (1678us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788541081.067336:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 36 00000100:00100000:0.0:1788541081.076371:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541081.079349:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955828992 00000100:00100000:1.0:1788541081.079368:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955828992 00000100:00100000:1.0:1788541081.079448:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 37 00000100:00100000:1.0:1788541081.079469:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+18:10491:x1875420955828992:12345-192.168.202.56@tcp:41:rm.0 00000004:00000024:1.0:1788541081.079535:0:12149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:1.0:1788541081.079617:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+18:10491:x1875420955828992:12345-192.168.202.56@tcp:41:rm.0 Request processed in 159us (3256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541081.079625:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 37 00000100:00100000:0.0:1788541081.082997:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541081.083235:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955829120 00000100:00100000:3.0:1788541081.083247:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955829120 00000100:00100000:2.0:1788541081.089055:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 38 00000100:00100000:2.0:1788541081.089071:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670691bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+18:10491:x1875420955829120:12345-192.168.202.56@tcp:101:rm.0 00010000:00010000:2.0:1788541081.089106:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541081.089138:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551bc00/0x2aac941e5f4a78fc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3311c0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.089223:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a200/0x2aac941e5f4a7903 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.089240:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a200/0x2aac941e5f4a7903 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.089274:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a200/0x2aac941e5f4a7903 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.089289:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a790a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x4003f5df bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.089297:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a790a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.089304:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a790a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.089393:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551ac00/0x2aac941e5f4a7911 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.089403:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551ac00/0x2aac941e5f4a7911 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.089410:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551ac00/0x2aac941e5f4a7911 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541081.089448:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788541081.089452:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788541081.089597:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551ac00/0x2aac941e5f4a7911 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.089610:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551ac00/0x2aac941e5f4a7911 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.089617:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a200/0x2aac941e5f4a7903 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.089634:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a200/0x2aac941e5f4a7903 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.089640:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a200/0x2aac941e5f4a7903 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.089646:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551a200 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:2.0:1788541081.089650:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a200/0x2aac941e5f4a7903 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.089658:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a200/0x2aac941e5f4a7903 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.089671:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a67078a1e00) 00010000:00010000:2.0:1788541081.089674:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541081.089679:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a200/0x2aac941e5f4a7903 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.089686:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a200/0x2aac941e5f4a7903 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.089700:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a790a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.089707:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a790a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.089713:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a790a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.089718:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551b200 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:2.0:1788541081.089728:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a790a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.089735:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a790a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.089742:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x4003f5df (ffff9a6803a25300) 00010000:00010000:2.0:1788541081.089745:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541081.089748:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a790a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.089754:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a790a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.089783:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551bc00/0x2aac941e5f4a78fc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3311c0 expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.089797:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551ac00/0x2aac941e5f4a7911 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3311c0 expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.089816:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9a6811269400) 00010000:00010000:2.0:1788541081.089819:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788541081.089822:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a683551ac00, rc 0) 00000100:00100000:2.0:1788541081.090079:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670691bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+19:10491:x1875420955829120:12345-192.168.202.56@tcp:101:rm.0 Request processed in 1010us (7091us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541081.090087:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 38 00000100:00100000:0.0:1788541081.096485:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541081.097211:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955829376 00000100:00100000:2.0:1788541081.097222:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955829376 00000100:00100000:2.0:1788541081.097283:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 39 00000100:00100000:2.0:1788541081.097294:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+19:10491:x1875420955829376:12345-192.168.202.56@tcp:36:rm.0 00010000:00010000:2.0:1788541081.097369:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788541081.097396:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551ac00/0x2aac941e5f4a7911 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3311c0 expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.097418:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a78bd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3311a4 expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.097429:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9a6811269400) 00010000:00010000:2.0:1788541081.097438:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a78d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3311ab expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.097446:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a67078a1e00) 00010000:00010000:2.0:1788541081.097449:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788541081.097480:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a600/0x2aac941e5f4a7918 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.097492:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a600/0x2aac941e5f4a7918 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.097501:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a600/0x2aac941e5f4a7918 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.097510:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a791f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x4003f5df bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.097518:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a791f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.097524:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a791f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.097649:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a7926 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.097658:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a7926 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.097665:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a7926 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788541081.097934:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1788541081.097944:0:6519:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 362016073193ns, next at 363016071019ns, rc = 0 00010000:00010000:2.0:1788541081.097984:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551ba00/0x2aac941e5f4a792d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.097993:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551ba00/0x2aac941e5f4a792d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.098000:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551ba00/0x2aac941e5f4a792d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.098008:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551ba00/0x2aac941e5f4a792d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.098015:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551ba00/0x2aac941e5f4a792d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.098021:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551ba00/0x2aac941e5f4a792d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.098034:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788541081.098050:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a7926 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.098062:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a7926 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.098069:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a7926 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.098074:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551b000 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:2.0:1788541081.098078:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a7926 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.098086:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a7926 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541081.098283:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788541081.098291:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551ba00/0x2aac941e5f4a792d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541081.098296:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551ba00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:3.0:1788541081.098299:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551ba00/0x2aac941e5f4a792d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541081.098305:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551ba00/0x2aac941e5f4a792d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541081.098315:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9a6811269400) 00010000:00010000:3.0:1788541081.098318:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788541081.098329:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551ba00/0x2aac941e5f4a792d lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541081.098335:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551ba00/0x2aac941e5f4a792d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541081.098348:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541081.098350:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541081.098351:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541081.098388:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9a6811269400) 00010000:00010000:2.0:1788541081.098390:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788541081.098393:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a7926 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.098399:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a7926 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.098415:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a600/0x2aac941e5f4a7918 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.098420:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a600/0x2aac941e5f4a7918 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.098424:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a600/0x2aac941e5f4a7918 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.098429:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551a600 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:2.0:1788541081.098437:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a600/0x2aac941e5f4a7918 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.098443:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a600/0x2aac941e5f4a7918 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.098449:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a67078a1e00) 00010000:00010000:2.0:1788541081.098451:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541081.098453:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a600/0x2aac941e5f4a7918 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.098519:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a600/0x2aac941e5f4a7918 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788541081.098531:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001cf7f0a4 reply state 00000000b1e8f39c transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a791f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.098542:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a791f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.098548:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x4003f5df (ffff9a6803a25300) 00010000:00010000:2.0:1788541081.098550:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788541081.098553:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788541081.099023:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706919880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+18:10491:x1875420955829376:12345-192.168.202.56@tcp:36:rm.0 Request processed in 1727us (2543us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788541081.099032:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 39 00000100:00100000:0.0:1788541081.120482:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541081.120678:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955829632 00000100:00100000:3.0:1788541081.120691:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955829632 00000100:00100000:3.0:1788541081.120760:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 5 00000100:00100000:3.0:1788541081.120771:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+18:10491:x1875420955829632:12345-192.168.202.56@tcp:35:rm.0 00000100:00100000:3.0:1788541081.121089:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+19:10491:x1875420955829632:12345-192.168.202.56@tcp:35:rm.0 Request processed in 319us (616us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788541081.121097:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 5 00000100:00100000:1.0:1788541081.131148:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541081.133536:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955829888 00000100:00100000:2.0:1788541081.133556:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955829888 00000100:00100000:2.0:1788541081.133713:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 40 00000100:00100000:2.0:1788541081.133725:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+19:10491:x1875420955829888:12345-192.168.202.56@tcp:36:rm.0 00010000:00010000:2.0:1788541081.133788:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788541081.133842:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac200/0x2aac941e5f4a78ee lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3311b9 expref: 19 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.133922:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fa00/0x2aac941e5f4a788c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331196 expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.133937:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a67078a1e00) 00010000:00010000:2.0:1788541081.133963:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a784d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331188 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.133972:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a683531b300) 00010000:00010000:2.0:1788541081.133979:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788541081.134007:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a600/0x2aac941e5f4a7934 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.134021:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a600/0x2aac941e5f4a7934 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.134032:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a600/0x2aac941e5f4a7934 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.134045:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a793b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.134052:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a793b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.134058:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a793b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.134145:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551ac00/0x2aac941e5f4a7942 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.134161:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551ac00/0x2aac941e5f4a7942 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.134167:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551ac00/0x2aac941e5f4a7942 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541081.134444:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788541081.134463:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551ac00/0x2aac941e5f4a7942 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.134471:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551ac00/0x2aac941e5f4a7942 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.134477:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551ac00/0x2aac941e5f4a7942 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.134484:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551ac00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:2.0:1788541081.134489:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551ac00/0x2aac941e5f4a7942 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.134498:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551ac00/0x2aac941e5f4a7942 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.134510:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9a68350c0900) 00010000:00010000:2.0:1788541081.134512:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788541081.134516:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551ac00/0x2aac941e5f4a7942 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.134523:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551ac00/0x2aac941e5f4a7942 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.134541:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a600/0x2aac941e5f4a7934 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.134553:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a600/0x2aac941e5f4a7934 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.134560:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a600/0x2aac941e5f4a7934 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.134564:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551a600 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:2.0:1788541081.134567:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a600/0x2aac941e5f4a7934 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.134573:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a600/0x2aac941e5f4a7934 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.134580:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68350c0500) 00010000:00010000:2.0:1788541081.134583:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541081.134585:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a600/0x2aac941e5f4a7934 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.134591:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a600/0x2aac941e5f4a7934 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788541081.134601:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cd626803 reply state 00000000f4e480c7 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a793b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.134611:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a793b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541081.134616:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a68350c0f00) 00010000:00010000:2.0:1788541081.134619:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788541081.134621:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788541081.134699:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+18:10491:x1875420955829888:12345-192.168.202.56@tcp:36:rm.0 Request processed in 976us (3561us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788541081.134713:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 40 00010000:00010000:1.0:1788541081.166536:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541082.058071:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788541082.062344:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981079296:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788541082.062437:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541082.062504:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981079168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788541082.062529:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541082.062567:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981079296 00000100:00100000:0.0:1788541082.062576:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981079296 00000100:00100000:0.0:1788541082.062631:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981079168 00000100:00100000:0.0:1788541082.062634:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981079168 00000100:00100000:0.0:1788541082.062653:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788541082.062662:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670691ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981079296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788541082.062685:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788541082.062732:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670691ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981079296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541082.062739:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788541082.062756:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788541082.062762:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981079168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788541082.062772:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788541082.062807:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981079168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541082.062834:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:0.0:1788541082.062895:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67080d7800 x1875420981079296/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541098 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541082.062918:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981079296:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1788541082.062930:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67080d7b80 x1875420981079168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541098 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541082.062940:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981079168:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788541082.062974:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788541082.064173:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f0ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420981079424:0@lo:400:kworker.0 00000100:00100000:0.0:1788541082.064230:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541082.064263:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6805674e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981079936:0@lo:400:kworker.0 00000100:00100000:0.0:1788541082.064288:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541082.064568:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670687b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981080448:0@lo:400:kworker.0 00000100:00100000:0.0:1788541082.064597:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541082.064636:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788541082.064642:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f0fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875420981079552:0@lo:400:kworker.0 00000100:00100000:0.0:1788541082.064669:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541082.064687:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706879880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875420981080064:0@lo:400:kworker.0 00000100:00100000:0.0:1788541082.064710:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541082.064728:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670687b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875420981080576:0@lo:400:kworker.0 00000100:00100000:0.0:1788541082.064747:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541082.064773:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981079424 00000100:00100000:0.0:1788541082.064779:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981079424 00000100:00100000:0.0:1788541082.064838:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1788541082.064846:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+24:3641:x1875420981079424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541082.064920:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+24:3641:x1875420981079424:12345-0@lo:400:kworker.0 Request processed in 74us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541082.064928:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1788541082.064966:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670781b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981079680:0@lo:400:kworker.0 00000100:00100000:0.0:1788541082.064991:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541082.065040:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981080448 00000100:00100000:1.0:1788541082.065044:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981080448 00000100:00100000:1.0:1788541082.065085:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788541082.065099:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683796a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981080448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541082.065135:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683796a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981080448:12345-0@lo:400:kworker.0 Request processed in 38us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541082.065141:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1788541082.065161:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788541082.065524:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875420981079808:0@lo:400:kworker.0 00000100:00100000:1.0:1788541082.065551:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541082.065570:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670687bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981080320:0@lo:400:kworker.0 00000100:00100000:1.0:1788541082.065590:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541082.073376:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670687b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875420981080192:0@lo:400:kworker.0 00000100:00100000:0.0:1788541082.073447:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541082.073469:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670687ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875420981080704:0@lo:400:kworker.0 00000100:00100000:0.0:1788541082.073493:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541082.073537:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981079552 00000100:00100000:0.0:1788541082.073545:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981079552 00000100:00100000:0.0:1788541082.073603:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981080064 00000100:00100000:0.0:1788541082.073607:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981080064 00000100:00100000:0.0:1788541082.073787:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981080576 00000100:00100000:0.0:1788541082.073791:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981080576 00000100:00100000:0.0:1788541082.073816:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981079808 00000100:00100000:0.0:1788541082.073819:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981079808 00000100:00100000:0.0:1788541082.073828:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981080192 00000100:00100000:0.0:1788541082.073830:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981080192 00000100:00100000:0.0:1788541082.073840:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981080704 00000100:00100000:0.0:1788541082.073842:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981080704 00000100:00100000:0.0:1788541082.073855:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788541082.073862:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6837968380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875420981079552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541082.073929:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6837968380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875420981079552:12345-0@lo:400:kworker.0 Request processed in 67us (9260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541082.073936:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788541082.073964:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788541082.073970:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6837968e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875420981080064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541082.073993:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6837968e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875420981080064:12345-0@lo:400:kworker.0 Request processed in 24us (9283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541082.073999:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788541082.074007:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788541082.074012:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683796aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875420981080576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541082.074031:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683796aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875420981080576:12345-0@lo:400:kworker.0 Request processed in 19us (9284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541082.074036:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788541082.074044:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788541082.074049:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875420981079808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541082.074075:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875420981079808:12345-0@lo:400:kworker.0 Request processed in 26us (8523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541082.074080:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788541082.074089:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788541082.074094:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6837969500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875420981080192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541082.074117:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6837969500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875420981080192:12345-0@lo:400:kworker.0 Request processed in 23us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541082.074122:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788541082.074131:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788541082.074135:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6837968a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875420981080704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541082.074154:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6837968a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875420981080704:12345-0@lo:400:kworker.0 Request processed in 19us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541082.074159:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00080000:0.0:1788541082.074179:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788541082.074183:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788541082.074212:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875420981079808:0@lo:400:kworker.0 00000100:00100000:0.0:1788541082.074237:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981080320 00000100:00100000:0.0:1788541082.074240:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981080320 00000100:00100000:0.0:1788541082.074266:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788541082.074271:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981080320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541082.074417:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981080320:12345-0@lo:400:kworker.0 Request processed in 144us (8824us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541082.074423:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1788541082.074439:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788541082.074457:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670687bb80 x1875420981080320/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541082.074469:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670687bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981080320:0@lo:400:kworker.0 00000100:00100000:0.0:1788541082.074493:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f0fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875420981079552:0@lo:400:kworker.0 00000100:00100000:0.0:1788541082.074502:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706879880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875420981080064:0@lo:400:kworker.0 00000100:00100000:0.0:1788541082.074512:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670687b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875420981080576:0@lo:400:kworker.0 00000100:00100000:0.0:1788541082.074523:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f0ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420981079424:0@lo:400:kworker.0 00010000:00080000:0.0:1788541082.074534:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670687b480 x1875420981080448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541082.074543:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670687b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981080448:0@lo:400:kworker.0 00010000:00080000:0.0:1788541082.074568:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670687b800 x1875420981080192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541082.074588:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670687b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875420981080192:0@lo:400:kworker.0 00010000:00080000:0.0:1788541082.074598:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670687ad80 x1875420981080704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541082.074606:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670687ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875420981080704:0@lo:400:kworker.0 00000100:00100000:2.0:1788541082.079726:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981079936 00000100:00100000:2.0:1788541082.079744:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981079936 00000100:00100000:2.0:1788541082.079824:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981079680 00000100:00100000:2.0:1788541082.079828:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981079680 00000100:00100000:2.0:1788541082.079850:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788541082.079858:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6837969c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981079936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541082.079972:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6837969c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981079936:12345-0@lo:400:kworker.0 Request processed in 114us (15682us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541082.079979:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788541082.079995:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788541082.080001:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683796bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981079680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541082.080029:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683796bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981079680:12345-0@lo:400:kworker.0 Request processed in 29us (15038us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541082.080035:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788541082.080232:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670781b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981079680:0@lo:400:kworker.0 00000100:00100000:0.0:1788541082.080268:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6805674e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981079936:0@lo:400:kworker.0 00010000:00010000:2.0:1788541082.185992:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541083.217718:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541083.951257:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541083.951296:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541083.951338:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541083.951361:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541083.951384:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541083.951411:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541083.951438:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955830272 00000100:00100000:0.0:1788541083.951448:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955830272 00000100:00100000:0.0:1788541083.951507:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955830528 00000100:00100000:0.0:1788541083.951510:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955830528 00000100:00100000:0.0:1788541083.951526:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955830144 00000100:00100000:0.0:1788541083.951529:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955830144 00000100:00100000:0.0:1788541083.951541:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955830656 00000100:00100000:0.0:1788541083.951548:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955830656 00000100:00100000:0.0:1788541083.951567:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 223 00000100:00100000:0.0:1788541083.951576:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683796b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+5:2394:x1875420955830272:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541083.951647:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683796b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+5:2394:x1875420955830272:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 72us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541083.951668:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 223 00000100:00100000:0.0:1788541083.951686:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 224 00000100:00100000:0.0:1788541083.951693:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6837968000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2394:x1875420955830528:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541083.951718:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6837968000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2394:x1875420955830528:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 26us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541083.951724:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 224 00000100:00100000:0.0:1788541083.951736:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 225 00000100:00100000:0.0:1788541083.951742:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6837969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+18:2394:x1875420955830144:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541083.951768:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6837969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+18:2394:x1875420955830144:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 26us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541083.951774:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 225 00000100:00100000:0.0:1788541083.951797:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 226 00000100:00100000:0.0:1788541083.951804:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683796b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2394:x1875420955830656:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541083.951828:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683796b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2394:x1875420955830656:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 24us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541083.951833:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 226 00000100:00100000:0.0:1788541083.951854:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955830400 00000100:00100000:0.0:1788541083.951857:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955830400 00000100:00100000:0.0:1788541083.951915:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 78 00000100:00100000:0.0:1788541083.951924:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6837969f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:384f52e3-0481-4979-9299-157aff7472d2+5:2394:x1875420955830400:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541083.951948:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6837969f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:384f52e3-0481-4979-9299-157aff7472d2+5:2394:x1875420955830400:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 26us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541083.951954:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 78 00000100:00080000:0.0:1788541083.951980:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788541083.951986:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788541083.951987:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788541083.952283:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955830016 00000100:00100000:2.0:1788541083.952288:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955830016 00000100:00100000:2.0:1788541083.952329:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 339 00000100:00100000:2.0:1788541083.952336:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:2394:x1875420955830016:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1788541083.952367:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:2394:x1875420955830016:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 32us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541083.952373:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 339 00010000:00010000:1.0:1788541084.234033:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541085.130135:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6805674e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981080832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788541085.130212:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541085.130289:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981080832 00000100:00100000:0.0:1788541085.130297:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981080832 00000100:00100000:0.0:1788541085.130352:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788541085.130362:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f0ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981080832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788541085.130405:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788541085.130450:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f0ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981080832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541085.130458:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:0.0:1788541085.130479:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788541085.130510:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6805674e00 x1875420981080832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541101 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541085.130527:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6805674e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981080832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788541085.131109:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788541085.131122:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f0fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981080960:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788541085.131162:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541085.131242:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981080960 00000100:00100000:2.0:1788541085.131248:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981080960 00000100:00100000:2.0:1788541085.131290:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788541085.131320:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6805674e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981080960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788541085.131349:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788541085.131404:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6805674e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981080960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541085.131412:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788541085.131449:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f0fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981080960:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788541085.134240:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788541085.134272:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981081088:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788541085.134352:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541085.134578:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981081088 00000100:00100000:0.0:1788541085.134586:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981081088 00000100:00100000:0.0:1788541085.134658:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788541085.134667:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981081088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788541085.134691:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788541085.134750:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981081088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541085.134780:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:0.0:1788541085.134804:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788541085.138064:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67080d6d80 x1875420981081088/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541101 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541085.138097:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981081088:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788541085.258966:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788541085.598214:0:13681:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:2.0:1788541086.164328:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788541086.164352:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707bb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981081216:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788541086.164424:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541086.164581:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981081216 00000100:00100000:3.0:1788541086.164590:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981081216 00000100:00100000:3.0:1788541086.164646:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788541086.164654:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981081216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788541086.164690:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788541086.164751:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981081216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541086.164767:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788541086.164843:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707bb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981081216:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788541086.283813:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788541086.744721:0:13729:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc1f6fc400 20000000:00000080:2.0:1788541086.744737:0:13729:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a6708146000 uarg=0000000000000000 20000000:01000000:2.0:1788541086.744783:0:13729:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788541086.744790:0:13729:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788541086.744795:0:13729:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1788541086.745276:0:13730:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1788541086.745414:0:13729:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1788541086.748345:0:13729:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1788541086.749548:0:13729:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1788541086.749582:0:13729:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1788541086.749600:0:13729:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788541086.749619:0:13729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a682e75f000/0x2aac941e5f4a7949 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541086.749638:0:13729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6800031600/0x2aac941e5f4a77dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a77d6 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541086.749646:0:13729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a683551aa00/0x2aac941e5f4a77eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a77e4 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541086.749654:0:13729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6800031c00/0x2aac941e5f4a77f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a77f2 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541086.749661:0:13729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a68354daa00/0x2aac941e5f4a7807 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a7800 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541086.749668:0:13729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6800031e00/0x2aac941e5f4a780e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331173 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541086.749673:0:13729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a68354dbe00/0x2aac941e5f4a7815 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33117a expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541086.749687:0:13729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a682e75f000/0x2aac941e5f4a7949 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541086.749727:0:13729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a68354dbe00/0x2aac941e5f4a7815 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33117a expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541086.749743:0:13729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a68354dbe00/0x2aac941e5f4a7815 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33117a expref: 12 pid: 6509 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541086.749777:0:13729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670687ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1875420981081344:192.168.202.56@tcp:104: 00010000:00010000:0.0:1788541086.750011:0:13729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6800031e00/0x2aac941e5f4a780e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331173 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541086.750021:0:13729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6800031e00/0x2aac941e5f4a780e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331173 expref: 12 pid: 6511 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541086.750030:0:13729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670687b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1875420981081472:192.168.202.56@tcp:104: 00010000:00010000:0.0:1788541086.750062:0:13729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a68354daa00/0x2aac941e5f4a7807 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a7800 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541086.750071:0:13729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a68354daa00/0x2aac941e5f4a7807 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a7800 expref: 23 pid: 6509 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541086.750079:0:13729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670687b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1875420981081600:0@lo:104: 00000100:00100000:0.0:1788541086.750123:0:13729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788541086.750164:0:13729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6800031c00/0x2aac941e5f4a77f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a77f2 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541086.750183:0:13729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6800031c00/0x2aac941e5f4a77f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a77f2 expref: 23 pid: 6509 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541086.750192:0:13729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670687b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1875420981081728:0@lo:104: 00010000:00010000:0.0:1788541086.750220:0:13729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a683551aa00/0x2aac941e5f4a77eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a77e4 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541086.750225:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:0.0:1788541086.750228:0:13729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a683551aa00/0x2aac941e5f4a77eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a77e4 expref: 23 pid: 6512 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541086.750235:0:13729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706879880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1875420981081856:0@lo:104: 00000100:00100000:3.0:1788541086.750243:0:6500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541086.750312:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981081600 00000100:00100000:3.0:1788541086.750320:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981081600 00000100:00100000:0.0:1788541086.750399:0:13729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541086.752783:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541086.752861:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541086.752911:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955830784 00000100:00100000:2.0:1788541086.752919:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955830784 00010000:00010000:2.0:1788541086.752953:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a68354dbe00/0x2aac941e5f4a7815 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33117a expref: 13 pid: 6509 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541086.752998:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955830912 00000100:00100000:2.0:1788541086.753001:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955830912 00010000:00010000:2.0:1788541086.753015:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6800031e00/0x2aac941e5f4a780e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331173 expref: 14 pid: 6511 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541086.753036:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 46 00000100:00100000:2.0:1788541086.753045:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de51b185-1fb8-4395-8428-f3d8fb602cc3+14:2396:x1875420955830784:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541086.753060:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541086.753065:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a68354dbe00/0x2aac941e5f4a7815 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33117a expref: 14 pid: 6509 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.753076:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a68354dbe00/0x2aac941e5f4a7815 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33117a expref: 14 pid: 6509 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.753096:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541086.753144:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de51b185-1fb8-4395-8428-f3d8fb602cc3+14:2396:x1875420955830784:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 100us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541086.753151:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 46 00000100:00100000:2.0:1788541086.753169:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 47 00000100:00100000:2.0:1788541086.753176:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b7e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:2397:x1875420955830912:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541086.753183:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541086.753188:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6800031e00/0x2aac941e5f4a780e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331173 expref: 13 pid: 6511 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.753197:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6800031e00/0x2aac941e5f4a780e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331173 expref: 13 pid: 6511 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.753217:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541086.753235:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b7e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:2397:x1875420955830912:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 59us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541086.753240:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 47 00010000:00010000:0.0:1788541086.753245:0:13729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6800031600/0x2aac941e5f4a77dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a77d6 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541086.753256:0:13729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a6800031600/0x2aac941e5f4a77dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a77d6 expref: 23 pid: 6509 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541086.753268:0:13729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670781b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1875420981081984:0@lo:104: 00000100:00100000:1.0:1788541086.753419:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981081728 00000100:00100000:1.0:1788541086.753424:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981081728 00000100:00100000:1.0:1788541086.753449:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981081856 00000100:00100000:1.0:1788541086.753453:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981081856 00000100:00100000:1.0:1788541086.753467:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788541086.753474:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f0fb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+5:13729:x1875420981081600:12345-0@lo:104: 00010000:00010000:1.0:1788541086.753487:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a683551b400/0x2aac941e5f4a7800 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a7807 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541086.753625:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788541086.753632:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f0fb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+5:13729:x1875420981081600:12345-0@lo:104: Request processed in 159us (3509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541086.753639:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788541086.753674:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788541086.753680:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+4:13729:x1875420981081728:12345-0@lo:104: 00010000:00010000:1.0:1788541086.753688:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a683551a000/0x2aac941e5f4a77f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a77f9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.753742:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788541086.753748:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a683551b400/0x2aac941e5f4a7800 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a7807 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.753769:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551b400 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:2.0:1788541086.753773:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a683551b400/0x2aac941e5f4a7800 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a7807 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.753782:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a683551b400/0x2aac941e5f4a7800 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a7807 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788541086.753789:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a683551b400/0x2aac941e5f4a7800 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a7807 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788541086.753795:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788541086.753823:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a683551b400/0x2aac941e5f4a7800 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7807 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.753829:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788541086.753850:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a683551b400/0x2aac941e5f4a7800 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7807 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.753857:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a683551b400/0x2aac941e5f4a7800 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a7807 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.753896:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541086.753899:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a683551a000/0x2aac941e5f4a77f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a77f9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.753905:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551a000 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:2.0:1788541086.753908:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a683551a000/0x2aac941e5f4a77f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a77f9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.753915:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a683551a000/0x2aac941e5f4a77f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a77f9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788541086.753920:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a683551a000/0x2aac941e5f4a77f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a77f9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788541086.753925:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788541086.753938:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a683551a000/0x2aac941e5f4a77f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a77f9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.753944:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788541086.753958:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a683551a000/0x2aac941e5f4a77f2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a77f9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.753965:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a683551a000/0x2aac941e5f4a77f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a77f9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.753973:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541086.753975:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541086.753977:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541086.754010:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:425687b6-1d99-41d2-88d8-2fb230997596:3644:1875420981082112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788541086.754043:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541086.754083:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420981082240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788541086.754111:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541086.754140:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981082112 00000100:00100000:2.0:1788541086.754145:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981082112 00010000:00010000:2.0:1788541086.754161:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a68354daa00/0x2aac941e5f4a7807 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a7800 expref: 24 pid: 6509 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541086.754178:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981082240 00000100:00100000:2.0:1788541086.754181:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981082240 00010000:00010000:2.0:1788541086.754192:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6800031c00/0x2aac941e5f4a77f9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a77f2 expref: 25 pid: 6509 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541086.754209:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788541086.754216:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+25:3644:x1875420981082112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788541086.754223:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541086.754227:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a68354daa00/0x2aac941e5f4a7807 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a7800 expref: 25 pid: 6509 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.754237:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a68354daa00/0x2aac941e5f4a7807 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a7800 expref: 25 pid: 6509 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.754249:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541086.754274:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+25:3644:x1875420981082112:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541086.754280:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788541086.754293:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788541086.754299:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+24:3641:x1875420981082240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788541086.754306:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541086.754316:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6800031c00/0x2aac941e5f4a77f9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a77f2 expref: 24 pid: 6509 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.754325:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6800031c00/0x2aac941e5f4a77f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a77f2 expref: 24 pid: 6509 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.754334:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541086.754359:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+24:3641:x1875420981082240:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541086.754365:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788541086.754400:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420981082240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788541086.754422:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:425687b6-1d99-41d2-88d8-2fb230997596:3644:1875420981082112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788541086.754428:0:13729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541086.754447:0:13729:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068fd240 going to sleep for 11 seconds 00010000:00010000:0.0:1788541086.754461:0:13729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a68354dbe00/0x2aac941e5f4a7815 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33117a expref: 12 pid: 6509 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541086.754472:0:13729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670687ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1875420981081344:192.168.202.56@tcp:104: 00010000:00010000:0.0:1788541086.754483:0:13729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6800031e00/0x2aac941e5f4a780e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331173 expref: 11 pid: 6511 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541086.754513:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1788541086.754519:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+4:13729:x1875420981081728:12345-0@lo:104: Request processed in 839us (4274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541086.754524:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788541086.754548:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981081984 00000100:00100000:1.0:1788541086.754552:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981081984 00000100:00100000:1.0:1788541086.754565:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788541086.754571:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670687bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+4:13729:x1875420981081856:12345-0@lo:104: 00010000:00010000:1.0:1788541086.754579:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a6800030a00/0x2aac941e5f4a77e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a77eb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.754676:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541086.754681:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a6800030a00/0x2aac941e5f4a77e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a77eb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788541086.754688:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00010000:00010000:2.0:1788541086.754688:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6800030a00 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:2.0:1788541086.754692:0:8446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a6800030a00/0x2aac941e5f4a77e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a77eb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.754698:0:8446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a6800030a00/0x2aac941e5f4a77e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a77eb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788541086.754701:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 10000000:00010000:2.0:1788541086.754704:0:8446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a6800030a00/0x2aac941e5f4a77e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a77eb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788541086.754710:0:8446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788541086.754725:0:8446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a6800030a00/0x2aac941e5f4a77e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a77eb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541086.754735:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ade00/0x2aac941e5f4a78a1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.754740:0:8446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788541086.754743:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ade00/0x2aac941e5f4a78a1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541086.754749:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ade00/0x2aac941e5f4a78a1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541086.754765:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075ade00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:2.0:1788541086.754765:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a6800030a00/0x2aac941e5f4a77e4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a77eb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541086.754770:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ade00/0x2aac941e5f4a78a1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.754771:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a6800030a00/0x2aac941e5f4a77e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a77eb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541086.754779:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ade00/0x2aac941e5f4a78a1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.754783:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541086.754785:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541086.754786:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541086.754796:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420981082368:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788541086.754821:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541086.754846:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981082368 00000100:00100000:2.0:1788541086.754850:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981082368 00010000:00010000:2.0:1788541086.754862:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a683551aa00/0x2aac941e5f4a77eb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a77e4 expref: 24 pid: 6512 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541086.754892:0:13729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670687b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1875420981081472:192.168.202.56@tcp:104: 00000100:00100000:2.0:1788541086.754894:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788541086.754900:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+24:3642:x1875420981082368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788541086.754907:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541086.754911:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a683551aa00/0x2aac941e5f4a77eb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a77e4 expref: 24 pid: 6512 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.754918:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a683551aa00/0x2aac941e5f4a77eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a77e4 expref: 24 pid: 6512 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.754926:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541086.754951:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+24:3642:x1875420981082368:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541086.754962:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:0.0:1788541086.754967:0:13729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a68354daa00/0x2aac941e5f4a7807 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a7800 expref: 24 pid: 6509 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541086.754976:0:13729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670687b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1875420981081600:0@lo:104: 00000100:00100000:2.0:1788541086.754978:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981082496:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788541086.754985:0:13729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6800031c00/0x2aac941e5f4a77f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a77f2 expref: 22 pid: 6509 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541086.754993:0:13729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670687b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1875420981081728:0@lo:104: 00010000:00010000:0.0:1788541086.755001:0:13729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a683551aa00/0x2aac941e5f4a77eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a77e4 expref: 21 pid: 6512 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541086.755005:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541086.755009:0:13729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706879880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1875420981081856:0@lo:104: 00000100:00100000:2.0:1788541086.755034:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981082496 00000100:00100000:2.0:1788541086.755037:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981082496 00000100:00100000:2.0:1788541086.755079:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788541086.755085:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f0fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981082496:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788541086.755110:0:8432:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:2.0:1788541086.755146:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a9af898, atime: 0x6a9af898, ctime: 0x6a9af898, blocks: 0x0 00010000:00010000:2.0:1788541086.755153:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003ed1e60/0x2aac941e5f4a7950 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.755167:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=367s v=(0 0) 00010000:00010000:2.0:1788541086.755171:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541086.755178:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003ed1e60/0x2aac941e5f4a7950 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.755198:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003ed1e60/0x2aac941e5f4a7950 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541086.755204:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x4003f5df (ffff9a6803a25300) 00010000:00010000:2.0:1788541086.755207:0:8432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003ed1e60/0x2aac941e5f4a7950 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541086.755208:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541086.755212:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ade00/0x2aac941e5f4a78a1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.755214:0:8432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003ed1e60/0x2aac941e5f4a7950 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541086.755219:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ade00/0x2aac941e5f4a78a1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.755238:0:8432:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788541086.755252:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dac00/0x2aac941e5f4a78b6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541086.755258:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dac00/0x2aac941e5f4a78b6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541086.755263:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dac00/0x2aac941e5f4a78b6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541086.755273:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68354dac00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541086.755275:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dac00/0x2aac941e5f4a78b6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541086.755282:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dac00/0x2aac941e5f4a78b6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541086.755290:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9a6811269400) 00010000:00010000:3.0:1788541086.755292:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541086.755309:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dac00/0x2aac941e5f4a78b6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541086.755315:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dac00/0x2aac941e5f4a78b6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541086.755331:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a791f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541086.755337:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a791f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541086.755342:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a791f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541086.755347:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551b600 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541086.755350:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a791f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541086.755355:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a791f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541086.755371:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f0fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1875420981082496:12345-0@lo:6:osp-syn-1-0.0 Request processed in 286us (365us total) trans 4294967301 rc 0/0 00010000:00010000:3.0:1788541086.755373:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x4003f5df (ffff9a6803a25300) 00010000:00010000:3.0:1788541086.755375:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788541086.755377:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1788541086.755378:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a791f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541086.755384:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a791f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x4003f5df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.755395:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788541086.755398:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a793b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.755401:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003ed1e60/0x2aac941e5f4a7950 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541086.755405:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a793b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.755409:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551b200 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:3.0:1788541086.755411:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a793b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.755413:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003ed1e60/0x2aac941e5f4a7950 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541086.755416:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551b000 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541086.755419:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a793b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.755421:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003ed1e60/0x2aac941e5f4a7950 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541086.755425:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a793b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541086.755432:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a68350c0f00) 00010000:00010000:2.0:1788541086.755432:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003ed1e60/0x2aac941e5f4a7950 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541086.755435:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541086.755438:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a793b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.755440:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003ed1e60/0x2aac941e5f4a7950 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541086.755444:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a793b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.755452:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541086.755454:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541086.755455:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541086.755474:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420981082368:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788541086.755499:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1788541086.755508:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a6707a30a80/2, rc 0, transno 4294967301 00000100:00100000:2.0:1788541086.755514:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981082496:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788541086.755616:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1788541086.755623:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670687bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+4:13729:x1875420981081856:12345-0@lo:104: Request processed in 1052us (5223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541086.755629:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788541086.755645:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788541086.755652:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707819f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+3:13729:x1875420981081984:12345-0@lo:104: 00010000:00010000:1.0:1788541086.755660:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a683551b800/0x2aac941e5f4a77d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a77dd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541086.755707:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788541086.755712:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707819f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:425687b6-1d99-41d2-88d8-2fb230997596+3:13729:x1875420981081984:12345-0@lo:104: Request processed in 62us (1284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541086.755718:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788541086.755726:0:13729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670781b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13729:1875420981081984:0@lo:104: 00010000:00010000:0.0:1788541086.755767:0:13729:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a682e75f000/0x2aac941e5f4a7949 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.755772:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541086.755777:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a683551b800/0x2aac941e5f4a77d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a77dd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.755783:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551b800 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:2.0:1788541086.755786:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a683551b800/0x2aac941e5f4a77d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a77dd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.755794:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a683551b800/0x2aac941e5f4a77d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a77dd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788541086.755800:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a683551b800/0x2aac941e5f4a77d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a77dd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788541086.755806:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788541086.755859:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a683551b800/0x2aac941e5f4a77d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a77dd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541086.755865:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541086.755866:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788541086.755901:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a683551b800/0x2aac941e5f4a77d6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a77dd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541086.755905:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:425687b6-1d99-41d2-88d8-2fb230997596:3644:1875420981082624:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788541086.755909:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a683551b800/0x2aac941e5f4a77d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a77dd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.755920:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541086.755921:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541086.755923:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541086.755934:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541086.755952:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981082624 00000100:00100000:2.0:1788541086.755957:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981082624 00010000:00010000:2.0:1788541086.755974:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6800031600/0x2aac941e5f4a77dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a77d6 expref: 21 pid: 6509 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541086.756000:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788541086.756006:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:425687b6-1d99-41d2-88d8-2fb230997596+21:3644:x1875420981082624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788541086.756015:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541086.756019:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6800031600/0x2aac941e5f4a77dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a77d6 expref: 21 pid: 6509 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.756029:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6800031600/0x2aac941e5f4a77dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a77d6 expref: 21 pid: 6509 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.756040:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6800031600/0x2aac941e5f4a77dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a77d6 expref: 21 pid: 6509 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.756052:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a682e75f000/0x2aac941e5f4a7949 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.756060:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a682e75f000/0x2aac941e5f4a7949 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.756070:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a682e75f000/0x2aac941e5f4a7949 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.756074:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a682e75f000/0x2aac941e5f4a7949 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.756078:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a682e75f000/0x2aac941e5f4a7949 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.756089:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a682e75f000/0x2aac941e5f4a7949 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.756092:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75f000 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:2.0:1788541086.756094:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a682e75f000/0x2aac941e5f4a7949 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.756098:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a682e75f000/0x2aac941e5f4a7949 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.756110:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a682e75f000/0x2aac941e5f4a7949 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541086.756119:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788541086.756129:0:13729:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a682e75f000/0x2aac941e5f4a7949 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541086.756137:0:13729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a682e75f000/0x2aac941e5f4a7949 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541086.756143:0:13729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a682e75f000/0x2aac941e5f4a7949 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541086.756152:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:425687b6-1d99-41d2-88d8-2fb230997596+20:3644:x1875420981082624:12345-0@lo:103:ldlm_bl.0 Request processed in 147us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541086.756157:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788541086.756265:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:425687b6-1d99-41d2-88d8-2fb230997596:3644:1875420981082624:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788541087.181244:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981082752:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788541087.181333:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541087.181404:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981082752 00000100:00100000:0.0:1788541087.181411:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981082752 00000100:00100000:0.0:1788541087.181457:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788541087.181466:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1875420981082752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788541087.181495:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788541087.181540:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1875420981082752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541087.181548:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788541087.181809:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707bb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981083136:0@lo:400:kworker.0 00000100:00100000:1.0:1788541087.181841:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541087.181887:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707bb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875420981083648:0@lo:400:kworker.0 00000100:00100000:1.0:1788541087.181914:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541087.181931:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707bb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875420981084160:0@lo:400:kworker.0 00000100:00100000:1.0:1788541087.181950:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541087.182098:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788541087.182107:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707bb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875420981083008:0@lo:400:kworker.0 00000100:00100000:1.0:1788541087.182134:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541087.182151:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707bb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875420981083520:0@lo:400:kworker.0 00000100:00100000:1.0:1788541087.182169:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541087.182188:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707bb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875420981084032:0@lo:400:kworker.0 00000100:00100000:1.0:1788541087.182222:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541087.182454:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981083648 00000100:00100000:2.0:1788541087.182460:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981083648 00000100:00100000:2.0:1788541087.182502:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981084160 00000100:00100000:2.0:1788541087.182505:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981084160 00000100:00100000:2.0:1788541087.182517:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981083008 00000100:00100000:2.0:1788541087.182519:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981083008 00000100:00100000:2.0:1788541087.182529:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981083520 00000100:00100000:2.0:1788541087.182531:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981083520 00000100:00100000:2.0:1788541087.182541:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981084032 00000100:00100000:2.0:1788541087.182543:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981084032 00000100:00100000:2.0:1788541087.182555:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788541087.182562:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707baf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875420981083648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541087.182606:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707baf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875420981083648:12345-0@lo:400:kworker.0 Request processed in 44us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541087.182620:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788541087.182636:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788541087.182642:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707badc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875420981084160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541087.182671:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707badc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875420981084160:12345-0@lo:400:kworker.0 Request processed in 30us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541087.182678:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788541087.182689:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788541087.182694:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707baea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875420981083008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541087.182721:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707baea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875420981083008:12345-0@lo:400:kworker.0 Request processed in 27us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541087.182727:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788541087.182739:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1788541087.182744:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875420981083520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541087.182760:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981083136 00000100:00100000:0.0:1788541087.182765:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981083136 00000100:00100000:2.0:1788541087.182780:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875420981083520:12345-0@lo:400:kworker.0 Request processed in 37us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541087.182786:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788541087.182791:0:10866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788541087.182795:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788541087.182797:0:10866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981083136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541087.182800:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875420981084032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541087.182823:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875420981084032:12345-0@lo:400:kworker.0 Request processed in 23us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541087.182825:0:10866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981083136:12345-0@lo:400:kworker.0 Request processed in 29us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541087.182829:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788541087.182843:0:10866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788541087.182864:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707bb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875420981083008:0@lo:400:kworker.0 00000100:00100000:0.0:1788541087.182889:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707bb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420981082880:0@lo:400:kworker.0 00000100:00100000:2.0:1788541087.182893:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707bb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875420981083520:0@lo:400:kworker.0 00000100:00100000:2.0:1788541087.182911:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707bb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875420981084032:0@lo:400:kworker.0 00000100:00100000:2.0:1788541087.182919:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707bb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981083136:0@lo:400:kworker.0 00000100:00100000:0.0:1788541087.182921:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788541087.182930:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707bb6d80 x1875420981083648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541087.182940:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707bb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875420981083648:0@lo:400:kworker.0 00000100:00100000:0.0:1788541087.182943:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707bb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981083392:0@lo:400:kworker.0 00000100:00100000:0.0:1788541087.182963:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788541087.183259:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707bb5c00 x1875420981084160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541087.183269:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707bb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875420981084160:0@lo:400:kworker.0 00000100:00080000:1.0:1788541087.183783:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788541087.183788:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788541087.185243:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707bb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981083904:0@lo:400:kworker.0 00000100:00100000:0.0:1788541087.185301:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541087.185321:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981084416:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788541087.185342:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541087.185367:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788541087.185373:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707bb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875420981083264:0@lo:400:kworker.0 00000100:00100000:0.0:1788541087.185409:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541087.185429:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707bb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981083776:0@lo:400:kworker.0 00000100:00100000:0.0:1788541087.185449:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541087.185466:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707bb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981084288:0@lo:400:kworker.0 00000100:00100000:0.0:1788541087.185485:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541087.185518:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981082880 00000100:00100000:0.0:1788541087.185527:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981082880 00000100:00100000:0.0:1788541087.185590:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1788541087.185598:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+20:3642:x1875420981082880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541087.185644:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+20:3642:x1875420981082880:12345-0@lo:400:kworker.0 Request processed in 47us (2721us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541087.185650:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1788541087.187952:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981083904 00000100:00100000:1.0:1788541087.187965:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981083904 00000100:00100000:0.0:1788541087.188354:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981083264 00000100:00100000:0.0:1788541087.188360:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981083264 00000100:00100000:3.0:1788541087.188513:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981083392 00000100:00100000:3.0:1788541087.188518:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981083392 00000100:00100000:3.0:1788541087.188738:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788541087.188760:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981083392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541087.189130:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981083776 00000100:00100000:1.0:1788541087.189134:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981083776 00000100:00100000:1.0:1788541087.189152:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981084288 00000100:00100000:1.0:1788541087.189155:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981084288 00000100:00100000:0.0:1788541087.189499:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788541087.189508:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670781b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875420981083264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541087.190102:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788541087.190115:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981083904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541087.191124:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981083392:12345-0@lo:400:kworker.0 Request processed in 1087us (6869us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541087.191135:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788541087.191286:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670781b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875420981083264:12345-0@lo:400:kworker.0 Request processed in 1779us (5875us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541087.191295:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788541087.191331:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788541087.191343:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706879880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981083776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541087.191409:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706879880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981083776:12345-0@lo:400:kworker.0 Request processed in 71us (5958us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541087.191416:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788541087.191432:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788541087.191439:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670687b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981084288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541087.191483:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670687b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981084288:12345-0@lo:400:kworker.0 Request processed in 46us (5998us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541087.191489:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788541087.191545:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707bb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875420981083264:0@lo:400:kworker.0 00000100:00100000:1.0:1788541087.191810:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981083904:12345-0@lo:400:kworker.0 Request processed in 1699us (6508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541087.191818:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1788541087.192341:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788541087.192348:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788541087.192812:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981082752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788541087.193277:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981084416 00000100:00100000:3.0:1788541087.193285:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981084416 00000100:00100000:3.0:1788541087.193326:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788541087.193335:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981084416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788541087.193353:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00080000:0.0:1788541087.193745:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707bb6300 x1875420981083776/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541087.193768:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707bb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981083776:0@lo:400:kworker.0 00000100:00100000:0.0:1788541087.193788:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707bb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981084288:0@lo:400:kworker.0 00000100:00100000:0.0:1788541087.193798:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707bb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420981082880:0@lo:400:kworker.0 00000100:00100000:0.0:1788541087.193808:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707bb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981083392:0@lo:400:kworker.0 00010000:00080000:0.0:1788541087.193818:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707bb5f80 x1875420981083904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541087.193827:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707bb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981083904:0@lo:400:kworker.0 00000100:00100000:3.0:1788541087.194562:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981084416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1217us (9207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541087.194571:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788541087.195340:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981084416:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788541087.306080:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788541087.766787:0:13778:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffd4812840 20000000:00000080:0.0:1788541087.766806:0:13778:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a6707a9d400 uarg=0000000000000000 20000000:01000000:0.0:1788541087.772367:0:13778:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1788541087.772375:0:13778:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1788541087.772381:0:13778:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:3.0:1788541087.772853:0:13779:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:0.0:1788541087.773063:0:13778:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:0.0:1788541087.773121:0:13778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:0.0:1788541087.773143:0:13778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:0.0:1788541087.773155:0:13778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:0.0:1788541087.773178:0:13778:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788541087.773197:0:13778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a682e75f000/0x2aac941e5f4a7957 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541087.773218:0:13778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a682e75f000/0x2aac941e5f4a7957 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541087.773229:0:13778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a682e75f000/0x2aac941e5f4a7957 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541087.773235:0:13778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a682e75f000/0x2aac941e5f4a7957 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541087.773242:0:13778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a682e75f000/0x2aac941e5f4a7957 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541087.773317:0:13778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a682e75f000/0x2aac941e5f4a7957 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541087.773323:0:13778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75f000 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788541087.773327:0:13778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a682e75f000/0x2aac941e5f4a7957 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541087.773339:0:13778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a682e75f000/0x2aac941e5f4a7957 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541087.773397:0:13778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a682e75f000/0x2aac941e5f4a7957 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541087.773407:0:13778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a682e75f000/0x2aac941e5f4a7957 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541087.773414:0:13778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a682e75f000/0x2aac941e5f4a7957 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541087.841918:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541087.841956:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955831040 00000100:00100000:0.0:1788541087.841966:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955831040 00000100:00100000:0.0:1788541087.842016:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 341 00000100:00100000:0.0:1788541087.842026:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+11:6168:x1875420955831040:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788541087.842043:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541087.842064:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a682e75f000/0x2aac941e5f4a795e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16473202a3311c7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541087.842092:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a682e75f000/0x2aac941e5f4a795e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3311c7 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541087.842103:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a682e75f000/0x2aac941e5f4a795e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3311c7 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541087.842112:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75f000, rc 0) 00000100:00100000:0.0:1788541087.842172:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+12:6168:x1875420955831040:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 Request processed in 147us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541087.842179:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 341 00000100:00100000:0.0:1788541087.844277:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541087.844350:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955831168 00000100:00100000:3.0:1788541087.844359:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955831168 00000100:00100000:3.0:1788541087.844409:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 342 00000100:00100000:3.0:1788541087.844420:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+12:6168:x1875420955831168:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788541087.844590:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+12:6168:x1875420955831168:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 Request processed in 171us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541087.844599:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 342 00000100:00100000:1.0:1788541087.849437:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541087.849471:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955831296 00000100:00100000:1.0:1788541087.849492:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955831296 00000100:00100000:1.0:1788541087.849542:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 343 00000100:00100000:1.0:1788541087.849552:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+12:6168:x1875420955831296:12345-192.168.202.56@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788541087.849694:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+12:6168:x1875420955831296:12345-192.168.202.56@tcp:503:ll_cfg_requeue.0 Request processed in 143us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541087.849702:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 343 00000100:00100000:3.0:1788541087.852702:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541087.852739:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955831424 00000100:00100000:3.0:1788541087.852759:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955831424 00000100:00100000:3.0:1788541087.852808:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 344 00000100:00100000:3.0:1788541087.852817:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+12:10776:x1875420955831424:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788541087.852978:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+12:10776:x1875420955831424:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 161us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541087.852986:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 344 00000100:00100000:1.0:1788541087.862711:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541087.862768:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955831552 00000100:00100000:1.0:1788541087.862778:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955831552 00000100:00100000:1.0:1788541087.862829:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 345 00000100:00100000:1.0:1788541087.862838:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e778050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+12:10776:x1875420955831552:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788541087.862998:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e778050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+12:10776:x1875420955831552:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 160us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541087.863006:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 345 00000100:00100000:1.0:1788541087.883518:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541087.883784:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955831680 00000100:00100000:2.0:1788541087.883796:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955831680 00000100:00100000:2.0:1788541087.883857:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 346 00000100:00100000:2.0:1788541087.883893:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e778850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+12:6168:x1875420955831680:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788541087.883913:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541087.883933:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a683551bc00/0x2aac941e5f4a7965 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16473202a3311ce expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541087.883963:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a683551bc00/0x2aac941e5f4a7965 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3311ce expref: 13 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541087.883975:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a683551bc00/0x2aac941e5f4a7965 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3311ce expref: 13 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541087.883984:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a683551bc00, rc 0) 00000100:00100000:2.0:1788541087.884042:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e778850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:6168:x1875420955831680:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 Request processed in 176us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541087.884060:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 346 00000100:00100000:1.0:1788541087.890453:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541087.890539:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955831808 00000100:00100000:0.0:1788541087.890549:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955831808 00000100:00100000:0.0:1788541087.890615:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 347 00000100:00100000:0.0:1788541087.890626:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e77b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:6168:x1875420955831808:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788541087.890781:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e77b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:6168:x1875420955831808:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 Request processed in 156us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541087.890798:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 347 00000100:00100000:1.0:1788541087.904844:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541087.905044:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955831936 00000100:00100000:3.0:1788541087.905056:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955831936 00000100:00100000:3.0:1788541087.905111:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 348 00000100:00100000:3.0:1788541087.905122:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e77bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:6168:x1875420955831936:12345-192.168.202.56@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788541087.905253:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e77bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:6168:x1875420955831936:12345-192.168.202.56@tcp:503:ll_cfg_requeue.0 Request processed in 133us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541087.905261:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 348 00000100:00100000:2.0:1788541087.921951:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541087.922081:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955832064 00000100:00100000:3.0:1788541087.922093:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955832064 00000100:00100000:3.0:1788541087.922155:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 349 00000100:00100000:3.0:1788541087.922165:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e77a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:10780:x1875420955832064:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788541087.922333:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e77a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:10780:x1875420955832064:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 168us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541087.922350:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 349 00000100:00100000:1.0:1788541087.926533:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541087.927357:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955832192 00000100:00100000:2.0:1788541087.927369:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955832192 00000100:00100000:2.0:1788541087.927441:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 350 00000100:00100000:2.0:1788541087.927453:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e77a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:10780:x1875420955832192:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788541087.927614:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e77a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:10780:x1875420955832192:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 164us (1090us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541087.927623:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 350 00010000:00010000:3.0:1788541088.330208:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788541088.716213:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788541088.716224:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a67067e3800 from 7 10000000:01000000:2.0:1788541088.716230:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788541088.716295:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551a600/0x2aac941e5f4a796c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541088.716309:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a683551a600/0x2aac941e5f4a796c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541088.716321:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a683551a600/0x2aac941e5f4a796c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541088.716350:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b7c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981084544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788541088.716427:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541088.716491:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683f2f4300 going to sleep for 11 seconds 00000100:00100000:1.0:1788541088.716619:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981084544 00000100:00100000:1.0:1788541088.716627:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981084544 00000100:00100000:1.0:1788541088.716685:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1788541088.716695:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e77a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+20:6514:x1875420981084544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788541088.716707:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541088.716721:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a68354db200/0x2aac941e5f4a7973 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a796c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541088.716753:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68354db200/0x2aac941e5f4a7973 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a796c expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541088.716780:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a68354db200/0x2aac941e5f4a7973 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a796c expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541088.716790:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68354db200, rc 0) 00000100:00100000:1.0:1788541088.716839:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e77a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+21:6514:x1875420981084544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541088.716845:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1788541088.716915:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b7c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981084544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788541088.716930:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a683551a600/0x2aac941e5f4a796c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7973 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541088.716938:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a683551a600/0x2aac941e5f4a796c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a7973 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541088.716993:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981084672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788541088.717018:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541088.717036:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68012543c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788541088.717955:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981084672 00000100:00100000:2.0:1788541088.717963:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981084672 00000100:00100000:2.0:1788541088.718005:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1788541088.718013:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e778c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+21:6514:x1875420981084672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788541088.718167:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e778c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+21:6514:x1875420981084672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 154us (1148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541088.718175:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1788541088.718241:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080a5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981084672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788541088.718298:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b7c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981084800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788541088.718342:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541088.718369:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683f2f4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788541088.718376:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981084800 00000100:00100000:3.0:1788541088.718384:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981084800 00000100:00100000:3.0:1788541088.718419:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1788541088.718427:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e77b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+21:6514:x1875420981084800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788541088.718507:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e77b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+21:6514:x1875420981084800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541088.718514:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1788541088.718768:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b7c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981084800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788541088.722988:0:13792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b7c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:13792:1875420981084928:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788541088.723351:0:13792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541088.723402:0:13792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683f2f4480 going to sleep for 11 seconds 00000100:00100000:3.0:1788541088.724185:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981084928 00000100:00100000:3.0:1788541088.724195:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981084928 00000100:00100000:3.0:1788541088.724253:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1788541088.724263:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e77b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+21:13792:x1875420981084928:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788541088.724438:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e77b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+21:13792:x1875420981084928:12345-0@lo:502:llog_process_th.0 Request processed in 175us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541088.724445:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1788541088.725075:0:13792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b7c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:13792:1875420981084928:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788541088.725116:0:13792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788541088.725127:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788541088.725129:0:13792:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788541088.725140:0:13792:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a67067e3800 00000020:00000080:2.0:1788541088.725143:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788541088.725417:0:13792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788541088.725422:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788541088.725424:0:13792:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788541088.725427:0:13792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788541088.725430:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788541088.725432:0:13792:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788541088.725435:0:13792:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a67067e3800 00000020:00000080:2.0:1788541088.725437:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788541088.725500:0:13792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b7c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:13792:1875420981085056:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788541088.725582:0:13792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541088.726823:0:13792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683f2f4480 going to sleep for 11 seconds 00000100:00100000:3.0:1788541088.726978:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981085056 00000100:00100000:3.0:1788541088.726987:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981085056 00000100:00100000:3.0:1788541088.727289:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1788541088.727300:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e779450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+21:13792:x1875420981085056:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788541088.727440:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e779450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+21:13792:x1875420981085056:12345-0@lo:502:llog_process_th.0 Request processed in 142us (1858us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541088.727448:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1788541088.732472:0:13792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b7c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:13792:1875420981085056:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788541088.732527:0:13792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788541088.732540:0:13792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788541088.732542:0:13792:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788541088.732552:0:13792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788541088.732920:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1788541088.732943:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788541088.732955:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551a600/0x2aac941e5f4a796c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7973 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541088.732967:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a683551a600/0x2aac941e5f4a796c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7973 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788541088.732978:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788541088.732981:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a683533b800 from 7 10000000:01000000:0.0:1788541088.732984:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788541088.733022:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a797a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541088.733030:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a797a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541088.733040:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a797a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541088.733065:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670687b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981085184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788541088.733137:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541088.733187:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68352ef180 going to sleep for 11 seconds 00000100:00100000:2.0:1788541088.733414:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981085184 00000100:00100000:2.0:1788541088.733421:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981085184 00000100:00100000:2.0:1788541088.733480:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1788541088.733489:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e779c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+21:6514:x1875420981085184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788541088.733504:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541088.733520:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a683551ba00/0x2aac941e5f4a7981 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a797a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541088.733545:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a683551ba00/0x2aac941e5f4a7981 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a797a expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541088.733566:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a683551ba00/0x2aac941e5f4a7981 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a797a expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541088.733576:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a683551ba00, rc 0) 00000100:00100000:2.0:1788541088.733615:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e779c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+22:6514:x1875420981085184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541088.733622:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1788541088.734357:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670687b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981085184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788541088.734374:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a797a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7981 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541088.734384:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a797a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a7981 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541088.734474:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670687b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981085312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788541088.734518:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541088.734547:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68352ef180 going to sleep for 11 seconds 00000100:00100000:2.0:1788541088.734637:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981085312 00000100:00100000:2.0:1788541088.734643:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981085312 00000100:00100000:2.0:1788541088.734683:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1788541088.734691:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e77ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+22:6514:x1875420981085312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788541088.734822:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e77ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+22:6514:x1875420981085312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 131us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541088.734829:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1788541088.735264:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670687b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981085312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788541088.735300:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670687b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981085440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788541088.735347:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541088.735375:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68352ef180 going to sleep for 11 seconds 00000100:00100000:2.0:1788541088.735641:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981085440 00000100:00100000:2.0:1788541088.735646:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981085440 00000100:00100000:2.0:1788541088.735682:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1788541088.735691:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e779050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+22:6514:x1875420981085440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788541088.735784:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e779050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+22:6514:x1875420981085440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541088.735790:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1788541088.736494:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670687b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981085440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788541088.741222:0:13794:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670687b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:13794:1875420981085568:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788541088.741313:0:13794:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541088.741358:0:13794:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68352ef480 going to sleep for 11 seconds 00000100:00100000:1.0:1788541088.741490:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981085568 00000100:00100000:1.0:1788541088.741499:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981085568 00000100:00100000:1.0:1788541088.741563:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1788541088.741573:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e779850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+22:13794:x1875420981085568:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788541088.742291:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e779850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+22:13794:x1875420981085568:12345-0@lo:502:llog_process_th.0 Request processed in 716us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541088.742300:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1788541088.752654:0:13794:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670687b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:13794:1875420981085568:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788541088.752713:0:13794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788541088.752746:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541088.752749:0:13794:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788541088.752759:0:13794:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a683533b800 00000020:00000080:3.0:1788541088.752762:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788541088.752831:0:13794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788541088.752835:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541088.752836:0:13794:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788541088.752839:0:13794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788541088.752842:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541088.752843:0:13794:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788541088.752847:0:13794:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a683533b800 00000020:00000080:3.0:1788541088.752849:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788541088.752924:0:13794:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:13794:1875420981085696:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788541088.753009:0:13794:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541088.753263:0:13794:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6706859a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788541088.753849:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981085696 00000100:00100000:0.0:1788541088.753858:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981085696 00000100:00100000:0.0:1788541088.753941:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1788541088.753951:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e778450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+22:13794:x1875420981085696:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788541088.754113:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e778450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+22:13794:x1875420981085696:12345-0@lo:502:llog_process_th.0 Request processed in 162us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541088.754121:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1788541088.756000:0:13794:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:13794:1875420981085696:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788541088.756045:0:13794:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788541088.756054:0:13794:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541088.756057:0:13794:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788541088.756062:0:13794:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788541088.756253:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1788541088.756285:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788541088.756304:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a797a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7981 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541088.756314:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a797a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7981 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788541088.756325:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788541088.756329:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a6839117000 from 7 10000000:01000000:1.0:1788541088.756331:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788541088.756366:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68354db400/0x2aac941e5f4a7988 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541088.756373:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a68354db400/0x2aac941e5f4a7988 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541088.756382:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a68354db400/0x2aac941e5f4a7988 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541088.756403:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080a5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981085824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788541088.756481:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541088.756522:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68012543c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788541088.757372:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981085824 00000100:00100000:2.0:1788541088.757384:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981085824 00000100:00100000:2.0:1788541088.757443:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1788541088.757465:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680cee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+22:6514:x1875420981085824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788541088.757480:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541088.757497:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a683551ac00/0x2aac941e5f4a798f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a7988 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541088.757522:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a683551ac00/0x2aac941e5f4a798f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a7988 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541088.757532:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a683551ac00/0x2aac941e5f4a798f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a7988 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541088.757540:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a683551ac00, rc 0) 00000100:00100000:2.0:1788541088.757607:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680cee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+23:6514:x1875420981085824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (1126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541088.757627:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1788541088.757835:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080a5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981085824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788541088.757854:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a68354db400/0x2aac941e5f4a7988 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a798f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541088.757863:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a68354db400/0x2aac941e5f4a7988 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a798f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541088.757963:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080a5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981085952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788541088.758007:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541088.758042:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68012543c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788541088.759600:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981085952 00000100:00100000:3.0:1788541088.759613:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981085952 00000100:00100000:3.0:1788541088.759674:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1788541088.759685:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680cee4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+23:6514:x1875420981085952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788541088.759865:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680cee4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+23:6514:x1875420981085952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 181us (1855us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541088.759890:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1788541088.759946:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080a5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981085952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788541088.760000:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981086080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788541088.760048:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541088.760077:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6706859300 going to sleep for 11 seconds 00000100:00100000:3.0:1788541088.760089:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981086080 00000100:00100000:3.0:1788541088.760093:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981086080 00000100:00100000:3.0:1788541088.760109:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1788541088.760115:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680cee5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+23:6514:x1875420981086080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788541088.760186:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680cee5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+23:6514:x1875420981086080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541088.760193:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1788541088.760229:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981086080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788541088.760398:0:13796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:13796:1875420981086208:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788541088.760429:0:13796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541088.760444:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981086208 00000100:00100000:3.0:1788541088.760447:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981086208 00000100:00100000:3.0:1788541088.760476:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1788541088.760482:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680cee7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+23:13796:x1875420981086208:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788541088.760544:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680cee7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+23:13796:x1875420981086208:12345-0@lo:502:llog_process_th.0 Request processed in 61us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541088.760550:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1788541088.760573:0:13796:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6706859cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788541088.760584:0:13796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:13796:1875420981086208:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788541088.760602:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788541088.760612:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541088.760615:0:13796:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788541088.760623:0:13796:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a6839117000 00000020:00000080:3.0:1788541088.760629:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788541088.760693:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788541088.760696:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541088.760697:0:13796:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788541088.760700:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788541088.760702:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541088.760703:0:13796:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788541088.760706:0:13796:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a6839117000 00000020:00000080:3.0:1788541088.760708:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788541088.760749:0:13796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:13796:1875420981086336:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788541088.760781:0:13796:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541088.760798:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981086336 00000100:00100000:3.0:1788541088.760801:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981086336 00000100:00100000:3.0:1788541088.760818:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1788541088.760824:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680cee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+23:13796:x1875420981086336:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788541088.760900:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680cee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+23:13796:x1875420981086336:12345-0@lo:502:llog_process_th.0 Request processed in 75us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541088.760906:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1788541088.760937:0:13796:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6706859cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788541088.760949:0:13796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:13796:1875420981086336:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788541088.760965:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788541088.760969:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541088.760971:0:13796:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788541088.760974:0:13796:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788541088.761023:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1788541088.761040:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788541088.761050:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68354db400/0x2aac941e5f4a7988 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a798f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541088.761070:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a68354db400/0x2aac941e5f4a7988 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a798f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541088.761082:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788541088.761084:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a68112dc000 from 7 10000000:01000000:3.0:1788541088.761087:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788541088.761109:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a67075ade00/0x2aac941e5f4a7996 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541088.761118:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a67075ade00/0x2aac941e5f4a7996 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541088.761126:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a67075ade00/0x2aac941e5f4a7996 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541088.761138:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981086464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788541088.761160:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541088.761175:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6706859cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788541088.761186:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981086464 00000100:00100000:3.0:1788541088.761189:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981086464 00000100:00100000:3.0:1788541088.761204:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1788541088.761208:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6805288050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+23:6514:x1875420981086464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788541088.761216:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541088.761228:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a67075ad600/0x2aac941e5f4a799d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a7996 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541088.761247:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a67075ad600/0x2aac941e5f4a799d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a7996 expref: 24 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541088.761266:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a67075ad600/0x2aac941e5f4a799d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a7996 expref: 24 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541088.761275:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075ad600, rc 0) 00000100:00100000:3.0:1788541088.761301:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6805288050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+24:6514:x1875420981086464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541088.761306:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1788541088.761331:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981086464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788541088.761342:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a67075ade00/0x2aac941e5f4a7996 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a799d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541088.761350:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a67075ade00/0x2aac941e5f4a7996 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a799d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541088.761385:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981086592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788541088.761406:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541088.761417:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6706859cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788541088.761426:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981086592 00000100:00100000:3.0:1788541088.761429:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981086592 00000100:00100000:3.0:1788541088.761443:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1788541088.761448:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680528a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+24:6514:x1875420981086592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788541088.761520:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680528a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+24:6514:x1875420981086592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 70us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541088.761526:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1788541088.761551:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981086592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788541088.761580:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981086720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788541088.761611:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541088.761624:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6706859cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788541088.761635:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981086720 00000100:00100000:3.0:1788541088.761638:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981086720 00000100:00100000:3.0:1788541088.761653:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1788541088.761657:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6805289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+24:6514:x1875420981086720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788541088.761716:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6805289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+24:6514:x1875420981086720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 57us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541088.761723:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1788541088.761768:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:425687b6-1d99-41d2-88d8-2fb230997596:6514:1875420981086720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788541088.764108:0:13797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b7c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:13797:1875420981086848:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788541088.764198:0:13797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541088.764246:0:13797:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683f2f4600 going to sleep for 11 seconds 00000100:00100000:1.0:1788541088.764295:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981086848 00000100:00100000:1.0:1788541088.764302:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981086848 00000100:00100000:1.0:1788541088.764350:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1788541088.764360:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6805288850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+24:13797:x1875420981086848:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788541088.764493:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6805288850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+24:13797:x1875420981086848:12345-0@lo:502:llog_process_th.0 Request processed in 134us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541088.764501:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1788541088.764569:0:13797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b7c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:13797:1875420981086848:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788541088.764597:0:13797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788541088.764606:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541088.764609:0:13797:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788541088.764618:0:13797:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a68112dc000 00000020:00000080:1.0:1788541088.764620:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788541088.764684:0:13797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788541088.764688:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541088.764690:0:13797:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788541088.764693:0:13797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788541088.764695:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541088.764696:0:13797:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788541088.764699:0:13797:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a68112dc000 00000020:00000080:1.0:1788541088.764701:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788541088.764747:0:13797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080a4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:13797:1875420981086976:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788541088.764784:0:13797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541088.764806:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981086976 00000100:00100000:1.0:1788541088.764809:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981086976 00000100:00100000:1.0:1788541088.764834:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1788541088.764847:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6809078850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+24:13797:x1875420981086976:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788541088.764932:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6809078850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+24:13797:x1875420981086976:12345-0@lo:502:llog_process_th.0 Request processed in 84us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541088.764939:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1788541088.764968:0:13797:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6706875900 going to sleep for 11 seconds 00000100:00100000:1.0:1788541088.764979:0:13797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080a4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:425687b6-1d99-41d2-88d8-2fb230997596:13797:1875420981086976:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788541088.764996:0:13797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788541088.765000:0:13797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541088.765002:0:13797:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788541088.765006:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788541088.765069:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1788541088.765087:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788541088.765096:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a67075ade00/0x2aac941e5f4a7996 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a799d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541088.765107:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a67075ade00/0x2aac941e5f4a7996 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a799d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788541088.773766:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788541088.789054:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788541089.062494:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541089.062587:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541089.062637:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541089.062681:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541089.062707:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541089.062769:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541089.063346:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955832448 00000100:00100000:3.0:1788541089.063360:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955832448 00000100:00100000:3.0:1788541089.063458:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955832960 00000100:00100000:3.0:1788541089.063462:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955832960 00000100:00100000:3.0:1788541089.063477:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955832576 00000100:00100000:3.0:1788541089.063480:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955832576 00000100:00100000:3.0:1788541089.063494:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955832832 00000100:00100000:3.0:1788541089.063497:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955832832 00000100:00100000:3.0:1788541089.063517:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 233 00000100:00100000:3.0:1788541089.063529:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+5:2395:x1875420955832448:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541089.063646:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+5:2395:x1875420955832448:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 119us (1163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541089.063654:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 233 00000100:00100000:3.0:1788541089.063672:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 234 00000100:00100000:3.0:1788541089.063698:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2395:x1875420955832960:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541089.063728:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2395:x1875420955832960:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 32us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541089.063744:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 234 00000100:00100000:3.0:1788541089.063757:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 235 00000100:00100000:3.0:1788541089.063764:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+5:2395:x1875420955832576:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541089.063789:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+5:2395:x1875420955832576:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 25us (1081us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541089.063795:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 235 00000100:00100000:3.0:1788541089.064138:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 236 00000100:00100000:3.0:1788541089.064148:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2395:x1875420955832832:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541089.064180:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2395:x1875420955832832:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 35us (1411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541089.064187:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 236 00000100:00080000:3.0:1788541089.064398:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788541089.064404:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788541089.064614:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955832320 00000100:00100000:1.0:1788541089.064622:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955832320 00000100:00100000:1.0:1788541089.064661:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 371 00000100:00100000:1.0:1788541089.064669:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680907a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:2395:x1875420955832320:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1788541089.064719:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680907a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:2395:x1875420955832320:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 51us (2038us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541089.064727:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 371 00000100:00100000:2.0:1788541089.065246:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955832704 00000100:00100000:2.0:1788541089.065252:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955832704 00000100:00100000:2.0:1788541089.065301:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 82 00000100:00100000:2.0:1788541089.065310:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:384f52e3-0481-4979-9299-157aff7472d2+5:2395:x1875420955832704:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1788541089.065345:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:384f52e3-0481-4979-9299-157aff7472d2+5:2395:x1875420955832704:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 38us (2760us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541089.065352:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 82 00000100:00080000:2.0:1788541089.065371:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788541089.354066:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788541089.803071:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788541089.806228:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788541090.250263:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981087104:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788541090.250394:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541090.250579:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981087104 00000100:00100000:3.0:1788541090.250589:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981087104 00000100:00100000:3.0:1788541090.250656:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788541090.250667:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981087104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788541090.250700:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788541090.250761:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981087104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541090.250768:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:1.0:1788541090.250960:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788541090.250994:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67080d7800 x1875420981087104/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541106 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541090.251015:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981087104:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788541090.251330:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670687b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981087232:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788541090.251393:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541090.253289:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981087232 00000100:00100000:3.0:1788541090.253299:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981087232 00000100:00100000:3.0:1788541090.253362:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788541090.253372:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981087232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788541090.253404:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788541090.253592:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981087360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788541090.253633:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541090.254223:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981087360 00000100:00100000:1.0:1788541090.254229:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981087360 00000100:00100000:1.0:1788541090.254287:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788541090.254296:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670687ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981087360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788541090.254312:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788541090.254355:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670687ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981087360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541090.254363:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:0.0:1788541090.255102:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788541090.255150:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67080a4700 x1875420981087360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541106 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541090.255287:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981087232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1915us (3891us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541090.255288:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981087360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788541090.255296:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788541090.255356:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670687b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981087232:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788541090.378051:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541091.285754:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788541091.285781:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981087488:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788541091.285904:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541091.286684:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981087488 00000100:00100000:1.0:1788541091.286694:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981087488 00000100:00100000:1.0:1788541091.286763:0:10866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788541091.286772:0:10866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981087488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788541091.286817:0:10866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788541091.286951:0:10866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981087488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 179us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541091.286958:0:10866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788541091.287121:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981087488:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788541091.403793:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788541091.792937:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:2.0:1788541092.298435:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420981087616:0@lo:400:kworker.0 00000100:00100000:2.0:1788541092.298526:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541092.298588:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981088128:0@lo:400:kworker.0 00000100:00100000:2.0:1788541092.298615:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541092.298650:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981088640:0@lo:400:kworker.0 00000100:00100000:2.0:1788541092.298673:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541092.298774:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67076f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981089152:0@lo:400:kworker.0 00000100:00100000:2.0:1788541092.298802:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541092.298813:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875420981088000:0@lo:400:kworker.0 00000100:00100000:2.0:1788541092.298828:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1788541092.298836:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875420981087744:0@lo:400:kworker.0 00000100:00100000:0.0:1788541092.298856:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541092.298926:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981088512:0@lo:400:kworker.0 00000100:00100000:2.0:1788541092.298938:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981087872:0@lo:400:kworker.0 00000100:00100000:0.0:1788541092.298957:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541092.298977:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67076f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981089024:0@lo:400:kworker.0 00000100:00100000:0.0:1788541092.299001:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541092.299033:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981088640 00000100:00100000:0.0:1788541092.299040:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981088640 00000100:00100000:0.0:1788541092.299086:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981089152 00000100:00100000:0.0:1788541092.299089:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981089152 00000100:00100000:0.0:1788541092.299105:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981088512 00000100:00100000:0.0:1788541092.299107:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981088512 00000100:00100000:0.0:1788541092.299118:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981089024 00000100:00100000:0.0:1788541092.299121:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981089024 00000100:00100000:0.0:1788541092.299148:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788541092.299167:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981088640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541092.299219:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981088640:12345-0@lo:400:kworker.0 Request processed in 63us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541092.299227:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788541092.299237:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541092.299249:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788541092.299258:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981089152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541092.299262:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875420981088384:0@lo:400:kworker.0 00000100:00100000:2.0:1788541092.299298:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541092.299305:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981089152:12345-0@lo:400:kworker.0 Request processed in 47us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541092.299319:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875420981088896:0@lo:400:kworker.0 00000100:00100000:0.0:1788541092.299326:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788541092.299346:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788541092.299349:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541092.299358:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670687b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981088512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541092.299370:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707bb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981089408:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788541092.299405:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541092.299416:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670687b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981088512:12345-0@lo:400:kworker.0 Request processed in 49us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541092.299424:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788541092.299440:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788541092.299448:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981089024:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788541092.299465:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788541092.299471:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788541092.299481:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981089024:12345-0@lo:400:kworker.0 Request processed in 34us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541092.299484:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541092.299493:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788541092.299512:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875420981088256:0@lo:400:kworker.0 00000100:00100000:0.0:1788541092.299529:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981088000 00000100:00100000:0.0:1788541092.299534:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981088000 00000100:00100000:2.0:1788541092.299539:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541092.299558:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981088384 00000100:00100000:2.0:1788541092.299563:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875420981088768:0@lo:400:kworker.0 00000100:00100000:0.0:1788541092.299563:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981088384 00000100:00100000:0.0:1788541092.299590:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981088896 00000100:00100000:0.0:1788541092.299595:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981088896 00000100:00100000:2.0:1788541092.299596:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541092.299615:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67076f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981089280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788541092.299615:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981087744 00000100:00100000:0.0:1788541092.299619:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981087744 00000100:00100000:0.0:1788541092.299636:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981088256 00000100:00100000:0.0:1788541092.299639:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981088256 00000100:00100000:2.0:1788541092.299646:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541092.299655:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981088768 00000100:00100000:0.0:1788541092.299659:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981088768 00000100:00100000:0.0:1788541092.299743:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788541092.299749:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670687b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875420981088000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541092.299783:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670687b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875420981088000:12345-0@lo:400:kworker.0 Request processed in 34us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541092.299796:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788541092.299802:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981087616 00000100:00100000:3.0:1788541092.299808:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981087616 00000100:00100000:0.0:1788541092.299822:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788541092.299831:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875420981088384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541092.299843:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1788541092.299852:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680907ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+24:3643:x1875420981087616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541092.299901:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875420981088384:12345-0@lo:400:kworker.0 Request processed in 71us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541092.299909:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788541092.299916:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680907ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+24:3643:x1875420981087616:12345-0@lo:400:kworker.0 Request processed in 64us (1389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541092.299923:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1788541092.299927:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788541092.299937:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875420981088896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541092.299958:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981088128 00000100:00100000:1.0:1788541092.299962:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981088128 00000100:00100000:0.0:1788541092.299990:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875420981088896:12345-0@lo:400:kworker.0 Request processed in 55us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541092.299997:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788541092.300010:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788541092.300016:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875420981087744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541092.300045:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875420981087744:12345-0@lo:400:kworker.0 Request processed in 30us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541092.300051:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788541092.300062:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788541092.300068:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875420981088256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541092.300095:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875420981088256:12345-0@lo:400:kworker.0 Request processed in 28us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541092.300100:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788541092.300111:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788541092.300118:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875420981088768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541092.300146:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875420981088768:12345-0@lo:400:kworker.0 Request processed in 29us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541092.300152:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00080000:0.0:1788541092.300178:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788541092.300182:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788541092.300187:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981087872 00000100:00100000:1.0:1788541092.300191:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981087872 00000100:00100000:0.0:1788541092.300209:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875420981088000:0@lo:400:kworker.0 00000100:00100000:3.0:1788541092.300216:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00010000:00080000:0.0:1788541092.300226:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67080a6a00 x1875420981088512/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541092.300235:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981088128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541092.300241:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981088512:0@lo:400:kworker.0 00000100:00100000:0.0:1788541092.300256:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67076f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981089024:0@lo:400:kworker.0 00000100:00100000:3.0:1788541092.300278:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981088128:12345-0@lo:400:kworker.0 Request processed in 46us (1661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541092.300285:0:10866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788541092.300295:0:10866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981087872:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1788541092.300298:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67080a5f80 x1875420981088384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541092.300308:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875420981088384:0@lo:400:kworker.0 00010000:00080000:0.0:1788541092.300318:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67080a5c00 x1875420981088896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541092.300326:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875420981088896:0@lo:400:kworker.0 00000100:00100000:1.0:1788541092.300330:0:10866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981087872:12345-0@lo:400:kworker.0 Request processed in 38us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541092.300341:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981087872:0@lo:400:kworker.0 00000100:00100000:0.0:1788541092.300369:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981089408 00000100:00100000:0.0:1788541092.300372:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981089408 00010000:00080000:2.0:1788541092.300378:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67080a4700 x1875420981088640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541092.300389:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981089280 00000100:00100000:0.0:1788541092.300392:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981089280 00000100:00100000:2.0:1788541092.300394:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981088640:0@lo:400:kworker.0 00000100:00100000:0.0:1788541092.300405:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788541092.300415:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981089408:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788541092.300428:0:3643:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:2.0:1788541092.300434:0:3643:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a6707a30a80, transno 4294967301 00002000:00000024:0.0:1788541092.300436:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788541092.300448:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67076f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981089152:0@lo:400:kworker.0 00000100:00100000:2.0:1788541092.300474:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875420981087744:0@lo:400:kworker.0 00000100:00100000:0.0:1788541092.300480:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981089408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541092.300487:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788541092.300490:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875420981088256:0@lo:400:kworker.0 00000100:00100000:2.0:1788541092.300507:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875420981088768:0@lo:400:kworker.0 00000100:00100000:0.0:1788541092.300512:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788541092.300519:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420981087616:0@lo:400:kworker.0 00000100:00100000:0.0:1788541092.300522:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981089280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788541092.300534:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788541092.300535:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981088128:0@lo:400:kworker.0 00000100:00100000:0.0:1788541092.300567:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981089280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541092.300573:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67076f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981089280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788541092.300576:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788541092.300615:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707bb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981089408:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788541092.303458:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788541092.307089:0:10866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00010000:00010000:2.0:1788541092.426058:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541093.450070:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541094.179756:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541094.179812:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541094.179841:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955833216 00000100:00100000:1.0:1788541094.179851:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541094.179853:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955833216 00000100:00100000:1.0:1788541094.179919:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541094.179928:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955833472 00000100:00100000:2.0:1788541094.179934:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955833472 00000100:00100000:1.0:1788541094.179951:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541094.179952:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955833344 00000100:00100000:0.0:1788541094.179957:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955833344 00000100:00100000:1.0:1788541094.179986:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541094.179986:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955833600 00000100:00100000:0.0:1788541094.179991:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955833600 00000100:00100000:2.0:1788541094.179998:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 87 00000100:00100000:0.0:1788541094.180011:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955833728 00000100:00100000:2.0:1788541094.180014:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67076f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:384f52e3-0481-4979-9299-157aff7472d2+5:2395:x1875420955833472:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541094.180015:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955833728 00000100:00100000:1.0:1788541094.180031:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 243 00000100:00100000:1.0:1788541094.180042:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67076f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+5:2395:x1875420955833216:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541094.180071:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955833088 00000100:00100000:3.0:1788541094.180076:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955833088 00000100:00100000:1.0:1788541094.180103:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67076f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+5:2395:x1875420955833216:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 63us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541094.180114:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 373 00000100:00100000:3.0:1788541094.180133:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6809078450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:2394:x1875420955833088:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1788541094.180730:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67076f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:384f52e3-0481-4979-9299-157aff7472d2+5:2395:x1875420955833472:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 719us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541094.180740:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 87 00000100:00100000:0.0:1788541094.183607:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 244 00000100:00100000:0.0:1788541094.183634:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67076f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+5:2394:x1875420955833344:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541094.183724:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67076f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+5:2394:x1875420955833344:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 103us (3806us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541094.183733:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 244 00000100:00100000:0.0:1788541094.183767:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 245 00000100:00100000:0.0:1788541094.183775:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67076f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2394:x1875420955833600:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541094.183801:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67076f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2394:x1875420955833600:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 28us (3853us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541094.183807:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 245 00000100:00100000:0.0:1788541094.183818:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 246 00000100:00100000:0.0:1788541094.183841:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67076f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2395:x1875420955833728:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541094.183868:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67076f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2395:x1875420955833728:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 28us (3883us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541094.183890:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 246 00000100:00080000:0.0:1788541094.183943:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788541094.183950:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788541094.183953:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788541094.187594:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6809078450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:2394:x1875420955833088:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 7448us (7769us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541094.187610:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 373 00000100:00100000:1.0:1788541094.188274:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 243 00010000:00010000:3.0:1788541094.476735:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541095.370134:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788541095.370158:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981089536:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788541095.370247:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541095.370362:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981089536 00000100:00100000:1.0:1788541095.370370:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981089536 00000100:00100000:2.0:1788541095.370411:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67076f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981089664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788541095.370420:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788541095.370430:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981089536:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788541095.370444:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:1.0:1788541095.370462:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788541095.370516:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981089536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541095.370537:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788541095.370632:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981089536:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788541095.370639:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981089664 00000100:00100000:0.0:1788541095.370642:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981089664 00000100:00080000:2.0:1788541095.370690:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788541095.370718:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788541095.370726:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981089664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788541095.370746:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788541095.370779:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981089664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541095.370784:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788541095.370941:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981089792:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788541095.370981:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788541095.371029:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67076f6a00 x1875420981089664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541111 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541095.371043:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67076f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981089664:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788541095.371165:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981089792 00000100:00100000:2.0:1788541095.371170:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981089792 00000100:00080000:0.0:1788541095.371214:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788541095.371222:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788541095.371230:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981089792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788541095.371241:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788541095.371280:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981089792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541095.371287:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:0.0:1788541095.371324:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67079e0380 x1875420981089792/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541111 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541095.371337:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981089792:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788541095.498255:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541096.394259:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788541096.394284:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67076f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981089920:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788541096.394358:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541096.394734:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981089920 00000100:00100000:1.0:1788541096.394742:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981089920 00000100:00100000:1.0:1788541096.394788:0:10866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788541096.394798:0:10866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981089920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788541096.394832:0:10866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788541096.394923:0:10866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981089920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 127us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541096.394932:0:10866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788541096.395029:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67076f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981089920:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788541096.523167:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541097.418308:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788541097.418335:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707823800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981090048:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788541097.418415:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541097.418502:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981090048 00000100:00100000:2.0:1788541097.418510:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981090048 00000100:00100000:1.0:1788541097.418553:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67076f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420981090176:0@lo:400:kworker.0 00000100:00100000:2.0:1788541097.418572:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788541097.418584:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707822d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981090048:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788541097.418594:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1788541097.418617:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788541097.418623:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67076f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981090688:0@lo:400:kworker.0 00000100:00100000:2.0:1788541097.418678:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707822d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981090048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541097.418682:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541097.418691:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788541097.418707:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67076f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981091200:0@lo:400:kworker.0 00000100:00080000:2.0:1788541097.418724:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788541097.418740:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67076f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981090432:0@lo:400:kworker.0 00000100:00100000:3.0:1788541097.418814:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67076f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875420981090304:0@lo:400:kworker.0 00000100:00100000:0.0:1788541097.418985:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981090176 00000100:00100000:0.0:1788541097.418989:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981090176 00000100:00100000:0.0:1788541097.419026:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1788541097.419033:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807634850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+24:3643:x1875420981090176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541097.420419:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541097.420471:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67076f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875420981090944:0@lo:400:kworker.0 00000100:00100000:3.0:1788541097.420542:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541097.420652:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67076f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875420981090816:0@lo:400:kworker.0 00000100:00100000:2.0:1788541097.420672:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541097.420695:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67076f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875420981091456:0@lo:400:kworker.0 00000100:00100000:2.0:1788541097.420718:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541097.420920:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541097.420925:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707823800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981090048:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788541097.420946:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67076f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875420981091328:0@lo:400:kworker.0 00000100:00100000:2.0:1788541097.421018:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788541097.421026:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67076f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875420981090560:0@lo:400:kworker.0 00000100:00100000:2.0:1788541097.421052:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541097.421072:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67076f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981091072:0@lo:400:kworker.0 00000100:00100000:2.0:1788541097.421104:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541097.421113:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541097.421131:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788541097.421138:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981091712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788541097.421163:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541097.421234:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67076f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981091584:0@lo:400:kworker.0 00000100:00100000:2.0:1788541097.421258:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541097.421288:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981090688 00000100:00100000:2.0:1788541097.421295:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981090688 00000100:00100000:2.0:1788541097.421333:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981090432 00000100:00100000:2.0:1788541097.421337:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981090432 00000100:00100000:2.0:1788541097.421352:0:10866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788541097.421360:0:10866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67076f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981090688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541097.421382:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981091712 00000100:00100000:3.0:1788541097.421387:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981091712 00000100:00100000:2.0:1788541097.421408:0:10866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67076f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981090688:12345-0@lo:400:kworker.0 Request processed in 49us (2728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541097.421417:0:10866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788541097.421433:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788541097.421439:0:10866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788541097.421444:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707addf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981091712:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788541097.421450:0:10866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707822300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981090432:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1788541097.421460:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788541097.421500:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707addf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981091712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541097.421513:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:3.0:1788541097.421535:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788541097.421562:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981091712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788541097.421772:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981090304 00000100:00100000:3.0:1788541097.421776:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981090304 00000100:00100000:3.0:1788541097.421798:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981090944 00000100:00100000:3.0:1788541097.421800:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981090944 00000100:00100000:3.0:1788541097.421818:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981091456 00000100:00100000:3.0:1788541097.421821:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981091456 00000100:00100000:3.0:1788541097.421833:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981090816 00000100:00100000:3.0:1788541097.421835:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981090816 00000100:00100000:3.0:1788541097.421845:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981090560 00000100:00100000:3.0:1788541097.421847:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981090560 00000100:00100000:3.0:1788541097.421856:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981091328 00000100:00100000:3.0:1788541097.421858:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981091328 00000100:00100000:3.0:1788541097.421892:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788541097.421899:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875420981090304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541097.421938:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875420981090304:12345-0@lo:400:kworker.0 Request processed in 40us (1398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541097.421945:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788541097.421957:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788541097.421964:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707821f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875420981090944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541097.421997:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707821f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875420981090944:12345-0@lo:400:kworker.0 Request processed in 34us (1326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541097.422003:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788541097.422014:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788541097.422020:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707823100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875420981091456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541097.422059:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707823100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875420981091456:12345-0@lo:400:kworker.0 Request processed in 39us (1340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541097.422065:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788541097.422077:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788541097.422082:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707aded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875420981090816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541097.422107:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707aded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875420981090816:12345-0@lo:400:kworker.0 Request processed in 26us (1189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541097.422113:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788541097.422124:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788541097.422129:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707823800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875420981090560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541097.422155:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707823800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875420981090560:12345-0@lo:400:kworker.0 Request processed in 26us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541097.422160:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788541097.422170:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788541097.422176:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875420981091328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541097.422202:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875420981091328:12345-0@lo:400:kworker.0 Request processed in 26us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541097.422207:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00080000:3.0:1788541097.422228:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788541097.422231:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788541097.422249:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67076f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875420981090304:0@lo:400:kworker.0 00000100:00100000:3.0:1788541097.422451:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67076f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875420981090816:0@lo:400:kworker.0 00000100:00100000:3.0:1788541097.422464:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67076f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875420981091328:0@lo:400:kworker.0 00000100:00100000:3.0:1788541097.422511:0:8973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981091072 00000100:00100000:3.0:1788541097.422525:0:8973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981091072 00000100:00100000:3.0:1788541097.422562:0:8973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981091584 00000100:00100000:3.0:1788541097.422565:0:8973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981091584 00000100:00100000:2.0:1788541097.422625:0:10866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707822300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981090432:12345-0@lo:400:kworker.0 Request processed in 1177us (2211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541097.422633:0:10866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788541097.422666:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788541097.422676:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707821c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981091072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541097.422708:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707821c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981091072:12345-0@lo:400:kworker.0 Request processed in 35us (1604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541097.422714:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788541097.422916:0:8973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788541097.422924:0:8973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707821180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981091584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541097.422963:0:8973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707821180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981091584:12345-0@lo:400:kworker.0 Request processed in 41us (1704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541097.422968:0:8973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:3.0:1788541097.422986:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788541097.423015:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67076f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875420981090560:0@lo:400:kworker.0 00010000:00080000:3.0:1788541097.423029:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67076f7100 x1875420981091072/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541113 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541097.423038:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67076f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981091072:0@lo:400:kworker.0 00000100:00100000:3.0:1788541097.423047:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67076f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981091584:0@lo:400:kworker.0 00000100:00100000:3.0:1788541097.423058:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67076f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981090432:0@lo:400:kworker.0 00010000:00080000:3.0:1788541097.423068:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67076f5f80 x1875420981090944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541113 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541097.423076:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67076f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875420981090944:0@lo:400:kworker.0 00010000:00080000:3.0:1788541097.423086:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67076f6680 x1875420981091456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541113 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541097.423093:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67076f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875420981091456:0@lo:400:kworker.0 00000100:00100000:1.0:1788541097.426363:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541097.426567:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67076f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981090688:0@lo:400:kworker.0 00000100:00100000:3.0:1788541097.426913:0:8973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981091200 00000100:00100000:3.0:1788541097.426922:0:8973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981091200 00000100:00100000:3.0:1788541097.426990:0:8973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788541097.427016:0:8973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68357b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981091200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541097.427089:0:8973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68357b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981091200:12345-0@lo:400:kworker.0 Request processed in 74us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541097.427096:0:8973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:1.0:1788541097.428102:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788541097.428146:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67076f5c00 x1875420981091200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541113 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541097.428159:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67076f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981091200:0@lo:400:kworker.0 00000100:00100000:1.0:1788541097.434579:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67076f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420981090176:0@lo:400:kworker.0 00000100:00100000:0.0:1788541097.434580:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807634850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+24:3643:x1875420981090176:12345-0@lo:400:kworker.0 Request processed in 15537us (15977us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541097.434600:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00010000:00010000:3.0:1788541097.546117:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541098.570215:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788541099.018990:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788541099.020174:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788541099.298948:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541099.298993:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541099.299027:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541099.299056:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541099.299078:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541099.299098:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541099.299172:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955833856 00000100:00100000:3.0:1788541099.299181:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955833856 00000100:00100000:3.0:1788541099.299235:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 375 00000100:00100000:3.0:1788541099.299244:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:2396:x1875420955833856:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541099.299308:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:2396:x1875420955833856:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 65us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541099.299316:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 375 00000100:00100000:3.0:1788541099.299351:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955834112 00000100:00100000:3.0:1788541099.299355:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955834112 00000100:00100000:3.0:1788541099.299388:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955834368 00000100:00100000:3.0:1788541099.299391:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955834368 00000100:00100000:3.0:1788541099.299404:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955833984 00000100:00100000:3.0:1788541099.299407:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955833984 00000100:00100000:3.0:1788541099.299418:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955834496 00000100:00100000:3.0:1788541099.299421:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955834496 00000100:00100000:3.0:1788541099.299434:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 253 00000100:00100000:3.0:1788541099.299441:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67076f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+5:2396:x1875420955834112:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541099.299468:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67076f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+5:2396:x1875420955834112:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 28us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541099.299475:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 253 00000100:00100000:3.0:1788541099.299485:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 254 00000100:00100000:3.0:1788541099.299502:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67076f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2396:x1875420955834368:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541099.299521:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67076f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2396:x1875420955834368:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 20us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541099.299527:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 254 00000100:00100000:3.0:1788541099.299536:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 255 00000100:00100000:3.0:1788541099.299541:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67076f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+5:2396:x1875420955833984:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541099.299558:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67076f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+5:2396:x1875420955833984:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 17us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541099.299564:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 255 00000100:00100000:3.0:1788541099.299572:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 256 00000100:00100000:3.0:1788541099.299577:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67076f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2396:x1875420955834496:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541099.299603:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67076f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2396:x1875420955834496:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 16us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541099.299609:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 256 00000100:00100000:3.0:1788541099.299625:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955834240 00000100:00100000:3.0:1788541099.299628:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955834240 00000100:00100000:3.0:1788541099.299659:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 91 00000100:00100000:3.0:1788541099.299666:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67076f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:384f52e3-0481-4979-9299-157aff7472d2+5:2396:x1875420955834240:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541099.299691:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67076f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:384f52e3-0481-4979-9299-157aff7472d2+5:2396:x1875420955834240:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 25us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541099.299697:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 91 00000100:00080000:1.0:1788541099.300039:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788541099.300044:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788541099.300046:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788541099.594396:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541100.490176:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981091840:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788541100.490267:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541100.490593:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981091840 00000100:00100000:2.0:1788541100.490604:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981091840 00000100:00100000:2.0:1788541100.490691:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788541100.490701:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981091840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788541100.490732:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788541100.490787:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707adf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981091840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541100.490794:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788541100.493381:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981091968:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788541100.493455:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541100.493527:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788541100.493535:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707820a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981092096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788541100.493563:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788541100.493616:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788541100.493666:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67079e1180 x1875420981091840/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541116 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541100.493687:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981091840:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788541100.493961:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981091968 00000100:00100000:0.0:1788541100.493969:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981091968 00000100:00100000:0.0:1788541100.494036:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788541100.494046:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981091968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788541100.494077:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788541100.494141:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981091968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541100.494148:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788541100.494306:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981092096 00000100:00100000:2.0:1788541100.494312:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981092096 00000100:00100000:2.0:1788541100.494372:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788541100.494381:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981092096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788541100.494395:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788541100.494430:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981092096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541100.494447:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:1.0:1788541100.494503:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788541100.494756:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707820a80 x1875420981092096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541116 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541100.494772:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707820a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981092096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788541100.494784:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981091968:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788541100.618216:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541101.514158:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788541101.514183:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67076f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981092224:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788541101.514259:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541101.514445:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981092224 00000100:00100000:1.0:1788541101.514453:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981092224 00000100:00100000:1.0:1788541101.514512:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788541101.514521:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981092224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788541101.514554:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788541101.514626:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981092224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541101.514633:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788541101.514778:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67076f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981092224:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788541101.642053:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541102.538116:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707822680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981092352:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788541102.538199:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541102.538488:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981092352 00000100:00100000:2.0:1788541102.538498:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981092352 00000100:00100000:2.0:1788541102.538574:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788541102.538585:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981092352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788541102.538624:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788541102.538675:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981092352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541102.538682:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788541102.538772:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707822680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981092352:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788541102.539167:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875420981092864:0@lo:400:kworker.0 00000100:00100000:0.0:1788541102.539197:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541102.539217:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981093376:0@lo:400:kworker.0 00000100:00100000:0.0:1788541102.539236:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541102.539247:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981093888:0@lo:400:kworker.0 00000100:00100000:0.0:1788541102.539261:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541102.539274:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788541102.539278:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981092736:0@lo:400:kworker.0 00000100:00100000:0.0:1788541102.539295:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541102.539318:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875420981093248:0@lo:400:kworker.0 00000100:00100000:0.0:1788541102.539338:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541102.539352:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875420981093760:0@lo:400:kworker.0 00000100:00100000:0.0:1788541102.539375:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541102.539401:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981092736 00000100:00100000:0.0:1788541102.539418:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981092736 00000100:00100000:0.0:1788541102.539449:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788541102.539456:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981092736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541102.539728:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875420981092608:0@lo:400:kworker.0 00000100:00100000:1.0:1788541102.539760:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541102.539781:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875420981093120:0@lo:400:kworker.0 00000100:00100000:1.0:1788541102.539802:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541102.539819:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875420981093632:0@lo:400:kworker.0 00000100:00100000:1.0:1788541102.539839:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541102.539857:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788541102.539888:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420981092480:0@lo:400:kworker.0 00000100:00100000:1.0:1788541102.539909:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541102.539925:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981092992:0@lo:400:kworker.0 00000100:00100000:1.0:1788541102.539939:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541102.539947:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981093504:0@lo:400:kworker.0 00000100:00100000:1.0:1788541102.539958:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541102.539975:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981092864 00000100:00100000:1.0:1788541102.539977:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981092864 00000100:00100000:1.0:1788541102.539995:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981093248 00000100:00100000:1.0:1788541102.539996:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981093248 00000100:00100000:1.0:1788541102.540005:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981093760 00000100:00100000:1.0:1788541102.540006:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981093760 00000100:00100000:1.0:1788541102.540013:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981092608 00000100:00100000:1.0:1788541102.540014:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981092608 00000100:00100000:1.0:1788541102.540019:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981093120 00000100:00100000:1.0:1788541102.540020:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981093120 00000100:00100000:1.0:1788541102.540027:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981093632 00000100:00100000:1.0:1788541102.540028:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981093632 00000100:00100000:1.0:1788541102.540036:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788541102.540040:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875420981092864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541102.540076:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875420981092864:12345-0@lo:400:kworker.0 Request processed in 35us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541102.540080:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788541102.540090:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788541102.540094:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875420981093248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541102.540117:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875420981093248:12345-0@lo:400:kworker.0 Request processed in 23us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541102.540121:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788541102.540145:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788541102.540152:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875420981093760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541102.540180:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875420981093760:12345-0@lo:400:kworker.0 Request processed in 29us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541102.540184:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788541102.540191:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788541102.540195:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67076f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875420981092608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541102.540214:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67076f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875420981092608:12345-0@lo:400:kworker.0 Request processed in 19us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541102.540218:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788541102.540224:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788541102.540227:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67076f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875420981093120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541102.540241:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67076f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875420981093120:12345-0@lo:400:kworker.0 Request processed in 13us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541102.540244:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788541102.540249:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788541102.540252:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67076f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875420981093632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541102.540266:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67076f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875420981093632:12345-0@lo:400:kworker.0 Request processed in 14us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541102.540269:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788541102.540285:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981092992 00000100:00100000:1.0:1788541102.540287:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981092992 00000100:00100000:1.0:1788541102.540297:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788541102.540300:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67076f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981092992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541102.540318:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67076f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981092992:12345-0@lo:400:kworker.0 Request processed in 18us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541102.540326:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788541102.540348:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981092992:0@lo:400:kworker.0 00000100:00100000:1.0:1788541102.540355:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875420981092608:0@lo:400:kworker.0 00000100:00100000:1.0:1788541102.540360:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875420981093120:0@lo:400:kworker.0 00000100:00100000:1.0:1788541102.540365:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875420981093632:0@lo:400:kworker.0 00000100:00100000:1.0:1788541102.540424:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981092736:0@lo:400:kworker.0 00010000:00080000:1.0:1788541102.540436:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67080a6d80 x1875420981093248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541102.540446:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875420981093248:0@lo:400:kworker.0 00010000:00080000:1.0:1788541102.540456:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67080a5880 x1875420981093760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541102.540464:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875420981093760:0@lo:400:kworker.0 00000100:00100000:1.0:1788541102.540473:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875420981092864:0@lo:400:kworker.0 00000100:00100000:1.0:1788541102.540505:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981092480 00000100:00100000:1.0:1788541102.540508:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981092480 00000100:00100000:1.0:1788541102.540525:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1788541102.540529:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+24:3642:x1875420981092480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541102.540552:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+24:3642:x1875420981092480:12345-0@lo:400:kworker.0 Request processed in 23us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541102.540556:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1788541102.540575:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420981092480:0@lo:400:kworker.0 00000100:00100000:0.0:1788541102.540748:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981092736:12345-0@lo:400:kworker.0 Request processed in 41us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541102.540756:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788541102.540923:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981093376 00000100:00100000:2.0:1788541102.540928:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981093376 00000100:00100000:2.0:1788541102.540960:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981093888 00000100:00100000:2.0:1788541102.540963:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981093888 00000100:00100000:2.0:1788541102.540973:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981093504 00000100:00100000:2.0:1788541102.540975:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981093504 00000100:00100000:2.0:1788541102.540986:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788541102.540992:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981093376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541102.541024:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981093376:12345-0@lo:400:kworker.0 Request processed in 33us (1788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541102.541030:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788541102.541039:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788541102.541044:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981093888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541102.541079:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981093888:12345-0@lo:400:kworker.0 Request processed in 35us (1816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541102.541084:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788541102.541092:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788541102.541103:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67076f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981093504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541102.541147:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67076f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981093504:12345-0@lo:400:kworker.0 Request processed in 44us (1187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541102.541152:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:2.0:1788541102.541174:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67080a5180 x1875420981093504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541102.541183:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981093504:0@lo:400:kworker.0 00010000:00080000:1.0:1788541102.541563:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67080a4000 x1875420981093376/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541102.541570:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981093376:0@lo:400:kworker.0 00000100:00100000:1.0:1788541102.541576:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981093888:0@lo:400:kworker.0 00000100:00080000:3.0:1788541102.541752:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788541102.541757:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788541102.541760:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788541102.541761:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788541102.542027:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788541102.542038:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67076f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981094016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788541102.542317:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541102.542391:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981094016 00000100:00100000:0.0:1788541102.542397:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981094016 00000100:00100000:0.0:1788541102.542451:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788541102.542461:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981094016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788541102.542480:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788541102.542526:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981094016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541102.542531:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788541102.542648:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67076f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981094016:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788541102.666060:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541103.693030:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541104.420700:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541104.420755:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541104.420804:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541104.420934:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955834880 00000100:00100000:3.0:1788541104.420948:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955834880 00000100:00100000:3.0:1788541104.421035:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955834752 00000100:00100000:3.0:1788541104.421039:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955834752 00000100:00100000:3.0:1788541104.421066:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 263 00000100:00100000:3.0:1788541104.421078:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+5:2394:x1875420955834880:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541104.421184:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+5:2394:x1875420955834880:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 107us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541104.421192:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 263 00000100:00100000:3.0:1788541104.421212:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 264 00000100:00100000:3.0:1788541104.421219:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+5:2394:x1875420955834752:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541104.421247:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+5:2394:x1875420955834752:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 28us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541104.421253:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 264 00000100:00080000:0.0:1788541104.421424:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788541104.421430:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788541104.421638:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955834624 00000100:00100000:1.0:1788541104.421644:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955834624 00000100:00100000:1.0:1788541104.421691:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 377 00000100:00100000:1.0:1788541104.421699:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807636c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:2394:x1875420955834624:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1788541104.421735:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807636c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:2394:x1875420955834624:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 38us (1053us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541104.421743:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 377 00000100:00100000:0.0:1788541104.447292:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541104.447348:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541104.447389:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541104.447949:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955835008 00000100:00100000:2.0:1788541104.447964:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955835008 00000100:00100000:2.0:1788541104.448047:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 27 00000100:00100000:2.0:1788541104.448057:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706831f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:384f52e3-0481-4979-9299-157aff7472d2+5:2393:x1875420955835008:12345-192.168.202.56@tcp:9:kworker.0 00000020:00000080:2.0:1788541104.448096:0:8430:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a78c4 00000100:00080000:2.0:1788541104.448108:0:8430:0:(import.c:65:import_set_state_nolock()) ffff9a6705afd000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788541104.448182:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:2.0:1788541104.448432:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706831f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:384f52e3-0481-4979-9299-157aff7472d2+2:2393:x1875420955835008:12345-192.168.202.56@tcp:9:kworker.0 Request processed in 375us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541104.448442:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 27 00010000:00010000:2.0:1788541104.448469:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788541104.449396:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788541104.450004:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955835136 00000100:00100000:1.0:1788541104.450018:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955835136 00000100:00100000:1.0:1788541104.450100:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955835264 00000100:00100000:1.0:1788541104.450103:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955835264 00000100:00100000:1.0:1788541104.450136:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 265 00000100:00100000:1.0:1788541104.450148:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2395:x1875420955835136:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1788541104.450242:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2395:x1875420955835136:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 96us (2899us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541104.450252:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 265 00000100:00100000:1.0:1788541104.450273:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 266 00000100:00100000:1.0:1788541104.450279:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2395:x1875420955835264:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1788541104.450302:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2395:x1875420955835264:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 24us (2915us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541104.450331:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 266 00000100:00080000:0.0:1788541104.450749:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788541104.450754:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788541104.715647:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541105.610324:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788541105.610357:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6811426680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981094144:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788541105.610472:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541105.611191:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981094144 00000100:00100000:0.0:1788541105.611201:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981094144 00000100:00100000:0.0:1788541105.611268:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788541105.611280:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6811424e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981094144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788541105.611338:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788541105.611412:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6811424e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981094144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 135us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541105.611420:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:0.0:1788541105.611444:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788541105.612458:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788541105.612504:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981094272:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788541105.612594:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541105.614037:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788541105.614067:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707820380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981094400:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788541105.615292:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981094272 00000100:00100000:0.0:1788541105.615309:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981094272 00000100:00100000:0.0:1788541105.615394:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788541105.615406:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67076f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981094272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788541105.615455:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788541105.615570:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67076f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981094272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 166us (2975us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541105.615588:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788541105.615710:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981094272:0@lo:41:osp-pre-1-0.0 00010000:00080000:1.0:1788541105.616495:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6811426680 x1875420981094144/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541121 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541105.616516:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6811426680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981094144:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788541105.616801:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541105.617202:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981094400 00000100:00100000:0.0:1788541105.617211:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981094400 00000100:00100000:0.0:1788541105.617282:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788541105.617291:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981094400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788541105.617314:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788541105.617388:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981094400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (1304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541105.617394:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:2.0:1788541105.617824:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788541105.618261:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707820380 x1875420981094400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541121 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541105.618287:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707820380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981094400:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788541105.740296:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541106.634794:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67076f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981094528:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788541106.634964:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541106.635160:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981094528 00000100:00100000:0.0:1788541106.635172:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981094528 00000100:00100000:0.0:1788541106.635244:0:10866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788541106.635257:0:10866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981094528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788541106.635306:0:10866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788541106.635375:0:10866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981094528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541106.635395:0:10866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788541106.636027:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67076f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981094528:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788541106.762152:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541107.658423:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6811426680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981094912:0@lo:400:kworker.0 00000100:00100000:1.0:1788541107.658548:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541107.658632:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875420981095424:0@lo:400:kworker.0 00000100:00100000:1.0:1788541107.658662:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541107.658691:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875420981095936:0@lo:400:kworker.0 00000100:00100000:1.0:1788541107.658718:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541107.658747:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788541107.658754:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67076f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875420981094784:0@lo:400:kworker.0 00000100:00100000:1.0:1788541107.658778:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541107.658798:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875420981095296:0@lo:400:kworker.0 00000100:00100000:1.0:1788541107.658820:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541107.658981:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875420981095808:0@lo:400:kworker.0 00000100:00100000:3.0:1788541107.658987:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67076f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420981094656:0@lo:400:kworker.0 00000100:00100000:1.0:1788541107.659009:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541107.659028:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541107.659053:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981095168:0@lo:400:kworker.0 00000100:00100000:1.0:1788541107.659053:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981094912 00000100:00100000:1.0:1788541107.659062:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981094912 00000100:00100000:3.0:1788541107.659077:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541107.659096:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981095680:0@lo:400:kworker.0 00000100:00100000:3.0:1788541107.659120:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541107.659135:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981096192:0@lo:400:kworker.0 00000100:00100000:1.0:1788541107.659135:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981095168 00000100:00100000:1.0:1788541107.659139:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981095168 00000100:00100000:3.0:1788541107.659157:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541107.659158:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788541107.659167:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981094912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541107.659177:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788541107.659181:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875420981095040:0@lo:400:kworker.0 00000100:00100000:3.0:1788541107.659202:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541107.659212:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981095552:0@lo:400:kworker.0 00000100:00100000:1.0:1788541107.659231:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981094912:12345-0@lo:400:kworker.0 Request processed in 63us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541107.659233:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541107.659238:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788541107.659247:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981096064:0@lo:400:kworker.0 00000100:00100000:1.0:1788541107.659258:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788541107.659265:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541107.659265:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981095168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541107.659296:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981095168:12345-0@lo:400:kworker.0 Request processed in 31us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541107.659298:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981095424 00000100:00100000:3.0:1788541107.659302:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981095424 00000100:00100000:1.0:1788541107.659303:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788541107.659320:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981095936 00000100:00100000:1.0:1788541107.659323:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981095936 00000100:00100000:3.0:1788541107.659341:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981095296 00000100:00100000:1.0:1788541107.659341:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981094784 00000100:00100000:3.0:1788541107.659344:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981095296 00000100:00100000:1.0:1788541107.659344:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981094784 00000100:00100000:1.0:1788541107.659354:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981095808 00000100:00100000:3.0:1788541107.659357:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981095040 00000100:00100000:1.0:1788541107.659357:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981095808 00000100:00100000:3.0:1788541107.659359:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981095040 00000100:00100000:1.0:1788541107.659370:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788541107.659376:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707819880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875420981095936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541107.660170:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707819880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875420981095936:12345-0@lo:400:kworker.0 Request processed in 792us (1448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541107.660320:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981095680 00000100:00100000:2.0:1788541107.660327:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981095680 00000100:00100000:2.0:1788541107.660367:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981096192 00000100:00100000:2.0:1788541107.660370:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981096192 00000100:00100000:2.0:1788541107.660384:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981095552 00000100:00100000:2.0:1788541107.660399:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981095552 00000100:00100000:2.0:1788541107.660417:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981096064 00000100:00100000:2.0:1788541107.660420:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981096064 00000100:00100000:2.0:1788541107.660434:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788541107.660442:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981095680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541107.660482:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981095680:12345-0@lo:400:kworker.0 Request processed in 42us (1361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541107.660489:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788541107.660504:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788541107.660757:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981096192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541107.660797:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981096192:12345-0@lo:400:kworker.0 Request processed in 286us (1639us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541107.660803:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788541107.660815:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788541107.660822:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981095552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541107.660863:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981095552:12345-0@lo:400:kworker.0 Request processed in 41us (1628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541107.660899:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788541107.660921:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788541107.660928:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981096064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541107.660960:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981096064:12345-0@lo:400:kworker.0 Request processed in 33us (1694us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541107.660966:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788541107.661028:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981094656 00000100:00100000:2.0:1788541107.661033:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981094656 00000100:00100000:2.0:1788541107.661069:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1788541107.661077:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807634450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+24:3642:x1875420981094656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541107.661122:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807634450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+24:3642:x1875420981094656:12345-0@lo:400:kworker.0 Request processed in 46us (2093us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541107.661128:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1788541107.664742:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788541107.664793:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875420981095424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541107.665050:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875420981095424:12345-0@lo:400:kworker.0 Request processed in 285us (6385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541107.665060:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788541107.665108:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788541107.665118:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707818000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875420981094784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541107.665156:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707818000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875420981094784:12345-0@lo:400:kworker.0 Request processed in 40us (6377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541107.665162:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788541107.665178:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788541107.665185:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707819500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875420981095296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541107.665217:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707819500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875420981095296:12345-0@lo:400:kworker.0 Request processed in 33us (6397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541107.665224:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788541107.665237:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788541107.666622:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670781ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875420981095808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541107.666719:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788541107.666733:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670781ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875420981095808:12345-0@lo:400:kworker.0 Request processed in 1486us (7719us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541107.666745:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1788541107.666756:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875420981095040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541107.666899:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875420981095040:12345-0@lo:400:kworker.0 Request processed in 164us (7694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541107.666908:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00080000:3.0:1788541107.666996:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788541107.667006:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67076f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875420981094784:0@lo:400:kworker.0 00000100:00080000:3.0:1788541107.667007:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788541107.667014:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788541107.667019:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788541107.667035:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875420981095296:0@lo:400:kworker.0 00000100:00100000:3.0:1788541107.667050:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707820e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981096320:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788541107.667055:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875420981095808:0@lo:400:kworker.0 00000100:00100000:0.0:1788541107.667074:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6811426680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981094912:0@lo:400:kworker.0 00010000:00080000:0.0:1788541107.667094:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67080a5880 x1875420981095424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541107.667107:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875420981095424:0@lo:400:kworker.0 00000100:00100000:3.0:1788541107.667125:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788541107.667131:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67079e0000 x1875420981095936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541107.667143:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875420981095936:0@lo:400:kworker.0 00000100:00100000:3.0:1788541107.667238:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875420981095040:0@lo:400:kworker.0 00010000:00080000:3.0:1788541107.667288:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67080a6d80 x1875420981095552/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541107.667302:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981095552:0@lo:400:kworker.0 00000100:00100000:3.0:1788541107.667324:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981096064:0@lo:400:kworker.0 00000100:00100000:0.0:1788541107.667333:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981096448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788541107.667340:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67076f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420981094656:0@lo:400:kworker.0 00000100:00100000:0.0:1788541107.667383:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541107.667431:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981096320 00000100:00100000:0.0:1788541107.667438:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981096320 00000100:00100000:0.0:1788541107.667471:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981096448 00000100:00100000:0.0:1788541107.667474:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981096448 00000100:00100000:0.0:1788541107.667521:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788541107.667527:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981096320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788541107.667551:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788541107.667596:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981096320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541107.667603:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788541107.667617:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788541107.667623:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706833b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981096448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788541107.667633:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788541107.667661:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706833b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981096448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541107.667667:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788541107.667700:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981096448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788541107.668139:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981095168:0@lo:400:kworker.0 00010000:00080000:3.0:1788541107.668165:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67080a6300 x1875420981095680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541107.668177:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981095680:0@lo:400:kworker.0 00000100:00100000:3.0:1788541107.668191:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981096192:0@lo:400:kworker.0 00000100:00100000:3.0:1788541107.668284:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707820e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981096320:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788541107.669010:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00010000:00010000:2.0:1788541107.786086:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541108.810332:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788541109.269125:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788541109.270793:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788541109.553077:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541109.553114:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955835520 00000100:00100000:0.0:1788541109.553125:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955835520 00000100:00100000:0.0:1788541109.553192:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 273 00000100:00100000:0.0:1788541109.553203:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+5:2397:x1875420955835520:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541109.553279:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+5:2397:x1875420955835520:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 78us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541109.553288:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 273 00000100:00080000:0.0:1788541109.553310:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788541109.553338:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541109.553466:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541109.553485:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541109.553525:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541109.553556:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955835776 00000100:00100000:0.0:1788541109.553560:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955835776 00000100:00100000:0.0:1788541109.553585:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955835648 00000100:00100000:0.0:1788541109.553588:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955835648 00000100:00100000:0.0:1788541109.553729:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955835904 00000100:00100000:0.0:1788541109.553732:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955835904 00000100:00100000:0.0:1788541109.553748:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 274 00000100:00100000:0.0:1788541109.553754:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2397:x1875420955835776:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541109.553788:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2397:x1875420955835776:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 34us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541109.553794:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 274 00000100:00100000:0.0:1788541109.553806:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 275 00000100:00100000:0.0:1788541109.553811:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+5:2397:x1875420955835648:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541109.553835:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+5:2397:x1875420955835648:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 23us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541109.553842:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 275 00000100:00100000:0.0:1788541109.553852:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 276 00000100:00100000:0.0:1788541109.553858:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2397:x1875420955835904:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541109.553918:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2397:x1875420955835904:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 59us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541109.553924:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 276 00000100:00100000:0.0:1788541109.553940:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955835392 00000100:00100000:0.0:1788541109.553944:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955835392 00000100:00100000:0.0:1788541109.553968:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 379 00000100:00100000:0.0:1788541109.553974:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807634050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:2397:x1875420955835392:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541109.554006:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807634050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:2397:x1875420955835392:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 33us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541109.554013:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 379 00000100:00080000:0.0:1788541109.554040:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788541109.554043:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788541109.835308:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788541110.253751:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 384f52e3-0481-4979-9299-157aff7472d2 00000020:00000080:1.0:1788541110.253766:0:9510:0:(genops.c:885:class_export_put()) final put ffff9a6705afc000/384f52e3-0481-4979-9299-157aff7472d2 00000020:00000080:2.0:1788541110.253854:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6705afc000/384f52e3-0481-4979-9299-157aff7472d2 for lustre-OST0001 00000020:00000080:2.0:1788541110.253967:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a6705afd000 for lustre-OST0001 00000100:00100000:3.0:1788541110.730404:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981096704:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788541110.731849:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788541110.731904:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981096832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788541110.732298:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981096576:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788541110.732386:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541110.732509:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981096576 00000100:00100000:1.0:1788541110.732519:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981096576 00000100:00100000:1.0:1788541110.732596:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788541110.732609:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670781a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981096576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788541110.732658:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788541110.732718:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670781a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981096576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541110.732726:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788541110.732788:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981096576:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788541110.734691:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541110.734831:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981096832 00000100:00100000:0.0:1788541110.734841:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981096832 00000100:00080000:1.0:1788541110.734917:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788541110.734933:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788541110.734960:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981096832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788541110.734996:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788541110.735056:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981096832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541110.735063:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00010000:00080000:1.0:1788541110.735144:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67079e2300 x1875420981096832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541126 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541110.735168:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981096832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788541110.735382:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541110.735526:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981096704 00000100:00100000:0.0:1788541110.735542:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981096704 00000100:00100000:0.0:1788541110.735701:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788541110.735710:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981096704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788541110.735732:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788541110.735773:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981096704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541110.735779:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00010000:00080000:3.0:1788541110.735851:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68355b5500 x1875420981096704/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541126 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541110.735868:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981096704:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788541110.736072:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788541110.862128:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541111.756725:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981096960:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788541111.756823:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541111.757899:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981096960 00000100:00100000:1.0:1788541111.757910:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981096960 00000100:00100000:1.0:1788541111.757964:0:10866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788541111.757974:0:10866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981096960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788541111.758011:0:10866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788541111.758083:0:10866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981096960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (1260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541111.758090:0:10866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788541111.760685:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981096960:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788541111.883928:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541112.778036:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788541112.778060:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981097088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788541112.778188:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541112.778247:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981097088 00000100:00100000:0.0:1788541112.778256:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981097088 00000100:00100000:0.0:1788541112.778327:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788541112.778337:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981097088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788541112.778367:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788541112.778680:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981097088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541112.778687:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:0.0:1788541112.778711:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788541112.778751:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981097088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788541112.779116:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788541112.779128:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981097216:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788541112.779164:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541112.779301:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981097216 00000100:00100000:0.0:1788541112.779306:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981097216 00000100:00100000:0.0:1788541112.779339:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788541112.779346:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981097216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788541112.779359:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788541112.779391:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981097216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541112.779398:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788541112.779447:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981097216:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788541112.779724:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875420981097472:0@lo:400:kworker.0 00000100:00100000:3.0:1788541112.779755:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541112.779773:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708080700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875420981097984:0@lo:400:kworker.0 00000100:00100000:3.0:1788541112.779794:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541112.779815:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708030380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875420981098496:0@lo:400:kworker.0 00000100:00100000:3.0:1788541112.779835:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541112.779855:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788541112.779861:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:425687b6-1d99-41d2-88d8-2fb230997596:3644:1875420981097344:0@lo:400:kworker.0 00000100:00100000:3.0:1788541112.779915:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541112.779936:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981097856:0@lo:400:kworker.0 00000100:00100000:3.0:1788541112.779988:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541112.780005:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981098368:0@lo:400:kworker.0 00000100:00100000:3.0:1788541112.780267:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541112.780303:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981098368 00000100:00100000:3.0:1788541112.780308:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981098368 00000100:00100000:3.0:1788541112.780353:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788541112.780361:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981098368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541112.780404:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981098368:12345-0@lo:400:kworker.0 Request processed in 43us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541112.780588:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981097472 00000100:00100000:0.0:1788541112.780593:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981097472 00000100:00100000:0.0:1788541112.780628:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981097984 00000100:00100000:0.0:1788541112.780631:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981097984 00000100:00100000:0.0:1788541112.780648:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981098496 00000100:00100000:0.0:1788541112.780650:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981098496 00000100:00100000:0.0:1788541112.780662:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788541112.780676:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6837969f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875420981097472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541112.780709:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6837969f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875420981097472:12345-0@lo:400:kworker.0 Request processed in 35us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541112.780715:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788541112.780727:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1788541112.780733:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875420981097984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541112.780756:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875420981097984:12345-0@lo:400:kworker.0 Request processed in 23us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541112.780761:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1788541112.780771:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788541112.780776:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875420981098496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541112.780799:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875420981098496:12345-0@lo:400:kworker.0 Request processed in 24us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541112.780805:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788541112.780827:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981097344 00000100:00100000:0.0:1788541112.780831:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981097344 00000100:00100000:0.0:1788541112.780853:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1788541112.780860:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807635c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+24:3644:x1875420981097344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541112.780905:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807635c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+24:3644:x1875420981097344:12345-0@lo:400:kworker.0 Request processed in 46us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541112.780911:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1788541112.780942:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981097856 00000100:00100000:0.0:1788541112.780945:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981097856 00000100:00100000:0.0:1788541112.780970:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788541112.780978:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981097856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541112.781010:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981097856:12345-0@lo:400:kworker.0 Request processed in 33us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541112.781179:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:3.0:1788541112.781202:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788541112.781207:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788541112.781216:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788541112.781245:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:425687b6-1d99-41d2-88d8-2fb230997596:3644:1875420981097344:0@lo:400:kworker.0 00000100:00100000:3.0:1788541112.781258:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708081f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981097856:0@lo:400:kworker.0 00010000:00080000:3.0:1788541112.781270:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6705aa4380 x1875420981098368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541112.781281:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981098368:0@lo:400:kworker.0 00000100:00100000:3.0:1788541112.781292:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875420981097472:0@lo:400:kworker.0 00000100:00100000:3.0:1788541112.781300:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708080700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875420981097984:0@lo:400:kworker.0 00000100:00100000:3.0:1788541112.781310:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708030380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875420981098496:0@lo:400:kworker.0 00000100:00100000:0.0:1788541112.782123:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788541112.782171:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981097600:0@lo:400:kworker.0 00000100:00100000:0.0:1788541112.782240:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541112.782266:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708081500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875420981098112:0@lo:400:kworker.0 00000100:00100000:0.0:1788541112.782291:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541112.782310:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683796a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875420981098624:0@lo:400:kworker.0 00000100:00100000:0.0:1788541112.782331:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541112.782350:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788541112.782356:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875420981097728:0@lo:400:kworker.0 00000100:00100000:0.0:1788541112.782376:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541112.782391:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981098240:0@lo:400:kworker.0 00000100:00100000:3.0:1788541112.782585:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981097600 00000100:00100000:3.0:1788541112.782592:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981097600 00000100:00100000:3.0:1788541112.782707:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788541112.782715:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981097600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541112.782761:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981097600:12345-0@lo:400:kworker.0 Request processed in 48us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541112.782767:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788541112.784261:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541112.784330:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981097600:0@lo:400:kworker.0 00000100:00100000:0.0:1788541112.784368:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981098240 00000100:00100000:0.0:1788541112.784375:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981098240 00000100:00100000:0.0:1788541112.784679:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788541112.784690:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981098240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541112.784761:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981098240:12345-0@lo:400:kworker.0 Request processed in 73us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541112.784767:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788541112.784794:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981098112 00000100:00100000:0.0:1788541112.784797:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981098112 00000100:00100000:0.0:1788541112.784825:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981098624 00000100:00100000:0.0:1788541112.784828:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981098624 00000100:00100000:0.0:1788541112.784847:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981097728 00000100:00100000:0.0:1788541112.784864:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981097728 00000100:00100000:0.0:1788541112.784910:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1788541112.784916:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6811426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875420981098112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541112.784952:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6811426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875420981098112:12345-0@lo:400:kworker.0 Request processed in 35us (2660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541112.784958:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1788541112.784971:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788541112.784978:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875420981098624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541112.785004:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875420981098624:12345-0@lo:400:kworker.0 Request processed in 28us (2673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541112.785009:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788541112.785018:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788541112.785023:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875420981097728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541112.785046:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875420981097728:12345-0@lo:400:kworker.0 Request processed in 23us (2669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541112.785051:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00080000:0.0:1788541112.785075:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788541112.785079:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788541112.785110:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875420981097728:0@lo:400:kworker.0 00010000:00080000:0.0:1788541112.785124:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6705aa5180 x1875420981098240/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541112.785133:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981098240:0@lo:400:kworker.0 00010000:00080000:0.0:1788541112.785144:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6708081500 x1875420981098112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541112.785152:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708081500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875420981098112:0@lo:400:kworker.0 00010000:00080000:0.0:1788541112.785173:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a683796a680 x1875420981098624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541112.785181:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683796a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875420981098624:0@lo:400:kworker.0 00010000:00010000:0.0:1788541112.910585:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541113.932356:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788541114.248268:0:14060:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 12:58:32 (1788541112) 00000100:00100000:0.0:1788541114.659441:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541114.659489:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541114.659532:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541114.659563:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541114.659593:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541114.659622:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955836288 00000100:00100000:0.0:1788541114.659631:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955836288 00000100:00100000:3.0:1788541114.659685:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955836544 00000100:00100000:0.0:1788541114.659688:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955836160 00000100:00100000:3.0:1788541114.659690:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955836544 00000100:00100000:0.0:1788541114.659690:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955836160 00000100:00100000:0.0:1788541114.659702:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955836416 00000100:00100000:0.0:1788541114.659704:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955836416 00000100:00100000:3.0:1788541114.659714:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 283 00000100:00100000:3.0:1788541114.659724:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+5:2397:x1875420955836288:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1788541114.659803:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955836032 00000100:00100000:3.0:1788541114.659808:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+5:2397:x1875420955836288:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 85us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541114.659808:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955836032 00000100:00100000:2.0:1788541114.659846:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 381 00000100:00100000:2.0:1788541114.659854:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:2397:x1875420955836032:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1788541114.659913:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807636050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:2397:x1875420955836032:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 59us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541114.659921:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 381 00000100:00100000:0.0:1788541114.662006:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 284 00000100:00100000:0.0:1788541114.663025:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+5:2397:x1875420955836160:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541114.663231:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+5:2397:x1875420955836160:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 1212us (3666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541114.663244:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 284 00000100:00100000:0.0:1788541114.663279:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 285 00000100:00100000:0.0:1788541114.663289:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2397:x1875420955836544:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541114.663322:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2397:x1875420955836544:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 36us (3790us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541114.663329:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 285 00000100:00100000:0.0:1788541114.663343:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 286 00000100:00100000:0.0:1788541114.663368:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2397:x1875420955836416:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541114.663397:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2397:x1875420955836416:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 31us (3804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541114.663404:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 286 00000100:00080000:0.0:1788541114.663433:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788541114.663439:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788541114.672618:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 283 00010000:00010000:2.0:1788541114.954125:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541115.850106:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981098880:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788541115.850156:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788541115.850170:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683796a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981099008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788541115.850182:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541115.850249:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981098880 00000100:00100000:1.0:1788541115.850257:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981098880 00000100:00100000:1.0:1788541115.850326:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788541115.850336:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707823480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981098880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788541115.850381:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1788541115.850443:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788541115.850521:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541115.850671:0:8433:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1788541115.850680:0:8433:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:0.0:1788541115.851335:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981099008 00000100:00100000:0.0:1788541115.851342:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981099008 00000100:00080000:0.0:1788541115.851381:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788541115.851508:0:14072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788541115.851516:0:14072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67076f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981099008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788541115.851531:0:14072:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788541115.851736:0:14072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67076f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981099008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 220us (1214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541115.851744:0:14072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00010000:00080000:0.0:1788541115.851811:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a683796a680 x1875420981099008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541131 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541115.851831:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683796a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981099008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788541115.852462:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981098752:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788541115.852578:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541115.852759:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981098752 00000100:00100000:0.0:1788541115.852766:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981098752 00000100:00100000:0.0:1788541115.852850:0:10866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788541115.852859:0:10866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707821500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981098752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788541115.852921:0:10866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788541115.852967:0:10866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707821500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981098752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541115.852973:0:10866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788541115.853040:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981098752:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788541115.855311:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707823480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981098880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4968us (5120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541115.855326:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00010000:00080000:2.0:1788541115.855436:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707b7ed80 x1875420981098880/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541131 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541115.855458:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981098880:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788541115.979367:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541116.153620:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541116.153804:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955836672 00000100:00100000:2.0:1788541116.153816:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955836672 00000100:00100000:2.0:1788541116.153937:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 41 00000100:00100000:2.0:1788541116.153949:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67076f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+5:11069:x1875420955836672:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788541116.153970:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541116.154053:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a79a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3311d5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541116.154121:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a79ab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541116.154136:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a79ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541116.154149:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a79ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541116.154199:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788541116.154203:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788541116.154263:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a79ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541116.154289:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a79a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3311d5 expref: 7 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541116.154310:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a79ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3311d5 expref: 6 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541116.154319:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68350c0000) 00010000:00010000:2.0:1788541116.154336:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788541116.154340:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a683551b400, rc 0) 00000100:00100000:2.0:1788541116.154409:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67076f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+6:11069:x1875420955836672:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 462us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541116.154417:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 41 00000100:00080000:0.0:1788541116.154554:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788541116.159089:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541116.160760:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955836800 00000100:00100000:0.0:1788541116.160791:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955836800 00000100:00100000:0.0:1788541116.160867:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 42 00000100:00100000:0.0:1788541116.161036:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707820700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+6:11070:x1875420955836800:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788541116.161058:0:9339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541116.161081:0:9339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a79b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3311dc expref: -99 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541116.161150:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a79b9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541116.161165:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a79b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541116.161177:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a79b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541116.161191:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a79c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541116.161197:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a79c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541116.161203:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a79c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541116.161287:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fa00/0x2aac941e5f4a79c7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541116.161296:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fa00/0x2aac941e5f4a79c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541116.161303:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fa00/0x2aac941e5f4a79c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541116.161351:0:9339:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788541116.161354:0:9339:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788541116.161377:0:9339:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fa00/0x2aac941e5f4a79c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541116.161389:0:9339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a79b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541116.161396:0:9339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a79b9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541116.161404:0:9339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a79b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541116.161410:0:9339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75e600 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541116.161414:0:9339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a79b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541116.161422:0:9339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a79b9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541116.161436:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68350c0000) 00010000:00010000:0.0:1788541116.161439:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541116.161444:0:9339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a79b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541116.161451:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a79b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541116.161465:0:9339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a79c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541116.161482:0:9339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a79c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541116.161533:0:9339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a79c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541116.161538:0:9339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75ec00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541116.161542:0:9339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a79c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541116.161548:0:9339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a79c0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541116.161556:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9a67078a1800) 00010000:00010000:0.0:1788541116.161559:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541116.161561:0:9339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a79c0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541116.161567:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a79c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541116.161599:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a79b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3311dc expref: 8 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541116.161614:0:9339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fa00/0x2aac941e5f4a79c7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3311dc expref: 7 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541116.161622:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a67078a1d00) 00010000:00010000:0.0:1788541116.161624:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788541116.161634:0:9339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75fa00, rc 0) 00000100:00100000:0.0:1788541116.161715:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707820700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+7:11070:x1875420955836800:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 684us (2637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541116.165122:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541116.165233:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955836928 00000100:00100000:1.0:1788541116.165243:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955836928 00000100:00100000:1.0:1788541116.165298:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 7 00000100:00100000:1.0:1788541116.165315:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:384f52e3-0481-4979-9299-157aff7472d2+8:11070:x1875420955836928:12345-192.168.202.56@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788541116.165414:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:384f52e3-0481-4979-9299-157aff7472d2+8:11070:x1875420955836928:12345-192.168.202.56@tcp:900:lhsmtool_posix.0 Request processed in 107us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541116.165422:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 7 00000100:00100000:0.0:1788541116.167105:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 42 00000100:00100000:1.0:1788541116.171571:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541116.171657:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955837184 00000100:00100000:2.0:1788541116.171669:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955837184 00000100:00100000:2.0:1788541116.171726:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 43 00000100:00100000:2.0:1788541116.171737:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+7:11070:x1875420955837184:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788541116.171758:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541116.171781:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a79ce lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3311e3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541116.171901:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a79d5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541116.171918:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a79d5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541116.171930:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a79d5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541116.171983:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a79dc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541116.171991:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a79dc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541116.171998:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a79dc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541116.172284:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a200/0x2aac941e5f4a79e3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541116.172294:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a200/0x2aac941e5f4a79e3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541116.172307:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a200/0x2aac941e5f4a79e3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541116.172317:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788541116.172405:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a79d5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541116.172413:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a79d5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541116.172419:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a79d5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541116.172424:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551b200 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:2.0:1788541116.172429:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a79d5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541116.172436:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a79d5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541116.172449:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a67078a1d00) 00010000:00010000:2.0:1788541116.172452:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541116.172456:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a79d5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541116.172473:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a79d5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541116.172497:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a79dc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541116.172503:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a79dc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541116.172508:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a79dc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541116.172513:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551b800 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:2.0:1788541116.172515:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a79dc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541116.172521:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a79dc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541116.172529:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a68350c0300) 00010000:00010000:2.0:1788541116.172531:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541116.172534:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a79dc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541116.172540:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a79dc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541116.174980:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a79ce lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3311e3 expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541116.175013:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a200/0x2aac941e5f4a79e3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3311e3 expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541116.175040:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a68350c0d00) 00010000:00010000:2.0:1788541116.175044:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541116.175049:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a683551a200, rc 0) 00000100:00100000:2.0:1788541116.175139:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+9:11070:x1875420955837184:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 3403us (3577us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788541116.175148:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 43 00000100:00100000:1.0:1788541116.193848:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541116.194763:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955837312 00000100:00100000:2.0:1788541116.194777:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955837312 00000100:00100000:2.0:1788541116.195037:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 44 00000100:00100000:2.0:1788541116.195048:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+9:11070:x1875420955837312:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788541116.195219:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+9:11070:x1875420955837312:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 Request processed in 174us (1382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541116.195227:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 44 00000100:00100000:3.0:1788541116.197141:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541116.197287:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955837440 00000100:00100000:0.0:1788541116.197296:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955837440 00000100:00080000:3.0:1788541116.197917:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788541116.197999:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 45 00000100:00100000:0.0:1788541116.198012:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708030380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+5:11070:x1875420955837440:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 00000004:00080000:0.0:1788541116.199189:0:9339:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1133us 00000100:00100000:2.0:1788541116.228817:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708030380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+5:11070:x1875420955837440:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 Request processed in 30800us (31676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541116.228831:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 45 00000040:00080000:2.0:1788541116.431057:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788541116.437462:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788541116.875139:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981099136:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788541116.875214:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541116.875519:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981099136 00000100:00100000:3.0:1788541116.875528:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981099136 00000100:00100000:3.0:1788541116.875581:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788541116.875590:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683796a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981099136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788541116.875624:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788541116.875677:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683796a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981099136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541116.875684:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788541116.875796:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981099136:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788541117.004005:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541117.898964:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420981099264:0@lo:400:kworker.0 00000100:00100000:1.0:1788541117.899049:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541117.899102:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788541117.899108:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875420981099392:0@lo:400:kworker.0 00000100:00100000:1.0:1788541117.899135:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541117.899167:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981099264 00000100:00100000:1.0:1788541117.899176:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981099264 00000100:00100000:1.0:1788541117.899227:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1788541117.899235:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+24:3641:x1875420981099264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541117.899283:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+24:3641:x1875420981099264:12345-0@lo:400:kworker.0 Request processed in 48us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541117.899303:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1788541117.899385:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420981099264:0@lo:400:kworker.0 00000100:00100000:2.0:1788541117.899502:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981099392 00000100:00100000:2.0:1788541117.899507:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981099392 00000100:00100000:2.0:1788541117.899542:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1788541117.899549:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875420981099392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541117.899585:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875420981099392:12345-0@lo:400:kworker.0 Request processed in 37us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541117.899590:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1788541117.899963:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875420981099392:0@lo:400:kworker.0 00000100:00100000:3.0:1788541117.902202:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981099520:0@lo:400:kworker.0 00000100:00100000:3.0:1788541117.902275:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541117.902298:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981099648:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788541117.902442:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875420981100032:0@lo:400:kworker.0 00000100:00100000:1.0:1788541117.902454:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981099520 00000100:00100000:1.0:1788541117.902461:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981099520 00000100:00100000:3.0:1788541117.902480:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541117.902515:0:10866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788541117.902518:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788541117.902523:0:10866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981099520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541117.902530:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708080700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875420981100160:0@lo:400:kworker.0 00000100:00100000:3.0:1788541117.902553:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541117.902569:0:10866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981099520:12345-0@lo:400:kworker.0 Request processed in 47us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541117.902576:0:10866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788541117.902583:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981099520:0@lo:400:kworker.0 00000100:00100000:1.0:1788541117.902598:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875420981099776:0@lo:400:kworker.0 00000100:00100000:1.0:1788541117.902624:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541117.902633:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f0fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875420981100544:0@lo:400:kworker.0 00000100:00100000:1.0:1788541117.902643:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981100288:0@lo:400:kworker.0 00000100:00100000:3.0:1788541117.902655:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541117.902663:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541117.902679:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788541117.902684:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981099904:0@lo:400:kworker.0 00000100:00100000:3.0:1788541117.902690:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788541117.902694:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f0fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875420981100672:0@lo:400:kworker.0 00000100:00100000:1.0:1788541117.902704:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541117.902713:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541117.902720:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981100416:0@lo:400:kworker.0 00000100:00100000:1.0:1788541117.902739:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541117.902757:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707bb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981100800:0@lo:400:kworker.0 00000100:00100000:3.0:1788541117.902775:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981100032 00000100:00100000:1.0:1788541117.902776:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541117.902779:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981100032 00000100:00100000:1.0:1788541117.902794:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788541117.902799:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707bb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981100928:0@lo:400:kworker.0 00000100:00100000:3.0:1788541117.902809:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981100160 00000100:00100000:3.0:1788541117.902811:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981100160 00000100:00100000:1.0:1788541117.902818:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541117.902823:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981099776 00000100:00100000:3.0:1788541117.902826:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981099776 00000100:00100000:3.0:1788541117.902837:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981100544 00000100:00100000:3.0:1788541117.902840:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981100544 00000100:00100000:1.0:1788541117.902841:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981099904 00000100:00100000:1.0:1788541117.902844:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981099904 00000100:00100000:1.0:1788541117.902889:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788541117.902895:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670687b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981099904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541117.902931:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670687b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981099904:12345-0@lo:400:kworker.0 Request processed in 36us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541117.902937:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788541117.902953:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981100672 00000100:00100000:1.0:1788541117.902957:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981100672 00000100:00100000:1.0:1788541117.902975:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788541117.902981:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875420981100032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541117.903128:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875420981100032:12345-0@lo:400:kworker.0 Request processed in 146us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541117.903137:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788541117.903151:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788541117.903157:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875420981100160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541117.903196:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541117.903229:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981099648 00000100:00100000:0.0:1788541117.903233:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981099648 00000100:00100000:0.0:1788541117.903261:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788541117.903267:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981099648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788541117.903295:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788541117.903451:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1788541117.903458:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706879f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875420981099776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541117.903465:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981099648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 198us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541117.903482:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788541117.903500:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706879f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875420981099776:12345-0@lo:400:kworker.0 Request processed in 43us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541117.903506:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1788541117.903516:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1788541117.903522:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f0fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875420981100672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541117.903543:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875420981100160:12345-0@lo:400:kworker.0 Request processed in 386us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541117.903545:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f0fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875420981100672:12345-0@lo:400:kworker.0 Request processed in 24us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541117.903549:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1788541117.908407:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1788541117.908458:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1788541117.908502:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f0fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875420981100544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541117.908593:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f0fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875420981100544:12345-0@lo:400:kworker.0 Request processed in 99us (5937us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541117.908600:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00080000:3.0:1788541117.908627:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788541117.908634:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788541117.908636:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788541117.912169:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981099648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788541117.912223:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788541117.912263:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707822a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981101056:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788541117.912363:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541117.913342:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981101056 00000100:00100000:3.0:1788541117.913353:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981101056 00000100:00100000:3.0:1788541117.913439:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788541117.913450:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981101056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788541117.913483:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788541117.913553:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981101056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (1191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541117.913560:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:3.0:1788541117.913581:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788541117.913754:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707822a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981101056:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788541117.915360:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981100288 00000100:00100000:1.0:1788541117.915372:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981100288 00000100:00100000:1.0:1788541117.915431:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981100416 00000100:00100000:1.0:1788541117.915434:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981100416 00000100:00100000:1.0:1788541117.915449:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981100800 00000100:00100000:1.0:1788541117.915451:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981100800 00000100:00100000:1.0:1788541117.915459:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981100928 00000100:00100000:1.0:1788541117.915462:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981100928 00000100:00100000:1.0:1788541117.915486:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788541117.915494:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706879880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981100288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541117.915574:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706879880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981100288:12345-0@lo:400:kworker.0 Request processed in 80us (12909us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541117.915592:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788541117.915608:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788541117.915614:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670687b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981100416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541117.915643:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670687b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981100416:12345-0@lo:400:kworker.0 Request processed in 29us (12904us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541117.915650:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788541117.915659:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788541117.915665:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708051880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981100800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541117.915690:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708051880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981100800:12345-0@lo:400:kworker.0 Request processed in 25us (12912us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541117.915695:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788541117.915705:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788541117.915711:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708053800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981100928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541117.915734:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708053800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981100928:12345-0@lo:400:kworker.0 Request processed in 23us (12915us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541117.915739:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788541117.915798:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707bb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981100928:0@lo:400:kworker.0 00000100:00100000:1.0:1788541117.915811:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707bb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981100800:0@lo:400:kworker.0 00000100:00100000:1.0:1788541117.915823:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981099904:0@lo:400:kworker.0 00010000:00080000:1.0:1788541117.915836:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68355b4700 x1875420981100416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541117.915846:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981100416:0@lo:400:kworker.0 00010000:00080000:1.0:1788541117.915856:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68045e1180 x1875420981100288/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541117.915892:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981100288:0@lo:400:kworker.0 00000100:00100000:1.0:1788541117.915907:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875420981099776:0@lo:400:kworker.0 00010000:00080000:1.0:1788541117.915957:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a683f0fce00 x1875420981100672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541117.915967:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f0fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875420981100672:0@lo:400:kworker.0 00000100:00100000:1.0:1788541117.915979:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f0fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875420981100544:0@lo:400:kworker.0 00010000:00080000:1.0:1788541117.915990:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6708080700 x1875420981100160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541117.915998:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708080700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875420981100160:0@lo:400:kworker.0 00000100:00100000:1.0:1788541117.916010:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875420981100032:0@lo:400:kworker.0 00000100:00080000:3.0:1788541117.916155:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788541118.026005:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541118.254702:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541118.255004:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955837568 00000100:00100000:3.0:1788541118.255071:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955837568 00000100:00100000:3.0:1788541118.255152:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 46 00000100:00100000:3.0:1788541118.255163:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708052d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+9:11113:x1875420955837568:12345-192.168.202.56@tcp:101:lfs.0 00000100:00080000:1.0:1788541118.255169:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788541118.255187:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541118.255210:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad200/0x2aac941e5f4a79f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3311ea expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.255293:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a79f8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.255537:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a79f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.255553:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a79f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.255568:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075acc00/0x2aac941e5f4a79ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.255576:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075acc00/0x2aac941e5f4a79ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.255583:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075acc00/0x2aac941e5f4a79ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.255636:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a79f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.255644:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a79f8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.255652:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a79f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.255658:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075adc00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541118.255662:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a79f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.255670:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a79f8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.255683:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68350c0000) 00010000:00010000:3.0:1788541118.255691:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541118.255697:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a79f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.255705:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a79f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.255716:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075acc00/0x2aac941e5f4a79ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.255722:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075acc00/0x2aac941e5f4a79ff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.255728:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075acc00/0x2aac941e5f4a79ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.255733:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075acc00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541118.255735:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075acc00/0x2aac941e5f4a79ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.255741:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075acc00/0x2aac941e5f4a79ff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.255748:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9a6706b4e200) 00010000:00010000:3.0:1788541118.255750:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541118.255752:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075acc00/0x2aac941e5f4a79ff lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.255757:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075acc00/0x2aac941e5f4a79ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.255791:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad200/0x2aac941e5f4a79f1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3311ea expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.255813:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68350c0000) 00010000:00010000:3.0:1788541118.255816:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541118.255820:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad200/0x2aac941e5f4a79f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3311ea expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.255830:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075ad200, rc 0) 00000100:00100000:3.0:1788541118.255941:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708052d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+9:11113:x1875420955837568:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 779us (1246us total) trans 0 rc 301/301 00000100:00100000:3.0:1788541118.255949:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 46 00000100:00100000:3.0:1788541118.259697:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541118.259917:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955837824 00000100:00100000:2.0:1788541118.259928:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955837824 00000100:00100000:2.0:1788541118.259981:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 47 00000100:00100000:2.0:1788541118.260001:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+9:11113:x1875420955837824:12345-192.168.202.56@tcp:36:lfs.0 00010000:00010000:2.0:1788541118.260064:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541118.260100:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a79ab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3311d5 expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541118.260118:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68350c0000) 00010000:00010000:2.0:1788541118.260145:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788541118.260218:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a7a06 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541118.260234:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a7a06 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541118.260243:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a7a06 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541118.260253:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a7a0d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541118.260259:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a7a0d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541118.260265:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a7a0d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541118.260739:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a7a14 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541118.260759:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a7a14 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541118.260766:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a7a14 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788541118.260781:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fb697316 reply state 00000000e5a178d9 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a7a14 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541118.260791:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a7a14 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541118.260797:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68350c4300) 00010000:00010000:2.0:1788541118.260799:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788541118.260802:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788541118.260806:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788541118.260811:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a7a06 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541118.260817:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a7a06 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541118.260823:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a7a06 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541118.260828:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551aa00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:2.0:1788541118.260832:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a7a06 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541118.260839:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a7a06 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541118.260854:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68350c4100) 00010000:00010000:2.0:1788541118.260856:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541118.260859:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a7a06 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541118.260865:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a7a06 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788541118.260933:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fb697316 reply state 00000000e5a178d9 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a7a0d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541118.260940:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a7a0d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541118.260946:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9a68350c4000) 00010000:00010000:2.0:1788541118.260948:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788541118.260950:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788541118.261099:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+10:11113:x1875420955837824:12345-192.168.202.56@tcp:36:lfs.0 Request processed in 1097us (1410us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788541118.261108:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 47 00000100:00100000:0.0:1788541118.343599:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541118.343663:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955837952 00000100:00100000:1.0:1788541118.343673:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955837952 00000100:00100000:1.0:1788541118.343729:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 48 00000100:00100000:1.0:1788541118.343737:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+10:11121:x1875420955837952:12345-192.168.202.56@tcp:101:lctl.0 00010000:00010000:1.0:1788541118.343762:0:9339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541118.343785:0:9339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da200/0x2aac941e5f4a7a1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3311f1 expref: -99 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541118.343845:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dac00/0x2aac941e5f4a7a22 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541118.343903:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dac00/0x2aac941e5f4a7a22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541118.343912:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dac00/0x2aac941e5f4a7a22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788541118.343955:0:9339:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788541118.343958:0:9339:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788541118.343988:0:9339:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dac00/0x2aac941e5f4a7a22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541118.344005:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da200/0x2aac941e5f4a7a1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3311f1 expref: 12 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541118.344026:0:9339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dac00/0x2aac941e5f4a7a22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3311f1 expref: 11 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541118.344032:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6809c1c700) 00010000:00010000:1.0:1788541118.344034:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788541118.344037:0:9339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68354dac00, rc 0) 00000100:00100000:1.0:1788541118.344090:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+11:11121:x1875420955837952:12345-192.168.202.56@tcp:101:lctl.0 Request processed in 354us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541118.344094:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 48 00000100:00100000:2.0:1788541118.396192:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541118.396307:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955838080 00000100:00100000:3.0:1788541118.396317:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955838080 00000100:00100000:3.0:1788541118.396384:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 49 00000100:00100000:3.0:1788541118.396394:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707820000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+11:11127:x1875420955838080:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:3.0:1788541118.396417:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541118.396437:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad200/0x2aac941e5f4a7a29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3311f8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.396512:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075acc00/0x2aac941e5f4a7a30 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.396528:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075acc00/0x2aac941e5f4a7a30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.396558:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075acc00/0x2aac941e5f4a7a30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.396569:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a7a37 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.396576:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a7a37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.396582:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a7a37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.396661:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac000/0x2aac941e5f4a7a3e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.396669:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac000/0x2aac941e5f4a7a3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.396675:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac000/0x2aac941e5f4a7a3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541118.396708:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788541118.396712:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788541118.396750:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac000/0x2aac941e5f4a7a3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.396763:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075acc00/0x2aac941e5f4a7a30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.396770:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075acc00/0x2aac941e5f4a7a30 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.396787:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075acc00/0x2aac941e5f4a7a30 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.396794:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075acc00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541118.396798:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075acc00/0x2aac941e5f4a7a30 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.396806:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075acc00/0x2aac941e5f4a7a30 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.396819:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6809c1c700) 00010000:00010000:3.0:1788541118.396822:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541118.396827:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075acc00/0x2aac941e5f4a7a30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.396833:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075acc00/0x2aac941e5f4a7a30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.396846:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a7a37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.396852:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a7a37 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.396858:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a7a37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.396863:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075adc00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541118.396866:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a7a37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.397043:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a7a37 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.397052:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9a68350c4000) 00010000:00010000:3.0:1788541118.397054:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541118.397058:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a7a37 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.397064:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a7a37 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.397093:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad200/0x2aac941e5f4a7a29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3311f8 expref: 13 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.397105:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac000/0x2aac941e5f4a7a3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3311f8 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.397112:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68350c4300) 00010000:00010000:3.0:1788541118.397114:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788541118.397116:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075ac000, rc 0) 00000100:00100000:2.0:1788541118.397284:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707820000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+12:11127:x1875420955838080:12345-192.168.202.56@tcp:101:bash.0 Request processed in 890us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541118.397293:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 49 00000100:00100000:2.0:1788541118.402323:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541118.402413:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955838336 00000100:00100000:1.0:1788541118.402424:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955838336 00000100:00100000:1.0:1788541118.402496:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 50 00000100:00100000:1.0:1788541118.402508:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707821880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+12:11127:x1875420955838336:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:1.0:1788541118.402530:0:12149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541118.402570:0:12149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da200/0x2aac941e5f4a7a45 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3311ff expref: -99 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541118.402679:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354daa00/0x2aac941e5f4a7a4c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541118.402696:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354daa00/0x2aac941e5f4a7a4c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541118.402708:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354daa00/0x2aac941e5f4a7a4c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541118.402755:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a7a53 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541118.402764:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a7a53 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541118.402770:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a7a53 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788541118.403132:0:12149:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:1.0:1788541118.403266:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7a5a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541118.403277:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7a5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541118.403286:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7a5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541118.403320:0:12149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354daa00/0x2aac941e5f4a7a4c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541118.403341:0:12149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354daa00/0x2aac941e5f4a7a4c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541118.403348:0:12149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354daa00/0x2aac941e5f4a7a4c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541118.403354:0:12149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68354daa00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541118.403359:0:12149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354daa00/0x2aac941e5f4a7a4c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541118.403367:0:12149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354daa00/0x2aac941e5f4a7a4c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541118.403381:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68350c4300) 00010000:00010000:1.0:1788541118.403385:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541118.403390:0:12149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354daa00/0x2aac941e5f4a7a4c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541118.403397:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354daa00/0x2aac941e5f4a7a4c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788541118.403411:0:12149:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000067eb2de reply state 00000000ff0779a6 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a7a53 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541118.403423:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a7a53 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541118.403430:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a6809c1cf00) 00010000:00010000:1.0:1788541118.403432:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788541118.403435:0:12149:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788541118.403476:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da200/0x2aac941e5f4a7a45 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3311ff expref: 15 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541118.403499:0:12149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7a5a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3311ff expref: 14 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541118.403508:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a6809c1c800) 00010000:00010000:1.0:1788541118.403510:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788541118.403513:0:12149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68354db800, rc 0) 00000100:00100000:1.0:1788541118.403586:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707821880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+15:11127:x1875420955838336:12345-192.168.202.56@tcp:101:bash.0 Request processed in 1081us (1276us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1788541118.403595:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 50 00000100:00100000:0.0:1788541118.422295:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541118.422373:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955838464 00000100:00100000:1.0:1788541118.422383:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955838464 00000100:00100000:1.0:1788541118.422431:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 28 00000100:00100000:1.0:1788541118.422441:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2393:x1875420955838464:12345-192.168.202.56@tcp:8:bash.0 00010000:00080000:1.0:1788541118.422488:0:8430:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 384f52e3-0481-4979-9299-157aff7472d2@192.168.202.56@tcp t0 exp 0000000000000000 cur 399 last 0 00000020:00000080:1.0:1788541118.422521:0:8430:0:(genops.c:1385:class_connect()) connect: client 384f52e3-0481-4979-9299-157aff7472d2, cookie 0x2aac941e5f4a7a68 00002000:00100000:1.0:1788541118.422532:0:8430:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 384f52e3-0481-4979-9299-157aff7472d2/ffff9a683f196800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788541118.422549:0:8430:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788541118.422624:0:8430:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788541118.422654:0:8430:0:(import.c:65:import_set_state_nolock()) ffff9a683f195000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788541118.422729:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:384f52e3-0481-4979-9299-157aff7472d2+6:2393:x1875420955838464:12345-192.168.202.56@tcp:8:bash.0 Request processed in 288us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541118.422738:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 28 00000100:00100000:3.0:1788541118.424638:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541118.424736:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955838592 00000100:00100000:1.0:1788541118.424745:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955838592 00000100:00100000:1.0:1788541118.424837:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 29 00000100:00100000:1.0:1788541118.424847:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:384f52e3-0481-4979-9299-157aff7472d2+6:0:x1875420955838592:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:1.0:1788541118.424864:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541118.424908:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006450c9ea/0x2aac941e5f4a7a6f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331206 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788541118.424938:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788541118.424956:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=399s v=(0 0) 00010000:00010000:1.0:1788541118.424961:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541118.424970:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006450c9ea/0x2aac941e5f4a7a6f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331206 expref: 7 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541118.425028:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006450c9ea/0x2aac941e5f4a7a6f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331206 expref: 7 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541118.425042:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68354da200, rc 0) 00000100:00100000:1.0:1788541118.425113:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:384f52e3-0481-4979-9299-157aff7472d2+7:0:x1875420955838592:12345-192.168.202.56@tcp:101:bash.0 Request processed in 267us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541118.425120:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 29 00000100:00080000:3.0:1788541118.425187:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788541118.435336:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541118.436059:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955838720 00000100:00100000:1.0:1788541118.436070:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955838720 00000100:00100000:1.0:1788541118.436136:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 30 00000100:00100000:1.0:1788541118.436147:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:384f52e3-0481-4979-9299-157aff7472d2+7:11127:x1875420955838720:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:1.0:1788541118.436165:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541118.436183:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed3f975b/0x2aac941e5f4a7a76 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a33120d expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541118.436238:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006450c9ea/0x2aac941e5f4a7a6f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331206 expref: 8 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541118.436249:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541118.436253:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541118.436260:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed3f975b/0x2aac941e5f4a7a76 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33120d expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541118.436299:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006450c9ea/0x2aac941e5f4a7a6f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331206 expref: 8 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541118.436315:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006450c9ea/0x2aac941e5f4a7a6f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331206 expref: 8 pid: 8431 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541118.436332:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708050e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1875420981101184:192.168.202.56@tcp:104: 00000100:00100000:1.0:1788541118.436433:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683572b900 going to sleep for 11 seconds 00000100:00100000:1.0:1788541118.439964:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708050e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1875420981101184:192.168.202.56@tcp:104: 00010000:00010000:1.0:1788541118.440007:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ed3f975b/0x2aac941e5f4a7a76 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xa16473202a33120d expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541118.440030:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68354daa00, rc 0) 00000100:00100000:1.0:1788541118.440104:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:384f52e3-0481-4979-9299-157aff7472d2+8:11127:x1875420955838720:12345-192.168.202.56@tcp:101:bash.0 Request processed in 3958us (4776us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541118.440113:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 30 00000100:00100000:3.0:1788541118.440414:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541118.441841:0:9520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955838848 00000100:00100000:0.0:1788541118.441853:0:9520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955838848 00010000:00010000:0.0:1788541118.441911:0:9520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006450c9ea/0x2aac941e5f4a7a6f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331206 expref: 8 pid: 8431 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541118.442002:0:9520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 52 00000100:00100000:0.0:1788541118.442013:0:9520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680763f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:384f52e3-0481-4979-9299-157aff7472d2+8:2396:x1875420955838848:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788541118.442030:0:9520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541118.442068:0:9520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006450c9ea/0x2aac941e5f4a7a6f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331206 expref: 8 pid: 8431 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541118.442081:0:9520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006450c9ea/0x2aac941e5f4a7a6f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331206 expref: 8 pid: 8431 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541118.442112:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006450c9ea/0x2aac941e5f4a7a6f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331206 expref: 8 pid: 8431 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541118.442129:0:9520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541118.442133:0:9520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541118.442143:0:9520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ed3f975b/0x2aac941e5f4a7a76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xa16473202a33120d expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541118.442172:0:9520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed3f975b/0x2aac941e5f4a7a76 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xa16473202a33120d expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541118.442211:0:9520:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ed3f975b/0x2aac941e5f4a7a76 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xa16473202a33120d expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541118.442225:0:9520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a73480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9520:1875420981101312:192.168.202.56@tcp:105: 00000100:00100000:0.0:1788541118.442354:0:9520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6835493240 going to sleep for 11 seconds 00000100:00100000:2.0:1788541118.452864:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541118.453518:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955839104 00000100:00100000:1.0:1788541118.453528:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955839104 00000100:00100000:1.0:1788541118.453596:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 6 00000100:00100000:1.0:1788541118.453605:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707823b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+15:11127:x1875420955839104:12345-192.168.202.56@tcp:35:bash.0 00000100:00100000:1.0:1788541118.453897:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707823b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+16:11127:x1875420955839104:12345-192.168.202.56@tcp:35:bash.0 Request processed in 292us (1042us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788541118.453904:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 6 00000100:00100000:0.0:1788541118.455423:0:9520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a73480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9520:1875420981101312:192.168.202.56@tcp:105: 00010000:00010000:0.0:1788541118.455451:0:9520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541118.455521:0:9520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680763f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:384f52e3-0481-4979-9299-157aff7472d2+7:2396:x1875420955838848:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 13509us (15107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541118.455531:0:9520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 52 00000100:00100000:2.0:1788541118.578337:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541118.578471:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955839360 00000100:00100000:3.0:1788541118.578483:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955839360 00000100:00100000:3.0:1788541118.578544:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 51 00000100:00100000:3.0:1788541118.578554:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707822a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+16:11137:x1875420955839360:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1788541118.578600:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541118.578621:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a7a7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331214 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541118.578726:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788541118.578830:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a7a7d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331214 expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.578844:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6809c1c700) 00010000:00010000:3.0:1788541118.578847:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788541118.578852:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a7a7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331214 expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.578866:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075ad400, rc 0) 00000100:00100000:3.0:1788541118.579670:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707822a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+17:11137:x1875420955839360:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1113us (1350us total) trans 4294967315 rc 301/301 00000100:00100000:3.0:1788541118.579680:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 51 00000100:00100000:2.0:1788541118.583586:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541118.587569:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955839616 00000100:00100000:1.0:1788541118.587584:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955839616 00000100:00100000:1.0:1788541118.587729:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 7 00000100:00100000:1.0:1788541118.587741:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707820e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+17:11137:x1875420955839616:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:1.0:1788541118.588030:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707820e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+18:11137:x1875420955839616:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 290us (4451us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788541118.588038:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 7 00000100:00100000:2.0:1788541118.684826:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541118.684913:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955839744 00000100:00100000:3.0:1788541118.684922:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955839744 00000100:00100000:3.0:1788541118.684986:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 52 00000100:00100000:3.0:1788541118.684996:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707820380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+18:11143:x1875420955839744:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1788541118.685030:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541118.685065:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a7a8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a33121b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.685141:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad200/0x2aac941e5f4a7a92 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.685175:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad200/0x2aac941e5f4a7a92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.685187:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad200/0x2aac941e5f4a7a92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541118.685235:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788541118.685240:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788541118.685262:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad200/0x2aac941e5f4a7a92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.685291:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a7a8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33121b expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.685318:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad200/0x2aac941e5f4a7a92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33121b expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.685326:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68350c4300) 00010000:00010000:3.0:1788541118.685329:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788541118.685332:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075ad200, rc 0) 00000100:00100000:3.0:1788541118.685399:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707820380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+19:11143:x1875420955839744:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 403us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541118.685406:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 52 00000100:00100000:2.0:1788541118.690117:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541118.690652:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955840000 00000100:00100000:1.0:1788541118.690663:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955840000 00000100:00100000:1.0:1788541118.690720:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 53 00000100:00100000:1.0:1788541118.690729:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707822680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+19:11143:x1875420955840000:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1788541118.690751:0:9339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541118.690773:0:9339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a7a99 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331222 expref: -99 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541118.690984:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da800/0x2aac941e5f4a7aa0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541118.690999:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da800/0x2aac941e5f4a7aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541118.691191:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da800/0x2aac941e5f4a7aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788541118.691201:0:9339:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788541118.691603:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a7a99 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331222 expref: 22 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541118.691624:0:9339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da800/0x2aac941e5f4a7aa0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331222 expref: 21 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541118.691633:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a6809c1c800) 00010000:00010000:1.0:1788541118.691636:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788541118.691639:0:9339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68354da800, rc 0) 00000100:00100000:1.0:1788541118.691737:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707822680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+21:11143:x1875420955840000:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1009us (1629us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1788541118.691743:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 53 00000100:00100000:2.0:1788541118.696999:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541118.697258:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541118.700971:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955840384 00000100:00100000:0.0:1788541118.700989:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955840384 00000100:00100000:0.0:1788541118.701094:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 3 00000100:00100000:0.0:1788541118.701104:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835650700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:384f52e3-0481-4979-9299-157aff7472d2+21:2396:x1875420955840384:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788541118.701119:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541118.701139:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da800/0x2aac941e5f4a7aa0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331222 expref: 21 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541118.701156:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a6809c1c800) 00010000:00010000:0.0:1788541118.701160:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541118.701216:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835650700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:384f52e3-0481-4979-9299-157aff7472d2+20:2396:x1875420955840384:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 113us (3959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541118.701232:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 3 00000100:00100000:3.0:1788541118.702723:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955840256 00000100:00100000:3.0:1788541118.702732:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955840256 00000100:00100000:3.0:1788541118.702812:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 54 00000100:00100000:3.0:1788541118.702818:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707820a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+20:11143:x1875420955840256:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1788541118.702839:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541118.702862:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a7aae lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331229 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.702978:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a7ab5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.702993:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a7ab5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.703005:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a7ab5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541118.703125:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788541118.703213:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a7aae lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331229 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.703226:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a7ab5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331229 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.703232:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a6809c1c800) 00010000:00010000:3.0:1788541118.703234:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788541118.703237:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075adc00, rc 0) 00000100:00100000:3.0:1788541118.703323:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707820a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+22:11143:x1875420955840256:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 506us (6334us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1788541118.703328:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 54 00000100:00100000:0.0:1788541118.718983:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541118.719157:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955840512 00000100:00100000:3.0:1788541118.719167:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955840512 00000100:00100000:3.0:1788541118.719215:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 31 00000100:00100000:3.0:1788541118.719223:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:384f52e3-0481-4979-9299-157aff7472d2+7:2397:x1875420955840512:12345-192.168.202.56@tcp:1:lfs.0 00010000:00010000:3.0:1788541118.719277:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056eb80e7/0x2aac941e5f4a7ac3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.719296:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ed3f975b/0x2aac941e5f4a7a76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xa16473202a33120d expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.719304:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541118.719308:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788541118.719313:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056eb80e7/0x2aac941e5f4a7ac3 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.719350:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ed3f975b/0x2aac941e5f4a7a76 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xa16473202a33120d expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.719363:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ed3f975b/0x2aac941e5f4a7a76 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a33120d expref: 7 pid: 8430 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541118.719377:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a31f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8431:1875420981101440:192.168.202.56@tcp:104: 00000100:00100000:3.0:1788541118.719470:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707871c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788541118.721819:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a31f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8431:1875420981101440:192.168.202.56@tcp:104: 00010000:00010000:3.0:1788541118.722112:0:8431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000056eb80e7/0x2aac941e5f4a7ac3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541118.722296:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541118.722400:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955840640 00000100:00100000:3.0:1788541118.722407:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955840640 00002000:00100000:3.0:1788541118.722468:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff9a6707a72300 x1875420955840640/t0(0) o4->384f52e3-0481-4979-9299-157aff7472d2@192.168.202.56@tcp:489/0 lens 504/0 e 0 to 0 dl 1788541129 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788541118.722498:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6707a72300 with x1875420955840640 ext(0->12) 00010000:00010000:3.0:1788541118.722505:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ed3f975b/0x2aac941e5f4a7a76 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a33120d expref: 8 pid: 8430 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.722519:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ed3f975b/0x2aac941e5f4a7a76 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a33120d expref: 8 pid: 8430 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788541118.722526:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a6707a72300 00000100:00100000:3.0:1788541118.722560:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 0 00000100:00100000:3.0:1788541118.722569:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:384f52e3-0481-4979-9299-157aff7472d2+8:2396:x1875420955840640:12345-192.168.202.56@tcp:4:lfs.0 00000001:00100000:2.0:1788541118.737394:0:8426:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 384f52e3-0481-4979-9299-157aff7472d2 00000100:00100000:3.0:1788541118.738969:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:384f52e3-0481-4979-9299-157aff7472d2+9:2396:x1875420955840640:12345-192.168.202.56@tcp:4:lfs.0 Request processed in 16381us (16654us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788541118.738983:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 0 00002000:00100000:3.0:1788541118.738996:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff9a6707a72300 x1875420955840640/t4294967300(0) o4->384f52e3-0481-4979-9299-157aff7472d2@192.168.202.56@tcp:489/0 lens 504/448 e 0 to 0 dl 1788541129 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788541118.739015:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6707a72300 with x1875420955840640 ext(0->12) 00010000:00010000:3.0:1788541118.739032:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ed3f975b/0x2aac941e5f4a7a76 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a33120d expref: 9 pid: 8430 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.739051:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ed3f975b/0x2aac941e5f4a7a76 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a33120d expref: 9 pid: 8430 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788541118.739059:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a6707a72300 00000100:00100000:0.0:1788541118.748144:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541118.748332:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955840768 00000100:00100000:3.0:1788541118.748358:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955840768 00010000:00010000:3.0:1788541118.748402:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ed3f975b/0x2aac941e5f4a7a76 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a33120d expref: 9 pid: 8430 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541118.748490:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 53 00000100:00100000:3.0:1788541118.748502:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:384f52e3-0481-4979-9299-157aff7472d2+9:2397:x1875420955840768:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541118.748518:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788541118.748536:0:6503:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788541118.748539:0:6503:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1788541118 00002000:00010000:3.0:1788541118.748541:0:6503:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1788541118 00002000:00010000:3.0:1788541118.748543:0:6503:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1788541118 00002000:00010000:3.0:1788541118.748546:0:6503:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788541118.748552:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ed3f975b/0x2aac941e5f4a7a76 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a33120d expref: 9 pid: 8430 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.748568:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ed3f975b/0x2aac941e5f4a7a76 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a33120d expref: 9 pid: 8430 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.748595:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed3f975b/0x2aac941e5f4a7a76 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a33120d expref: 9 pid: 8430 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.748612:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788541118.748616:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788541118.748622:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000056eb80e7/0x2aac941e5f4a7ac3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.748631:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056eb80e7/0x2aac941e5f4a7ac3 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.748674:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541118.748728:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:384f52e3-0481-4979-9299-157aff7472d2+8:2397:x1875420955840768:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 228us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541118.748734:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 53 00010000:00010000:2.0:1788541118.752370:0:8431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000056eb80e7/0x2aac941e5f4a7ac3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541118.752391:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056eb80e7/0x2aac941e5f4a7ac3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541118.752423:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056eb80e7/0x2aac941e5f4a7ac3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541118.752432:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056eb80e7/0x2aac941e5f4a7ac3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541118.752440:0:8431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056eb80e7/0x2aac941e5f4a7ac3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541118.752447:0:8431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075acc00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:2.0:1788541118.752452:0:8431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056eb80e7/0x2aac941e5f4a7ac3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541118.752478:0:8431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056eb80e7/0x2aac941e5f4a7ac3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541118.752504:0:8431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056eb80e7/0x2aac941e5f4a7ac3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541118.752512:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056eb80e7/0x2aac941e5f4a7ac3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541118.752638:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:384f52e3-0481-4979-9299-157aff7472d2+7:2397:x1875420955840512:12345-192.168.202.56@tcp:1:lfs.0 Request processed in 33410us (33661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541118.752648:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 31 00000100:00100000:0.0:1788541118.758189:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541118.760538:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955841024 00000100:00100000:3.0:1788541118.760554:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955841024 00000100:00100000:0.0:1788541118.763653:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 8 00000100:00100000:0.0:1788541118.763669:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+22:11143:x1875420955841024:12345-192.168.202.56@tcp:35:lfs.0 00000004:00010000:0.0:1788541118.763732:0:6520:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a7ab5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331229 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788541118.764089:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:0.0:1788541118.764138:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1788541118.764417:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:0.0:1788541118.764453:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7aca lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541118.764480:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7a5a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3311ff expref: 26 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541118.764491:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7aca lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541118.764528:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7a5a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3311ff expref: 26 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541118.764542:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7a5a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3311ff expref: 26 pid: 12149 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541118.764570:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a70a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6520:1875420981101568:192.168.202.56@tcp:104: 00000100:00100000:0.0:1788541118.765195:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6835493600 going to sleep for 11 seconds 00000100:00100000:2.0:1788541118.772255:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541118.772283:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955841152 00000100:00100000:2.0:1788541118.772292:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955841152 00010000:00010000:2.0:1788541118.772334:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7a5a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3311ff expref: 27 pid: 12149 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541118.772372:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 54 00000100:00100000:2.0:1788541118.772382:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835652a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:384f52e3-0481-4979-9299-157aff7472d2+27:2397:x1875420955841152:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541118.772398:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541118.772405:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7a5a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3311ff expref: 27 pid: 12149 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541118.772419:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7a5a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3311ff expref: 27 pid: 12149 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541118.772441:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a6809c1c800) 00010000:00010000:2.0:1788541118.772446:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7aca lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541118.772456:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7aca lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541118.772473:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7aca lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541118.772511:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541118.772556:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835652a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:384f52e3-0481-4979-9299-157aff7472d2+27:2397:x1875420955841152:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 175us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541118.772564:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 54 00010000:00010000:0.0:1788541118.772675:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7a5a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3311ff expref: 26 pid: 12149 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541118.772691:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a70a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6520:1875420981101568:192.168.202.56@tcp:104: 00010000:00010000:0.0:1788541118.772708:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7aca lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541118.772715:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7aca lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541118.772718:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7aca lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788541118.772812:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:0.0:1788541118.772935:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:0.0:1788541118.773056:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a70a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6520:1875420981101696:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788541118.773125:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541118.773161:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6835493900 going to sleep for 11 seconds 00000100:00100000:2.0:1788541118.773398:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981101696 00000100:00100000:2.0:1788541118.773405:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981101696 00000100:00100000:2.0:1788541118.773450:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788541118.773467:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6520:x1875420981101696:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788541118.773551:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6520:x1875420981101696:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 93us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541118.773558:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788541118.774239:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a70a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6520:1875420981101696:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788541118.774407:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:0.0:1788541118.774475:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a70a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6520:1875420981101824:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788541118.774513:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541118.777642:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683f241e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788541118.779340:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981101824 00000100:00100000:2.0:1788541118.779357:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981101824 00000100:00100000:2.0:1788541118.779485:0:10866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788541118.779497:0:10866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6520:x1875420981101824:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788541118.779724:0:10866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6520:x1875420981101824:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 229us (5209us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788541118.779733:0:10866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788541118.784327:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a70a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6520:1875420981101824:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788541118.784471:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:0.0:1788541118.784541:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7aca lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541118.784553:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7aca lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541118.784561:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7aca lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541118.784568:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75fc00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541118.784573:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7aca lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541118.784582:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7aca lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541118.784599:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a6809c1c800) 00010000:00010000:0.0:1788541118.784603:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788541118.784608:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7aca lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541118.784614:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7aca lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788541118.784730:0:6520:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788541118.784797:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1788541118.784810:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 399702938626ns, next at 400702936325ns, rc = 0 00000001:00080000:0.0:1788541118.784817:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:0.0:1788541118.784843:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a6809c1c800) 00010000:00010000:0.0:1788541118.784847:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788541118.784860:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a7ab5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331229 expref: 30 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541118.785019:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+29:11143:x1875420955841024:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 21353us (26839us total) trans 4294967327 rc 0/0 00000100:00100000:0.0:1788541118.785029:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 8 00000020:00080000:0.0:1788541118.785035:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788541118.796654:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541118.796757:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955841280 00000100:00100000:1.0:1788541118.796768:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955841280 00000100:00100000:1.0:1788541118.796841:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 55 00000100:00100000:1.0:1788541118.796853:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835650000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+29:11143:x1875420955841280:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1788541118.796907:0:12149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541118.796930:0:12149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7ad1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331230 expref: -99 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541118.796990:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7ad1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331230 expref: 30 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541118.797025:0:12149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7ad1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331230 expref: 30 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541118.797044:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a6809c1c300) 00010000:00010000:1.0:1788541118.797047:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788541118.797060:0:12149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68354db800, rc 0) 00000100:00100000:1.0:1788541118.797238:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835650000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+30:11143:x1875420955841280:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 386us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541118.797245:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 55 00000100:00100000:0.0:1788541118.818536:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541118.818631:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955841536 00000100:00100000:2.0:1788541118.818641:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955841536 00000100:00100000:2.0:1788541118.818699:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 9 00000100:00100000:2.0:1788541118.818710:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6811400050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+30:11143:x1875420955841536:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:2.0:1788541118.819025:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6811400050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+31:11143:x1875420955841536:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 315us (498us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1788541118.819048:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 9 00000100:00100000:0.0:1788541118.970288:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541118.973857:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955841792 00000100:00100000:1.0:1788541118.973891:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955841792 00000100:00100000:1.0:1788541118.973963:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 56 00000100:00100000:1.0:1788541118.973972:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+31:11153:x1875420955841792:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1788541118.973995:0:9339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541118.974016:0:9339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbc00/0x2aac941e5f4a7ad8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331237 expref: -99 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788541118.974109:0:9339:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788541118.974205:0:9339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbc00/0x2aac941e5f4a7ad8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331237 expref: 33 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541118.974221:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6809c1c700) 00010000:00010000:1.0:1788541118.974224:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788541118.974229:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbc00/0x2aac941e5f4a7ad8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331237 expref: 33 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541118.974264:0:9339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68354dbc00, rc 0) 00000100:00100000:1.0:1788541118.974346:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+32:11153:x1875420955841792:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 374us (4070us total) trans 4294967329 rc 301/301 00000100:00100000:1.0:1788541118.974354:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 56 00000100:00100000:1.0:1788541118.977370:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541118.977467:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955841920 00000100:00100000:3.0:1788541118.977477:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955841920 00000100:00100000:3.0:1788541118.977536:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 57 00000100:00100000:3.0:1788541118.977548:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708050e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+32:11153:x1875420955841920:12345-192.168.202.56@tcp:34:lfs.0 00010000:00010000:3.0:1788541118.977628:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a7ae6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.977647:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a7ae6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.977660:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a7ae6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.977671:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a7aed lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.977678:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a7aed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.977683:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a7aed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.977944:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a7af4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.977967:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a7af4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.977974:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a7af4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788541118.978028:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a7af4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.978041:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a7ae6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.978060:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a7ae6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.978068:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a7ae6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.978074:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075ad400 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541118.978078:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a7ae6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.978085:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a7ae6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.978096:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68350c4300) 00010000:00010000:3.0:1788541118.978099:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541118.978104:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a7ae6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.978110:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a7ae6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.978130:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a7aed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.978137:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a7aed lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.978142:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a7aed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.978148:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075ada00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541118.978151:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a7aed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.978157:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a7aed lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.978165:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a6809c1cf00) 00010000:00010000:3.0:1788541118.978167:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541118.978170:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a7aed lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.978175:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a7aed lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.978184:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a7af4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.978189:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a7af4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.978194:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a7af4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.978205:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075ad800 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541118.978208:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a7af4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.978215:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a7af4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.978223:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a6809c1c300) 00010000:00010000:3.0:1788541118.978226:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541118.978229:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a7af4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541118.978235:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a7af4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541118.978310:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708050e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+32:11153:x1875420955841920:12345-192.168.202.56@tcp:34:lfs.0 Request processed in 763us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541118.978319:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 57 00000100:00100000:0.0:1788541118.984124:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541118.984220:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955842176 00000100:00100000:2.0:1788541118.984232:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955842176 00000100:00100000:2.0:1788541118.984294:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 10 00000100:00100000:2.0:1788541118.984304:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+32:11153:x1875420955842176:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:2.0:1788541118.984591:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+33:11153:x1875420955842176:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 288us (476us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1788541118.984599:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 10 00010000:00010000:0.0:1788541119.050295:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541119.057148:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541119.057276:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955842432 00000100:00100000:1.0:1788541119.057288:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955842432 00000100:00100000:1.0:1788541119.057400:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 58 00000100:00100000:1.0:1788541119.057424:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+33:11156:x1875420955842432:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1788541119.057451:0:12149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541119.057484:0:12149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbc00/0x2aac941e5f4a7afb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a33123e expref: -99 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541119.057556:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a7b02 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541119.057570:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a7b02 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541119.057582:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a7b02 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541119.057592:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da800/0x2aac941e5f4a7b09 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541119.057599:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da800/0x2aac941e5f4a7b09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541119.057624:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da800/0x2aac941e5f4a7b09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541119.057741:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a7b10 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541119.057750:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a7b10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541119.057757:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a7b10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788541119.057767:0:12149:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788541119.057837:0:12149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a7b02 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541119.057844:0:12149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a7b02 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541119.057849:0:12149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a7b02 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541119.057855:0:12149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68354dba00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541119.057859:0:12149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a7b02 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541119.057866:0:12149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a7b02 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541119.057915:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68350c4300) 00010000:00010000:1.0:1788541119.057918:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541119.057929:0:12149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a7b02 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541119.057935:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a7b02 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541119.057950:0:12149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da800/0x2aac941e5f4a7b09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541119.057956:0:12149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da800/0x2aac941e5f4a7b09 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541119.057962:0:12149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da800/0x2aac941e5f4a7b09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541119.057966:0:12149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68354da800 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541119.057968:0:12149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da800/0x2aac941e5f4a7b09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541119.057973:0:12149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da800/0x2aac941e5f4a7b09 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541119.057980:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a6809c1cf00) 00010000:00010000:1.0:1788541119.057983:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541119.057985:0:12149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da800/0x2aac941e5f4a7b09 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541119.057991:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da800/0x2aac941e5f4a7b09 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541119.058026:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbc00/0x2aac941e5f4a7afb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33123e expref: 36 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541119.058051:0:12149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a7b10 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33123e expref: 35 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541119.058057:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a6809c1c300) 00010000:00010000:1.0:1788541119.058060:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788541119.058063:0:12149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68354db600, rc 0) 00000100:00100000:1.0:1788541119.058117:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+35:11156:x1875420955842432:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 708us (980us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1788541119.058124:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 58 00000100:00100000:1.0:1788541119.065929:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541119.066054:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955842560 00000100:00100000:2.0:1788541119.066064:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955842560 00000100:00100000:2.0:1788541119.066122:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 59 00000100:00100000:2.0:1788541119.066130:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708053480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+35:11156:x1875420955842560:12345-192.168.202.56@tcp:54:lfs.0 00010000:00010000:2.0:1788541119.066190:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a7b1e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.066204:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a7b1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.066212:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a7b1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.066242:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a7b1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.066247:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a7b1e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.066252:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a7b1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.066269:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551b800 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:2.0:1788541119.066273:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a7b1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.066278:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a7b1e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.066290:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a6809c1c300) 00010000:00010000:2.0:1788541119.066293:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788541119.066298:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a7b1e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.066305:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a7b1e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541119.066385:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708053480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+35:11156:x1875420955842560:12345-192.168.202.56@tcp:54:lfs.0 Request processed in 255us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541119.066391:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 59 00000100:00100000:0.0:1788541119.070749:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541119.076584:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955842816 00000100:00100000:2.0:1788541119.076601:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955842816 00000100:00100000:2.0:1788541119.076676:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 11 00000100:00100000:2.0:1788541119.076687:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+35:11156:x1875420955842816:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:2.0:1788541119.076948:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+36:11156:x1875420955842816:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 262us (6210us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1788541119.076957:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 11 00000100:00100000:1.0:1788541119.453772:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541119.453907:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955843072 00000100:00100000:3.0:1788541119.453918:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955843072 00000100:00100000:3.0:1788541119.453982:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 60 00000100:00100000:3.0:1788541119.453993:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708050700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+36:11187:x1875420955843072:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:3.0:1788541119.454030:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541119.454066:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a7b25 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331245 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541119.454183:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a7b2c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541119.454220:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a7b2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541119.454236:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a7b2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541119.454250:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788541119.454641:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a7b25 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331245 expref: 39 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541119.454661:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a7b2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331245 expref: 38 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541119.454670:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a6809c1c300) 00010000:00010000:3.0:1788541119.454673:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788541119.454676:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075ad800, rc 0) 00000100:00100000:3.0:1788541119.454734:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708050700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+38:11187:x1875420955843072:12345-192.168.202.56@tcp:101:cat.0 Request processed in 743us (971us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1788541119.454741:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 60 00000100:00100000:1.0:1788541119.459695:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541119.459786:0:9520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955843200 00000100:00100000:0.0:1788541119.459796:0:9520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955843200 00000100:00100000:0.0:1788541119.459860:0:9520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 4 00000100:00100000:0.0:1788541119.459903:0:9520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708050380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:384f52e3-0481-4979-9299-157aff7472d2+38:2397:x1875420955843200:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788541119.459918:0:9520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541119.459941:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a7b2c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331245 expref: 38 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541119.459959:0:9520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a6809c1c300) 00010000:00010000:0.0:1788541119.459963:0:9520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541119.460021:0:9520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708050380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:384f52e3-0481-4979-9299-157aff7472d2+37:2397:x1875420955843200:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 153us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541119.460028:0:9520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 4 00000100:00100000:0.0:1788541119.469398:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541119.469513:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955843456 00000100:00100000:2.0:1788541119.469525:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955843456 00000100:00100000:2.0:1788541119.469589:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 12 00000100:00100000:2.0:1788541119.469617:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+37:11187:x1875420955843456:12345-192.168.202.56@tcp:35:cat.0 00000100:00100000:2.0:1788541119.469866:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+38:11187:x1875420955843456:12345-192.168.202.56@tcp:35:cat.0 Request processed in 252us (478us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1788541119.469909:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 12 00000040:00080000:1.0:1788541119.499392:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788541119.500442:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788541119.568822:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541119.568961:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955843712 00000100:00100000:2.0:1788541119.568972:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955843712 00000100:00100000:2.0:1788541119.569045:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 61 00000100:00100000:2.0:1788541119.569056:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708051180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+38:11193:x1875420955843712:12345-192.168.202.56@tcp:101:dd.0 00010000:00010000:2.0:1788541119.569082:0:12149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541119.569085:0:12149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788541119.569112:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad200/0x2aac941e5f4a7a92 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33121b expref: 38 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.569131:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68350c4300) 00010000:00010000:2.0:1788541119.569136:0:12149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788541119.569149:0:12149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a7b3a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a33124c expref: -99 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.569252:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a7b41 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.569267:0:12149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a7b10 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33123e expref: 38 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.569288:0:12149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a7b41 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.569333:0:12149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a7b10 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33123e expref: 38 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.569428:0:12149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a7b10 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33123e expref: 38 pid: 12149 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541119.569442:0:12149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6835651880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12149:1875420981101952:192.168.202.56@tcp:104: 00000100:00100000:2.0:1788541119.569579:0:12149:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6706ab4480 going to sleep for 11 seconds 00000100:00100000:3.0:1788541119.574783:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541119.574916:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955843840 00000100:00100000:0.0:1788541119.574926:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955843840 00010000:00010000:0.0:1788541119.574966:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a7b10 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33123e expref: 39 pid: 12149 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541119.575012:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 55 00000100:00100000:0.0:1788541119.575022:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a31f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:384f52e3-0481-4979-9299-157aff7472d2+39:2397:x1875420955843840:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788541119.575038:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541119.575044:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a7b10 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33123e expref: 39 pid: 12149 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541119.575058:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a7b10 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33123e expref: 39 pid: 12149 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541119.575081:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a6809c1c300) 00010000:00010000:0.0:1788541119.575088:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a7b41 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541119.575098:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a7b41 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541119.575106:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a7b41 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541119.575124:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541119.575188:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a31f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:384f52e3-0481-4979-9299-157aff7472d2+39:2397:x1875420955843840:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 167us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541119.575195:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 55 00010000:00010000:2.0:1788541119.576100:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a7b10 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33123e expref: 38 pid: 12149 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541119.576122:0:12149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6835651880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12149:1875420981101952:192.168.202.56@tcp:104: 00010000:00010000:2.0:1788541119.576147:0:12149:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a7b41 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.576157:0:12149:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a7b41 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.576164:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a7b41 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541119.576182:0:12149:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788541119.576346:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a7b3a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33124c expref: 39 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.576757:0:12149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a7b41 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33124c expref: 38 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.576766:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a6809c1c300) 00010000:00010000:2.0:1788541119.576781:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788541119.576785:0:12149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a683551a000, rc 0) 00000100:00100000:2.0:1788541119.576851:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708051180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+38:11193:x1875420955843712:12345-192.168.202.56@tcp:101:dd.0 Request processed in 7796us (8038us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1788541119.576859:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 61 00000100:00100000:3.0:1788541119.579386:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541119.579563:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955843968 00000100:00100000:0.0:1788541119.579580:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955843968 00000100:00100000:0.0:1788541119.579635:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 62 00000100:00100000:0.0:1788541119.579645:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683558b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+38:11193:x1875420955843968:12345-192.168.202.56@tcp:101:dd.0 00010000:00010000:0.0:1788541119.579668:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541119.579689:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7b4f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331253 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541119.579722:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7b56 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541119.579738:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7b56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541119.579750:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7b56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541119.579947:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7b4f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331253 expref: 40 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541119.579968:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7b56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331253 expref: 39 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541119.579977:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a6809c1c300) 00010000:00010000:0.0:1788541119.579980:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788541119.579984:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75fe00, rc 0) 00000100:00100000:0.0:1788541119.580157:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683558b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+39:11193:x1875420955843968:12345-192.168.202.56@tcp:101:dd.0 Request processed in 512us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541119.580165:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 62 00000100:00100000:3.0:1788541119.589896:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541119.590003:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955844224 00000100:00100000:2.0:1788541119.590014:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955844224 00000100:00100000:2.0:1788541119.590132:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 63 00000100:00100000:2.0:1788541119.590144:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+39:11193:x1875420955844224:12345-192.168.202.56@tcp:36:dd.0 00010000:00010000:2.0:1788541119.590383:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a7b5d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.590398:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a7b5d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.590407:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a7b5d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788541119.590473:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:2.0:1788541119.590497:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c348e030 reply state 00000000c7603acf transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a7b5d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.590509:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a7b5d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.590517:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a6809c1c300) 00010000:00010000:2.0:1788541119.590519:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788541119.590523:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788541119.590616:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+42:11193:x1875420955844224:12345-192.168.202.56@tcp:36:dd.0 Request processed in 475us (748us total) trans 4294967337 rc 0/0 00000100:00100000:2.0:1788541119.590636:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 63 00000020:00080000:2.0:1788541119.590640:0:6517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788541119.782206:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541119.782254:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541119.782410:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955844352 00000100:00100000:0.0:1788541119.782432:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955844352 00000100:00100000:0.0:1788541119.782495:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 383 00000100:00100000:0.0:1788541119.782506:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807636850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:2395:x1875420955844352:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541119.782551:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541119.782611:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955844608 00000100:00100000:2.0:1788541119.782616:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955844608 00000100:00100000:2.0:1788541119.782648:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 105 00000100:00100000:0.0:1788541119.782649:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807636850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:2395:x1875420955844352:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 71us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541119.782656:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835589180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:384f52e3-0481-4979-9299-157aff7472d2+7:2395:x1875420955844608:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541119.782656:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 383 00000100:00100000:0.0:1788541119.782709:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955844864 00000100:00100000:0.0:1788541119.782713:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955844864 00000100:00100000:0.0:1788541119.782752:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 293 00000100:00100000:0.0:1788541119.782759:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2395:x1875420955844864:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541119.782788:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2395:x1875420955844864:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 29us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541119.782795:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 293 00000100:00100000:3.0:1788541119.782799:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541119.782807:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955844480 00000100:00100000:0.0:1788541119.782810:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955844480 00000100:00100000:0.0:1788541119.782831:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 294 00000100:00100000:0.0:1788541119.782837:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683558a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+5:2395:x1875420955844480:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541119.782854:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541119.782864:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683558a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+5:2395:x1875420955844480:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 27us (65us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541119.782895:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 294 00000100:00100000:0.0:1788541119.782906:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955844736 00000100:00100000:0.0:1788541119.782909:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955844736 00000100:00100000:0.0:1788541119.782928:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 295 00000100:00100000:0.0:1788541119.782934:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2395:x1875420955844736:12345-192.168.202.56@tcp:400:kworker.0 00000100:00080000:3.0:1788541119.782953:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788541119.782957:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788541119.782961:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2395:x1875420955844736:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 27us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541119.782974:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 295 00000100:00100000:2.0:1788541119.792194:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835589180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:384f52e3-0481-4979-9299-157aff7472d2+7:2395:x1875420955844608:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 9523us (9924us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541119.792210:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 105 00000100:00100000:3.0:1788541119.835606:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541119.835809:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955844992 00000100:00100000:2.0:1788541119.835821:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955844992 00000100:00100000:2.0:1788541119.835971:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 64 00000100:00100000:2.0:1788541119.835981:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+42:11207:x1875420955844992:12345-192.168.202.56@tcp:101:stat.0 00010000:00010000:2.0:1788541119.836017:0:9339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541119.836038:0:9339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a7b64 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a33125a expref: -99 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.836104:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a7b6b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.836119:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a7b6b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.836131:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a7b6b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.836142:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a7b72 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.836166:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a7b72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.836173:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a7b72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.836246:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048600/0x2aac941e5f4a7b79 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.836257:0:9339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a7b41 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33124c expref: 43 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.836266:0:9339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048600/0x2aac941e5f4a7b79 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.836314:0:9339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a7b41 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33124c expref: 43 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.836327:0:9339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a7b41 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33124c expref: 43 pid: 12149 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541119.836341:0:9339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6835651880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9339:1875420981102080:192.168.202.56@tcp:104: 00000100:00100000:2.0:1788541119.836763:0:9339:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6706ab4480 going to sleep for 11 seconds 00000100:00100000:2.0:1788541119.838812:0:9339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6835651880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9339:1875420981102080:192.168.202.56@tcp:104: 00010000:00010000:2.0:1788541119.838837:0:9339:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048600/0x2aac941e5f4a7b79 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541119.840007:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541119.840082:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955845248 00000100:00100000:2.0:1788541119.840101:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955845248 00000100:00100000:2.0:1788541119.840151:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 13 00000100:00100000:2.0:1788541119.840159:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683558b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+44:9914:x1875420955845248:12345-192.168.202.56@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788541119.840429:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683558b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+45:9914:x1875420955845248:12345-192.168.202.56@tcp:35:ldlm_bl.0 Request processed in 269us (424us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1788541119.840436:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 13 00000100:00100000:1.0:1788541119.842809:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541119.842902:0:9520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955845376 00000100:00100000:0.0:1788541119.842910:0:9520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955845376 00010000:00010000:0.0:1788541119.842952:0:9520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a7b41 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33124c expref: 45 pid: 12149 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541119.842994:0:9520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 56 00000100:00100000:0.0:1788541119.843073:0:9520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708051c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:384f52e3-0481-4979-9299-157aff7472d2+45:2397:x1875420955845376:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788541119.843089:0:9520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541119.843096:0:9520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a7b41 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33124c expref: 45 pid: 12149 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541119.843110:0:9520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a7b41 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33124c expref: 45 pid: 12149 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541119.843133:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a7b41 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33124c expref: 45 pid: 12149 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541119.843150:0:9520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a6809c1c300) 00010000:00010000:0.0:1788541119.843157:0:9520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048600/0x2aac941e5f4a7b79 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541119.843167:0:9520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048600/0x2aac941e5f4a7b79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541119.843176:0:9520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048600/0x2aac941e5f4a7b79 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541119.843229:0:9520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541119.843441:0:9520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708051c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:384f52e3-0481-4979-9299-157aff7472d2+44:2397:x1875420955845376:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 372us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541119.843459:0:9520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 56 00010000:00010000:2.0:1788541119.843593:0:9339:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048600/0x2aac941e5f4a7b79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.843602:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048600/0x2aac941e5f4a7b79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541119.843649:0:9339:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788541119.843653:0:9339:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788541119.843698:0:9339:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048600/0x2aac941e5f4a7b79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.843713:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048600/0x2aac941e5f4a7b79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.843722:0:9339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a7b6b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.843728:0:9339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a7b6b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.843735:0:9339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a7b6b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.843740:0:9339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551aa00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:2.0:1788541119.843745:0:9339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a7b6b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.843759:0:9339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a7b6b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.843770:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68350c4300) 00010000:00010000:2.0:1788541119.843772:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541119.843776:0:9339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a7b6b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.843781:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a7b6b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.843791:0:9339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a7b72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.843797:0:9339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a7b72 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.843801:0:9339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a7b72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.843806:0:9339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551b200 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:2.0:1788541119.843808:0:9339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a7b72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.843814:0:9339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a7b72 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.843820:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a6809c1cf00) 00010000:00010000:2.0:1788541119.843822:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541119.843824:0:9339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a7b72 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.843839:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a7b72 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.843935:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a7b64 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33125a expref: 44 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.843951:0:9339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048600/0x2aac941e5f4a7b79 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33125a expref: 43 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541119.843958:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a6809c1c300) 00010000:00010000:2.0:1788541119.843959:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788541119.843962:0:9339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6842048600, rc 0) 00000100:00100000:2.0:1788541119.843993:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+43:11207:x1875420955844992:12345-192.168.202.56@tcp:101:stat.0 Request processed in 8014us (8402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541119.844010:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 64 00000100:00100000:0.0:1788541119.935196:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541119.935303:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955845632 00000100:00100000:3.0:1788541119.935314:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955845632 00000100:00100000:3.0:1788541119.935378:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 65 00000100:00100000:3.0:1788541119.935389:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+43:11212:x1875420955845632:12345-192.168.202.56@tcp:36:truncate.0 00010000:00010000:3.0:1788541119.935549:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541119.935579:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048600/0x2aac941e5f4a7b79 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33125a expref: 43 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541119.935603:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a6809c1c300) 00010000:00010000:3.0:1788541119.935609:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788541119.935786:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a7b80 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541119.935802:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a7b80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541119.935812:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a7b80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788541119.935856:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:3.0:1788541119.935936:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003d2ddb2d reply state 000000007d977d50 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a7b80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541119.935949:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a7b80 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541119.935956:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a6809c1c300) 00010000:00010000:3.0:1788541119.935965:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788541119.935968:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788541119.936219:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+45:11212:x1875420955845632:12345-192.168.202.56@tcp:36:truncate.0 Request processed in 831us (1033us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1788541119.936227:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 65 00000020:00080000:3.0:1788541119.936233:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788541120.074815:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541120.116694:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541120.116791:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955845760 00000100:00100000:0.0:1788541120.116805:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955845760 00000100:00100000:0.0:1788541120.116931:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 66 00000100:00100000:0.0:1788541120.116943:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708050a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+45:11227:x1875420955845760:12345-192.168.202.56@tcp:101:stat.0 00010000:00010000:0.0:1788541120.116971:0:12149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541120.117007:0:12149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a7b87 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331261 expref: -99 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541120.117083:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7b8e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541120.117099:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7b8e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541120.117113:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7b8e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541120.117125:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7b95 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541120.117132:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7b95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541120.117139:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7b95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541120.117236:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7b9c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541120.117245:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7b9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541120.117252:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7b9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541120.117705:0:12149:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1788541120.117711:0:12149:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788541120.117746:0:12149:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7b9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541120.117761:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7b9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541120.117770:0:12149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7b8e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541120.117777:0:12149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7b8e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541120.117784:0:12149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7b8e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541120.117790:0:12149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75ec00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541120.117795:0:12149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7b8e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541120.117804:0:12149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7b8e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541120.117831:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68350c4300) 00010000:00010000:0.0:1788541120.117833:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541120.117839:0:12149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7b8e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541120.117845:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7b8e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541120.117858:0:12149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7b95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541120.117864:0:12149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7b95 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788541120.117998:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788541120.118036:0:12149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7b95 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541120.118041:0:12149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75ee00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541120.118044:0:12149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7b95 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541120.118049:0:12149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7b95 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541120.118057:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a6809c1cf00) 00010000:00010000:0.0:1788541120.118059:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541120.118062:0:12149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7b95 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541120.118067:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7b95 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541120.118109:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a7b87 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331261 expref: 47 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541120.118121:0:12149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7b9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331261 expref: 46 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541120.118128:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a6809c1c300) 00010000:00010000:0.0:1788541120.118130:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788541120.118132:0:12149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75fc00, rc 0) 00000100:00100000:0.0:1788541120.118211:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708050a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+46:11227:x1875420955845760:12345-192.168.202.56@tcp:101:stat.0 Request processed in 1271us (1530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541120.118218:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 66 00000100:00100000:2.0:1788541120.224742:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541120.226123:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955846016 00000100:00100000:3.0:1788541120.226136:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955846016 00000100:00100000:3.0:1788541120.226208:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 67 00000100:00100000:3.0:1788541120.226219:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835651880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+46:11237:x1875420955846016:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1788541120.226245:0:9339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541120.226281:0:9339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a7ba3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331268 expref: -99 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541120.226387:0:9339:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788541120.226696:0:9339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a7ba3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331268 expref: 48 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.226712:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6809c1c700) 00010000:00010000:3.0:1788541120.226715:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788541120.226721:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a7ba3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331268 expref: 48 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.226735:0:9339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075ada00, rc 0) 00000100:00100000:3.0:1788541120.226808:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835651880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+47:11237:x1875420955846016:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 591us (2076us total) trans 4294967341 rc 301/301 00000100:00100000:3.0:1788541120.226816:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 67 00000100:00100000:2.0:1788541120.243511:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541120.243670:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955846272 00000100:00100000:0.0:1788541120.243681:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955846272 00000100:00100000:0.0:1788541120.243745:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 14 00000100:00100000:0.0:1788541120.243756:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835653b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+47:11237:x1875420955846272:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:0.0:1788541120.244056:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835653b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+48:11237:x1875420955846272:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 300us (552us total) trans 4294967342 rc 0/0 00000100:00100000:0.0:1788541120.244064:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 14 00000100:00100000:1.0:1788541120.349720:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541120.349828:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955846528 00000100:00100000:0.0:1788541120.349839:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955846528 00000100:00100000:0.0:1788541120.349933:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 68 00000100:00100000:0.0:1788541120.349945:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708051500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+48:11243:x1875420955846528:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:0.0:1788541120.349969:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541120.350001:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a7bb1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a33126f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541120.350126:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7bb8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541120.350143:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7b9c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331261 expref: 49 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541120.350152:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7bb8 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541120.350188:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7b9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331261 expref: 49 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541120.350202:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7b9c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331261 expref: 49 pid: 12149 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541120.350216:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6518:1875420981102208:192.168.202.56@tcp:104: 00000100:00100000:0.0:1788541120.350339:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683f241780 going to sleep for 11 seconds 00000100:00100000:0.0:1788541120.354017:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6518:1875420981102208:192.168.202.56@tcp:104: 00010000:00010000:0.0:1788541120.354052:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7bb8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541120.354679:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541120.354757:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955846656 00000100:00100000:0.0:1788541120.354764:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955846656 00010000:00010000:0.0:1788541120.354801:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7b9c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331261 expref: 50 pid: 12149 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541120.354841:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 57 00000100:00100000:0.0:1788541120.354892:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680763d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:384f52e3-0481-4979-9299-157aff7472d2+50:2397:x1875420955846656:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788541120.354908:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541120.354915:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7b9c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331261 expref: 50 pid: 12149 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541120.354927:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7b9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331261 expref: 50 pid: 12149 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541120.354948:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7b9c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331261 expref: 50 pid: 12149 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541120.354964:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a6809c1c300) 00010000:00010000:0.0:1788541120.354968:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7bb8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541120.354978:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7bb8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541120.354986:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7bb8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541120.355025:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541120.355086:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680763d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:384f52e3-0481-4979-9299-157aff7472d2+49:2397:x1875420955846656:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 218us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541120.355094:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 57 00010000:00010000:3.0:1788541120.356003:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7bb8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.356015:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7bb8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541120.356038:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1788541120.356175:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a7bb1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33126f expref: 50 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.356194:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7bb8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33126f expref: 49 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.356203:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a6809c1c300) 00010000:00010000:3.0:1788541120.356205:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788541120.356209:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75ee00, rc 0) 00000100:00100000:3.0:1788541120.356328:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708051500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+49:11243:x1875420955846528:12345-192.168.202.56@tcp:101:bash.0 Request processed in 6384us (6623us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1788541120.356336:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 68 00000100:00100000:1.0:1788541120.366738:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541120.366810:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955846912 00000100:00100000:0.0:1788541120.366820:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955846912 00000100:00100000:0.0:1788541120.366918:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 69 00000100:00100000:0.0:1788541120.366927:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708052680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+49:11243:x1875420955846912:12345-192.168.202.56@tcp:36:bash.0 00010000:00010000:0.0:1788541120.367142:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7bc6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541120.367159:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7bc6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541120.367170:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7bc6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788541120.367205:0:12149:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:0.0:1788541120.367221:0:12149:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000099b402c3 reply state 00000000e327092b transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7bc6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541120.367233:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7bc6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541120.367241:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a6809c1c300) 00010000:00010000:0.0:1788541120.367244:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788541120.367247:0:12149:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788541120.367337:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708052680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+52:11243:x1875420955846912:12345-192.168.202.56@tcp:36:bash.0 Request processed in 411us (609us total) trans 4294967345 rc 0/0 00000100:00100000:0.0:1788541120.367344:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 69 00000020:00080000:0.0:1788541120.367349:0:12149:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788541120.380408:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541120.380610:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955847040 00000100:00100000:3.0:1788541120.380621:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955847040 00000100:00100000:3.0:1788541120.380683:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 70 00000100:00100000:3.0:1788541120.380693:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835653800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+52:11243:x1875420955847040:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:3.0:1788541120.380716:0:9339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541120.380741:0:9339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a7bcd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331276 expref: -99 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.380845:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a7bd4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.380921:0:9339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7bb8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33126f expref: 53 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.380931:0:9339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a7bd4 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.380968:0:9339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7bb8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33126f expref: 53 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.380981:0:9339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7bb8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33126f expref: 53 pid: 6518 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541120.380995:0:9339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6835589500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9339:1875420981102336:192.168.202.56@tcp:104: 00000100:00100000:3.0:1788541120.383566:0:9339:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707871a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788541120.390587:0:9339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6835589500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9339:1875420981102336:192.168.202.56@tcp:104: 00010000:00010000:3.0:1788541120.390617:0:9339:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a7bd4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541120.390726:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541120.390796:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955847168 00000100:00100000:3.0:1788541120.390803:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955847168 00010000:00010000:3.0:1788541120.390846:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7bb8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33126f expref: 54 pid: 6518 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541120.390914:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 58 00000100:00100000:3.0:1788541120.390924:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835652d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:384f52e3-0481-4979-9299-157aff7472d2+54:2396:x1875420955847168:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541120.390940:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541120.390962:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7bb8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33126f expref: 54 pid: 6518 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.390974:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7bb8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33126f expref: 54 pid: 6518 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.390999:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7bb8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33126f expref: 54 pid: 6518 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.391015:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a6809c1c300) 00010000:00010000:3.0:1788541120.391020:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a7bd4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.391030:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a7bd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.391038:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a7bd4 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.391069:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541120.391119:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835652d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:384f52e3-0481-4979-9299-157aff7472d2+53:2396:x1875420955847168:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 196us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541120.391127:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 58 00010000:00010000:2.0:1788541120.391431:0:9339:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a7bd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541120.391440:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a7bd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541120.391510:0:9339:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788541120.391516:0:9339:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788541120.391547:0:9339:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a7bd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541120.391577:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a7bcd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331276 expref: 53 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541120.391594:0:9339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a7bd4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331276 expref: 52 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541120.391601:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a6809c1c300) 00010000:00010000:2.0:1788541120.391605:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788541120.391608:0:9339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075ac600, rc 0) 00000100:00100000:2.0:1788541120.391651:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835653800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+52:11243:x1875420955847040:12345-192.168.202.56@tcp:101:bash.0 Request processed in 10958us (11253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541120.391666:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 70 00000100:00100000:2.0:1788541120.398373:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541120.398570:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955847424 00000100:00100000:0.0:1788541120.398583:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955847424 00000100:00100000:0.0:1788541120.398653:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 15 00000100:00100000:0.0:1788541120.398673:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6811400850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+52:11243:x1875420955847424:12345-192.168.202.56@tcp:35:bash.0 00000100:00100000:0.0:1788541120.398939:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6811400850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+53:11243:x1875420955847424:12345-192.168.202.56@tcp:35:bash.0 Request processed in 268us (576us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1788541120.398947:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 15 00000100:00100000:1.0:1788541120.445974:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541120.446061:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955847680 00000100:00100000:3.0:1788541120.446072:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955847680 00000100:00100000:3.0:1788541120.446136:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 71 00000100:00100000:3.0:1788541120.446146:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708050380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+53:11254:x1875420955847680:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1788541120.446170:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541120.446191:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac400/0x2aac941e5f4a7bdb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a33127d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541120.446322:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788541120.446434:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac400/0x2aac941e5f4a7bdb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33127d expref: 55 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.446595:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6809c1c700) 00010000:00010000:3.0:1788541120.446599:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788541120.446605:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac400/0x2aac941e5f4a7bdb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33127d expref: 55 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.446620:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075ac400, rc 0) 00000100:00100000:3.0:1788541120.446690:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708050380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+54:11254:x1875420955847680:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 545us (725us total) trans 4294967347 rc 301/301 00000100:00100000:3.0:1788541120.446698:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 71 00000100:00100000:2.0:1788541120.451557:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541120.451773:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955847808 00000100:00100000:3.0:1788541120.451784:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955847808 00000100:00100000:3.0:1788541120.451846:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 72 00000100:00100000:3.0:1788541120.451856:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835652300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+54:11254:x1875420955847808:12345-192.168.202.56@tcp:34:lfs.0 00010000:00010000:3.0:1788541120.451978:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac400/0x2aac941e5f4a7be9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.452007:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac400/0x2aac941e5f4a7be9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.452019:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac400/0x2aac941e5f4a7be9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.452031:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a7bf0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.452052:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a7bf0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.452059:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a7bf0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.452135:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a7bf7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.452144:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a7bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.452150:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a7bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788541120.452193:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a7bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.452205:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac400/0x2aac941e5f4a7be9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.452211:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac400/0x2aac941e5f4a7be9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.452218:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac400/0x2aac941e5f4a7be9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.452224:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075ac400 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541120.452227:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac400/0x2aac941e5f4a7be9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.452234:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac400/0x2aac941e5f4a7be9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.452254:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68350c4300) 00010000:00010000:3.0:1788541120.452257:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541120.452262:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac400/0x2aac941e5f4a7be9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.452280:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac400/0x2aac941e5f4a7be9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.452291:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a7bf0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.452297:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a7bf0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.452310:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a7bf0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.452314:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075ace00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541120.452316:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a7bf0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.452322:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a7bf0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.452329:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a6809c1cf00) 00010000:00010000:3.0:1788541120.452331:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541120.452334:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a7bf0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.452340:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a7bf0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.452359:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a7bf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.452364:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a7bf7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.452369:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a7bf7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.452373:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075ad000 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541120.452376:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a7bf7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.452381:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a7bf7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.452388:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a6809c1c300) 00010000:00010000:3.0:1788541120.452390:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541120.452393:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a7bf7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.452398:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a7bf7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541120.452713:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835652300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+54:11254:x1875420955847808:12345-192.168.202.56@tcp:34:lfs.0 Request processed in 855us (1163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541120.452723:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 72 00000100:00100000:2.0:1788541120.458185:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541120.458295:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955848064 00000100:00100000:0.0:1788541120.458315:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955848064 00000100:00100000:0.0:1788541120.458380:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 16 00000100:00100000:0.0:1788541120.458390:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835651f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+54:11254:x1875420955848064:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:0.0:1788541120.458672:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835651f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+55:11254:x1875420955848064:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 282us (495us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1788541120.458680:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 16 00000100:00100000:1.0:1788541120.508735:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541120.508842:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955848320 00000100:00100000:2.0:1788541120.508854:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955848320 00000100:00100000:2.0:1788541120.508952:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 73 00000100:00100000:2.0:1788541120.508962:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708051c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+55:11257:x1875420955848320:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1788541120.508984:0:9339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541120.509016:0:9339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a7bfe lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331284 expref: -99 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541120.509091:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048e00/0x2aac941e5f4a7c05 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541120.509119:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048e00/0x2aac941e5f4a7c05 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541120.509132:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048e00/0x2aac941e5f4a7c05 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541120.509144:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048800/0x2aac941e5f4a7c0c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541120.509151:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048800/0x2aac941e5f4a7c0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541120.509158:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048800/0x2aac941e5f4a7c0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541120.509265:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049e00/0x2aac941e5f4a7c13 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541120.509287:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049e00/0x2aac941e5f4a7c13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541120.509295:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049e00/0x2aac941e5f4a7c13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541120.509617:0:9339:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788541120.509705:0:9339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048e00/0x2aac941e5f4a7c05 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541120.509714:0:9339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048e00/0x2aac941e5f4a7c05 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541120.509721:0:9339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048e00/0x2aac941e5f4a7c05 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541120.509734:0:9339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842048e00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:2.0:1788541120.509739:0:9339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048e00/0x2aac941e5f4a7c05 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541120.509747:0:9339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048e00/0x2aac941e5f4a7c05 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541120.509761:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68350c4300) 00010000:00010000:2.0:1788541120.509764:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541120.509769:0:9339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048e00/0x2aac941e5f4a7c05 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541120.509775:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048e00/0x2aac941e5f4a7c05 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541120.509791:0:9339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048800/0x2aac941e5f4a7c0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541120.509797:0:9339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048800/0x2aac941e5f4a7c0c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541120.509803:0:9339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048800/0x2aac941e5f4a7c0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541120.509808:0:9339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842048800 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:2.0:1788541120.509811:0:9339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048800/0x2aac941e5f4a7c0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541120.509818:0:9339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048800/0x2aac941e5f4a7c0c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541120.509837:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a6809c1cf00) 00010000:00010000:2.0:1788541120.509839:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541120.509842:0:9339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048800/0x2aac941e5f4a7c0c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541120.509847:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048800/0x2aac941e5f4a7c0c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541120.509931:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a7bfe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331284 expref: 58 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541120.509948:0:9339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049e00/0x2aac941e5f4a7c13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331284 expref: 57 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541120.509956:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a6809c1c300) 00010000:00010000:2.0:1788541120.509959:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788541120.509961:0:9339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6842049e00, rc 0) 00000100:00100000:2.0:1788541120.510141:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708051c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+57:11257:x1875420955848320:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1179us (1418us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1788541120.510149:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 73 00000100:00100000:2.0:1788541120.514559:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541120.514722:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955848448 00000100:00100000:0.0:1788541120.514734:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955848448 00000100:00100000:0.0:1788541120.514810:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 74 00000100:00100000:0.0:1788541120.514822:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835653100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+57:11257:x1875420955848448:12345-192.168.202.56@tcp:54:lfs.0 00010000:00010000:0.0:1788541120.514954:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7c21 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541120.514976:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7c21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541120.514992:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7c21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541120.515031:0:12149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7c21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541120.515038:0:12149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7c21 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541120.515046:0:12149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7c21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541120.515052:0:12149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75ec00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541120.515076:0:12149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7c21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541120.515085:0:12149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7c21 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541120.515100:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a6809c1c300) 00010000:00010000:0.0:1788541120.515104:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788541120.515109:0:12149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7c21 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541120.515117:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7c21 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541120.515202:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835653100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+57:11257:x1875420955848448:12345-192.168.202.56@tcp:54:lfs.0 Request processed in 381us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541120.515210:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 74 00000100:00100000:0.0:1788541120.518252:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541120.518330:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955848576 00000100:00100000:2.0:1788541120.518339:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955848576 00000100:00100000:2.0:1788541120.518403:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 5 00000100:00100000:2.0:1788541120.518411:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:384f52e3-0481-4979-9299-157aff7472d2+57:2397:x1875420955848576:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541120.518428:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541120.518471:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049e00/0x2aac941e5f4a7c13 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331284 expref: 57 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541120.518508:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a6809c1c300) 00010000:00010000:2.0:1788541120.518513:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541120.518576:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:384f52e3-0481-4979-9299-157aff7472d2+56:2397:x1875420955848576:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 165us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541120.518584:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 5 00000100:00100000:1.0:1788541120.521843:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541120.522041:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955848832 00000100:00100000:0.0:1788541120.522053:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955848832 00000100:00100000:0.0:1788541120.522112:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 17 00000100:00100000:0.0:1788541120.522122:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708080700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+56:11257:x1875420955848832:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:0.0:1788541120.522386:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708080700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+57:11257:x1875420955848832:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 263us (550us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1788541120.522393:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 17 00000100:00100000:3.0:1788541120.696154:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541120.696318:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955849088 00000100:00100000:2.0:1788541120.696329:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955849088 00000100:00100000:2.0:1788541120.696402:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 75 00000100:00100000:2.0:1788541120.696411:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+57:11275:x1875420955849088:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:2.0:1788541120.696438:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541120.696475:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049e00/0x2aac941e5f4a7c28 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a33128b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541120.696615:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048800/0x2aac941e5f4a7c2f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541120.696631:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048800/0x2aac941e5f4a7c2f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541120.696644:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048800/0x2aac941e5f4a7c2f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541120.696655:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788541120.696773:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049e00/0x2aac941e5f4a7c28 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33128b expref: 60 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541120.696796:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048800/0x2aac941e5f4a7c2f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33128b expref: 59 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541120.696823:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a6809c1c300) 00010000:00010000:2.0:1788541120.696826:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788541120.696830:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6842048800, rc 0) 00000100:00100000:2.0:1788541120.696968:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+59:11275:x1875420955849088:12345-192.168.202.56@tcp:101:cat.0 Request processed in 557us (826us total) trans 4294967351 rc 0/0 00000100:00100000:2.0:1788541120.696975:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 75 00000100:00100000:2.0:1788541120.730106:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541120.730258:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955849216 00000100:00100000:3.0:1788541120.730279:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955849216 00000100:00100000:3.0:1788541120.730360:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 76 00000100:00100000:3.0:1788541120.730370:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835651c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+59:11276:x1875420955849216:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1788541120.730396:0:9339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541120.730419:0:9339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a7c3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331292 expref: -99 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.730495:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a7c44 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.730521:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a7c44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.730534:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a7c44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541120.730579:0:9339:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788541120.730582:0:9339:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788541120.730599:0:9339:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a7c44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.730624:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a7c3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331292 expref: 61 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.730642:0:9339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a7c44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331292 expref: 60 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.730651:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68350c4300) 00010000:00010000:3.0:1788541120.730653:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788541120.730656:0:9339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075ace00, rc 0) 00000100:00100000:3.0:1788541120.730719:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835651c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+60:11276:x1875420955849216:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 351us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541120.730731:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 76 00000100:00100000:1.0:1788541120.736752:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541120.736860:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955849600 00000100:00100000:0.0:1788541120.736895:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955849600 00000100:00100000:0.0:1788541120.736961:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 18 00000100:00100000:0.0:1788541120.736971:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f0fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+60:11276:x1875420955849600:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:0.0:1788541120.737605:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f0fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+61:11276:x1875420955849600:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 631us (861us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1788541120.737613:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 18 00000100:00100000:2.0:1788541120.741852:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541120.742126:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955849728 00000100:00100000:3.0:1788541120.742137:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955849728 00000100:00100000:3.0:1788541120.742279:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 6 00000100:00100000:3.0:1788541120.742291:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835651180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:384f52e3-0481-4979-9299-157aff7472d2+61:11276:x1875420955849728:12345-192.168.202.56@tcp:103:lfs.0 00010000:00010000:3.0:1788541120.742322:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788541120.742672:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a7bd4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331276 expref: 61 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.742698:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048800/0x2aac941e5f4a7c2f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33128b expref: 60 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.742711:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7ad1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331230 expref: 59 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.742722:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a6809c1c300) 00010000:00010000:3.0:1788541120.742728:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541120.742796:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835651180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:384f52e3-0481-4979-9299-157aff7472d2+58:11276:x1875420955849728:12345-192.168.202.56@tcp:103:lfs.0 Request processed in 507us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541120.742804:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 6 00000100:00100000:2.0:1788541120.746335:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541120.746741:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955849856 00000100:00100000:3.0:1788541120.746751:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955849856 00000100:00100000:3.0:1788541120.746817:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 77 00000100:00100000:3.0:1788541120.746828:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835650a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+58:11276:x1875420955849856:12345-192.168.202.56@tcp:58:lfs.0 00010000:00010000:3.0:1788541120.746979:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a7c4b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.747031:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a7c4b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.747044:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a7c4b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788541120.747296:0:6519:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788541120.747741:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1788541120.747825:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1788541120.748063:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835650a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+58:11276:x1875420955849856:12345-192.168.202.56@tcp:58:lfs.0 Request processed in 1232us (1735us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541120.748072:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 77 00000100:00100000:1.0:1788541120.777275:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541120.777958:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955849984 00000100:00100000:3.0:1788541120.777973:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955849984 00000100:00100000:3.0:1788541120.778082:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 78 00000100:00100000:3.0:1788541120.778096:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f0fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+58:11278:x1875420955849984:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1788541120.778130:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541120.778162:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a7c52 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331299 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.778250:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac400/0x2aac941e5f4a7c59 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.778267:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac400/0x2aac941e5f4a7c59 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.778278:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac400/0x2aac941e5f4a7c59 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.778327:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a7c60 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.778342:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a7c60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.778351:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a7c60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.778458:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad200/0x2aac941e5f4a7c67 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.778467:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad200/0x2aac941e5f4a7c67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.778474:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad200/0x2aac941e5f4a7c67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541120.778789:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788541120.778795:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788541120.778819:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad200/0x2aac941e5f4a7c67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.778832:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad200/0x2aac941e5f4a7c67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.778840:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac400/0x2aac941e5f4a7c59 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.778848:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac400/0x2aac941e5f4a7c59 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.778867:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac400/0x2aac941e5f4a7c59 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.778899:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075ac400 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541120.778904:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac400/0x2aac941e5f4a7c59 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.778912:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac400/0x2aac941e5f4a7c59 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.778925:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68350c4300) 00010000:00010000:3.0:1788541120.778928:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541120.778933:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac400/0x2aac941e5f4a7c59 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.778940:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac400/0x2aac941e5f4a7c59 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.778954:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a7c60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.778961:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a7c60 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.778967:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a7c60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.778971:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075ada00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541120.778974:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a7c60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.779419:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a7c60 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.779430:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a6809c1cf00) 00010000:00010000:3.0:1788541120.779433:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541120.779436:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a7c60 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.779451:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a7c60 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.779487:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a7c52 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331299 expref: 60 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.779502:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad200/0x2aac941e5f4a7c67 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331299 expref: 59 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541120.779631:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a6809c1c300) 00010000:00010000:3.0:1788541120.779634:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788541120.779637:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075ad200, rc 0) 00000100:00100000:3.0:1788541120.779710:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f0fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+59:11278:x1875420955849984:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1617us (2456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541120.779719:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 78 00000004:00080000:0.0:1788541120.971014:0:8971:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 401889140257ns, next at 402889136643ns, rc = 0 00000100:00100000:0.0:1788541120.971050:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981102464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788541120.971125:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541120.971203:0:14072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981102464 00000100:00100000:0.0:1788541120.971211:0:14072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981102464 00000100:00100000:0.0:1788541120.971266:0:14072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788541120.971277:0:14072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875420981102464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788541120.971310:0:14072:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788541120.971359:0:14072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875420981102464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541120.971366:0:14072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:0.0:1788541120.971392:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788541120.971436:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981102464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788541120.973052:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788541120.973069:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981102592:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788541120.973137:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541120.973231:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981102592 00000100:00100000:0.0:1788541120.973238:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981102592 00000100:00100000:0.0:1788541120.973299:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788541120.973307:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981102592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788541120.973345:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788541120.973394:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981102592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541120.973401:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788541120.973464:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981102592:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788541120.975928:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788541120.975951:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6835588700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981102720:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788541120.976036:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541120.976094:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981102720 00000100:00100000:0.0:1788541120.976101:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981102720 00000100:00100000:0.0:1788541120.976156:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788541120.976164:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981102720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788541120.976185:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788541120.976228:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981102720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541120.976235:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:0.0:1788541120.976258:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788541120.977163:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6835588700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981102720:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788541121.099149:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788541121.535156:0:14209:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788541121.535165:0:14209:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788541121.535190:0:14209:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788541121.535197:0:14209:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788541121.551834:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788541121.551844:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788541121.552189:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788541121.552197:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788541121.553495:0:13798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b7ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1875420981102848:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788541121.553591:0:13798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6835519c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788541121.562525:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541121.562807:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955850112 00000100:00100000:0.0:1788541121.562819:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955850112 00000100:00100000:0.0:1788541121.562909:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 79 00000100:00100000:0.0:1788541121.562921:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683558aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+60:11289:x1875420955850112:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788541121.562960:0:12149:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788541121.563588:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683558aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+60:11289:x1875420955850112:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 667us (1077us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541121.563607:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 79 00000100:00100000:0.0:1788541121.563659:0:13798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b7ce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1875420981102848:192.168.202.56@tcp:107:hsm_cdtr.0 00000004:00080000:3.0:1788541121.573583:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:3.0:1788541121.573630:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000004:00080000:3.0:1788541121.573675:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:3.0:1788541121.573702:0:6496:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a683f241180 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1788541121.573708:0:6496:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a6707909400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a683f241540 00000020:00080000:3.0:1788541121.573711:0:6496:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a6707909b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a6814f04600 00010000:00010000:3.0:1788541121.573757:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a7a0d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.573769:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a7a0d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.573777:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a7a0d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.573782:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551b600 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541121.573788:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a7a0d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.573795:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a7a0d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.573813:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9a68350c4000) 00010000:00010000:3.0:1788541121.573816:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541121.573821:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a7a0d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.573828:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a7a0d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.573849:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a7a14 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.573856:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a7a14 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.573867:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a7a14 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.574136:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551b000 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541121.574139:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a7a14 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.574145:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a7a14 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.574153:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68350c4300) 00010000:00010000:3.0:1788541121.574156:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541121.574159:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a7a14 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.574164:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a7a14 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.574179:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a7a53 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.574184:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a7a53 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.574189:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a7a53 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.574194:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68354dbe00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541121.574196:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a7a53 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.574210:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a7a53 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.574219:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a6809c1cf00) 00010000:00010000:3.0:1788541121.574221:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541121.574224:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a7a53 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.574230:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a7a53 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.574247:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a7b5d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.574253:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a7b5d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541121.574429:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541121.574475:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955850240 00000100:00100000:1.0:1788541121.574484:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955850240 00000100:00100000:1.0:1788541121.574529:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 80 00000100:00100000:1.0:1788541121.574539:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+15:11289:x1875420955850240:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788541121.574614:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a7c6e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541121.574630:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a7c6e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541121.574641:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a7c6e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541121.574706:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a7c75 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541121.574714:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a7c75 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541121.574722:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a7c75 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541121.574751:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da000/0x2aac941e5f4a7c7c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541121.574759:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da000/0x2aac941e5f4a7c7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541121.574765:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da000/0x2aac941e5f4a7c7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788541121.574828:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788541121.574832:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788541121.574849:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da000/0x2aac941e5f4a7c7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541121.574860:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a7c6e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541121.574866:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a7c6e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541121.574891:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a7c6e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541121.574896:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68354db600 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541121.574899:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a7c6e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541121.574905:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a7c6e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541121.574914:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a68350c0d00) 00010000:00010000:1.0:1788541121.574917:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541121.574921:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a7c6e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541121.574926:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a7c6e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541121.574937:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a7c75 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541121.574953:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a7c75 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541121.574959:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a7c75 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541121.574963:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68354dba00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541121.574966:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a7c75 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541121.574972:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a7c75 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.575247:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a7b5d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.575255:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551b400 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541121.575323:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff9a6809c1ca00) 00010000:00010000:1.0:1788541121.575327:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541121.575331:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a7c75 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541121.575338:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a7c75 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541121.575353:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da000/0x2aac941e5f4a7c7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541121.575359:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da000/0x2aac941e5f4a7c7c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541121.575365:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da000/0x2aac941e5f4a7c7c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541121.575370:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68354da000 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541121.575378:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da000/0x2aac941e5f4a7c7c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541121.575384:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da000/0x2aac941e5f4a7c7c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541121.575392:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a6809c1c300) 00010000:00010000:1.0:1788541121.575395:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541121.575397:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da000/0x2aac941e5f4a7c7c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541121.575403:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da000/0x2aac941e5f4a7c7c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541121.575489:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+15:11289:x1875420955850240:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 Request processed in 950us (1063us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541121.575498:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 80 00000100:00100000:2.0:1788541121.577272:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788541121.577293:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6835652680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981102976:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788541121.577359:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1788541121.581093:0:6549:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1788541121.581348:0:6549:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:3.0:1788541121.582465:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a7b5d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.582481:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a7b5d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.582499:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a6809c1c300) 00010000:00010000:3.0:1788541121.582502:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541121.582507:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a7b5d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.582529:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a7b5d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.583170:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a7b80 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.583179:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a7b80 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.583186:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a7b80 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.583191:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075ad400 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541121.583195:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a7b80 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.583202:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a7b80 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.583212:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a6809c1c300) 00010000:00010000:3.0:1788541121.583215:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541121.583218:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a7b80 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.583224:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a7b80 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.583236:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7bc6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.583242:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7bc6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541121.583401:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541121.583444:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955850496 00000100:00100000:1.0:1788541121.583453:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955850496 00000100:00100000:1.0:1788541121.583514:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 81 00000100:00100000:1.0:1788541121.583526:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+13:11289:x1875420955850496:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788541121.583548:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541121.583569:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbc00/0x2aac941e5f4a7c83 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3312a0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541121.583673:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7c8a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541121.583696:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7c8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541121.583706:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7c8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788541121.583718:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788541121.583800:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7c8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541121.583808:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7c8a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541121.583814:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7c8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541121.583818:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68354db800 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541121.583822:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7c8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541121.583828:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7c8a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541121.583849:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a6809c1c300) 00010000:00010000:1.0:1788541121.583852:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788541121.583854:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7c8a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541121.583860:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7c8a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541121.583919:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbc00/0x2aac941e5f4a7c83 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3312a0 expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541121.583935:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a68350c0d00) 00010000:00010000:1.0:1788541121.583938:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788541121.583942:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbc00/0x2aac941e5f4a7c83 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3312a0 expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541121.583952:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68354dbc00, rc 0) 00000100:00100000:1.0:1788541121.584217:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+14:11289:x1875420955850496:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 691us (817us total) trans 4294967353 rc 301/301 00000100:00100000:1.0:1788541121.584225:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 81 00010000:00010000:3.0:1788541121.585149:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7bc6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.585165:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75fc00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541121.585169:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7bc6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.585177:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7bc6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.585191:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a6809c1c300) 00010000:00010000:3.0:1788541121.585194:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541121.585198:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7bc6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.585205:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7bc6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541121.585387:0:8973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981102976 00000100:00100000:2.0:1788541121.585398:0:8973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981102976 00000100:00100000:2.0:1788541121.585467:0:8973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788541121.585476:0:8973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835650380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3644:x1875420981102976:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788541121.585524:0:8973:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:2.0:1788541121.585555:0:8973:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a9af8be, atime: 0x6a9af8be, ctime: 0x6a9af8be, blocks: 0x8 00010000:00010000:2.0:1788541121.585561:0:8973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8dce746/0x2aac941e5f4a7c98 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541121.585575:0:8973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=402s v=(0 0) 00010000:00010000:2.0:1788541121.585585:0:8973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541121.585591:0:8973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8dce746/0x2aac941e5f4a7c98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541121.585608:0:8973:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8dce746/0x2aac941e5f4a7c98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541121.585617:0:8973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8dce746/0x2aac941e5f4a7c98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541121.585624:0:8973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8dce746/0x2aac941e5f4a7c98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541121.585652:0:8973:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788541121.585825:0:8973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835650380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3644:x1875420981102976:12345-0@lo:6:osp-syn-0-0.0 Request processed in 350us (8465us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788541121.585832:0:8973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000004:00080000:2.0:1788541121.585909:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a6835652680/2, rc 0, transno 4294967302 00000100:00100000:2.0:1788541121.585917:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6835652680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981102976:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788541121.586549:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00010000:00010000:0.0:1788541121.586634:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541121.586642:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8dce746/0x2aac941e5f4a7c98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.586652:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842048e00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788541121.586656:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8dce746/0x2aac941e5f4a7c98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.586665:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8dce746/0x2aac941e5f4a7c98 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.586682:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8dce746/0x2aac941e5f4a7c98 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.586689:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8dce746/0x2aac941e5f4a7c98 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.586709:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541121.586710:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541121.586712:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541121.589554:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955850624 00000100:00100000:2.0:1788541121.589571:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955850624 00000100:00100000:2.0:1788541121.589661:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 82 00000100:00100000:2.0:1788541121.589671:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+13:11289:x1875420955850624:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788541121.589708:0:12149:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788541121.589835:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+13:11289:x1875420955850624:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 165us (3287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541121.589855:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 82 00000100:00100000:0.0:1788541121.604122:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541121.604216:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955850880 00000100:00100000:1.0:1788541121.604227:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955850880 00000100:00100000:1.0:1788541121.604284:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 83 00000100:00100000:1.0:1788541121.604294:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+13:11289:x1875420955850880:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788541121.604315:0:9339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541121.604319:0:9339:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788541121.604345:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a7c44 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331292 expref: 13 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541121.604365:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68350c4300) 00010000:00010000:1.0:1788541121.604371:0:9339:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788541121.604385:0:9339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbc00/0x2aac941e5f4a7c9f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3312a7 expref: -99 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788541121.604793:0:9339:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:1.0:1788541121.605161:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7ca6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541121.605175:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7ca6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541121.605186:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7ca6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541121.605242:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbc00/0x2aac941e5f4a7c9f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3312a7 expref: 15 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541121.605259:0:9339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7ca6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3312a7 expref: 14 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541121.605267:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a6809c1ca00) 00010000:00010000:1.0:1788541121.605270:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788541121.605274:0:9339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68354db800, rc 0) 00000100:00100000:1.0:1788541121.605349:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+14:11289:x1875420955850880:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 1056us (1235us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1788541121.605358:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 83 00000100:00100000:2.0:1788541121.617223:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541121.621519:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955851136 00000100:00100000:3.0:1788541121.621536:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955851136 00000100:00100000:0.0:1788541121.621681:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 84 00000100:00100000:0.0:1788541121.621695:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835650e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+14:11289:x1875420955851136:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788541121.621770:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541121.621800:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7ca6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3312a7 expref: 14 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.621820:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a6809c1ca00) 00010000:00010000:0.0:1788541121.621833:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788541121.621860:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a7cb4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.621903:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a7cb4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.621914:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a7cb4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.621929:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7cbb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x2968f262 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.621935:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7cbb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x2968f262 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.621943:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7cbb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x2968f262 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.622114:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a7cb4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.622123:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a7cb4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.622130:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a7cb4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.622142:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75e600 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541121.622146:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a7cb4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.622154:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a7cb4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.622163:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68350c4300) 00010000:00010000:0.0:1788541121.622166:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541121.622170:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a7cb4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.622176:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a7cb4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.622185:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7cbb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x2968f262 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.622190:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7cbb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x2968f262 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.622196:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7cbb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x2968f262 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.622200:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75f200 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541121.622203:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7cbb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x2968f262 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.622209:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7cbb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x2968f262 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.622226:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x2968f262 (ffff9a6809ac0a00) 00010000:00010000:0.0:1788541121.622228:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541121.622231:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7cbb lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x2968f262 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.622238:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7cbb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x2968f262 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541121.622352:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835650e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+13:11289:x1875420955851136:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 661us (5141us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788541121.622359:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 84 00000100:00100000:0.0:1788541121.624718:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541121.634047:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955851264 00000100:00100000:2.0:1788541121.634067:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955851264 00000100:00100000:2.0:1788541121.634149:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 85 00000100:00100000:2.0:1788541121.634160:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+13:11289:x1875420955851264:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788541121.634184:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541121.634209:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048800/0x2aac941e5f4a7cc2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3312ae expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541121.634247:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049e00/0x2aac941e5f4a7cc9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541121.634530:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049e00/0x2aac941e5f4a7cc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541121.634544:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049e00/0x2aac941e5f4a7cc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541121.634655:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048800/0x2aac941e5f4a7cc2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3312ae expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541121.634675:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049e00/0x2aac941e5f4a7cc9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3312ae expref: 14 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541121.634684:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a68350c4100) 00010000:00010000:2.0:1788541121.634687:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788541121.634691:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6842049e00, rc 0) 00000100:00100000:2.0:1788541121.634773:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+14:11289:x1875420955851264:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 615us (10063us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541121.634781:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 85 00000100:00100000:2.0:1788541121.644851:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541121.646200:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955851520 00000100:00100000:3.0:1788541121.646215:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955851520 00000100:00100000:0.0:1788541121.647195:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 86 00000100:00100000:0.0:1788541121.647208:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835653480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+14:11289:x1875420955851520:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788541121.647303:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7cd0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.647322:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7cd0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.647335:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7cd0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788541121.647514:0:9339:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:0.0:1788541121.647525:0:9339:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 402565653205ns, next at 403565650525ns, rc = 0 00000004:00010000:0.0:1788541121.647572:0:9339:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ae6241c5 reply state 00000000c800eda8 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7cd0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.647599:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7cd0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.647607:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a68350c4100) 00010000:00010000:0.0:1788541121.647610:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788541121.647613:0:9339:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788541121.647724:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835653480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+16:11289:x1875420955851520:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 517us (2883us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1788541121.647732:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 86 00000100:00100000:2.0:1788541121.654099:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541121.657724:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955851648 00000100:00100000:3.0:1788541121.657740:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955851648 00000100:00100000:3.0:1788541121.657819:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 87 00000100:00100000:3.0:1788541121.657829:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835651500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+16:11289:x1875420955851648:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788541121.657854:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541121.657889:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a7cd7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3312b5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.657969:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a7cd7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3312b5 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.658095:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a7cd7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3312b5 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.658116:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a68350c4100) 00010000:00010000:3.0:1788541121.658120:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788541121.658123:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075ad400, rc 0) 00000100:00100000:3.0:1788541121.658192:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835651500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+17:11289:x1875420955851648:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 364us (4104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541121.658199:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 87 00000100:00100000:2.0:1788541121.660847:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541121.661131:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955851776 00000100:00100000:3.0:1788541121.661142:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955851776 00000100:00100000:3.0:1788541121.661188:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 33 00000100:00100000:3.0:1788541121.661196:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835653b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2393:x1875420955851776:12345-192.168.202.56@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1788541121.661232:0:8430:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 384f52e3-0481-4979-9299-157aff7472d2@192.168.202.56@tcp t0 exp 0000000000000000 cur 402 last 0 00000020:00000080:3.0:1788541121.661361:0:8430:0:(genops.c:1385:class_connect()) connect: client 384f52e3-0481-4979-9299-157aff7472d2, cookie 0x2aac941e5f4a7cde 00002000:00100000:3.0:1788541121.661374:0:8430:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 384f52e3-0481-4979-9299-157aff7472d2/ffff9a6815c6a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788541121.661391:0:8430:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788541121.661472:0:8430:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788541121.661502:0:8430:0:(import.c:65:import_set_state_nolock()) ffff9a6815c6f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788541121.661958:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835653b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:384f52e3-0481-4979-9299-157aff7472d2+6:2393:x1875420955851776:12345-192.168.202.56@tcp:8:lhsmtool_posix.0 Request processed in 759us (1117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541121.661995:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 33 00000100:00100000:2.0:1788541121.672272:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541121.672546:0:8973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955851904 00000100:00100000:0.0:1788541121.672556:0:8973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955851904 00000100:00100000:0.0:1788541121.672663:0:8973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 34 00000100:00100000:0.0:1788541121.672674:0:8973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835650700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:384f52e3-0481-4979-9299-157aff7472d2+6:0:x1875420955851904:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788541121.674187:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1788541121.693411:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:0.0:1788541121.693444:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 384f52e3-0481-4979-9299-157aff7472d2 00000100:00100000:2.0:1788541121.697093:0:8973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835650700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:384f52e3-0481-4979-9299-157aff7472d2+5:0:x1875420955851904:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 Request processed in 24409us (24829us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788541121.697107:0:8973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 34 00000100:00100000:3.0:1788541121.702636:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541121.702717:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955852160 00000100:00100000:0.0:1788541121.702727:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955852160 00000100:00100000:0.0:1788541121.702789:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 19 00000100:00100000:0.0:1788541121.702800:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+17:11289:x1875420955852160:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788541121.703058:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+18:11289:x1875420955852160:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 259us (431us total) trans 4294967356 rc 0/0 00000100:00100000:0.0:1788541121.703068:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 19 00000100:00100000:0.0:1788541121.715167:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541121.715207:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955852416 00000100:00100000:0.0:1788541121.715219:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955852416 00000100:00100000:0.0:1788541121.715298:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 88 00000100:00100000:0.0:1788541121.715511:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+18:11289:x1875420955852416:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788541121.715608:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+18:11289:x1875420955852416:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 100us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541121.715615:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 88 00000100:00100000:3.0:1788541121.717750:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541121.717788:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955852544 00000100:00100000:3.0:1788541121.717798:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955852544 00000100:00100000:3.0:1788541121.717850:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 89 00000100:00100000:3.0:1788541121.717859:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+18:11289:x1875420955852544:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788541121.717896:0:12149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541121.717918:0:12149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a7ce5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3312bc expref: -99 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.718156:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a7cec lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.718174:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a7cec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.718187:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a7cec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541121.718239:0:12149:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788541121.718690:0:12149:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a7cec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.718724:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a7ce5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3312bc expref: 20 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.718742:0:12149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a7cec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3312bc expref: 19 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.718767:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a68350c4100) 00010000:00010000:3.0:1788541121.718771:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788541121.718775:0:12149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075ada00, rc 0) 00000100:00100000:3.0:1788541121.718848:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+19:11289:x1875420955852544:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 989us (1107us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541121.718857:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 89 00000100:00100000:3.0:1788541121.726765:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541121.726810:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955852672 00000100:00100000:3.0:1788541121.726821:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955852672 00000100:00100000:3.0:1788541121.726903:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 35 00000100:00100000:3.0:1788541121.726914:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683558bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:384f52e3-0481-4979-9299-157aff7472d2+5:2396:x1875420955852672:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788541121.726935:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541121.726959:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf469810/0x2aac941e5f4a7cf3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3312c3 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788541121.726990:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9af8c1, blocks: 0x0 00010000:00010000:3.0:1788541121.727011:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=402s v=(0 0) 00010000:00010000:3.0:1788541121.727016:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541121.727024:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf469810/0x2aac941e5f4a7cf3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3312c3 expref: 6 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.727047:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bf469810/0x2aac941e5f4a7cf3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3312c3 expref: 6 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.727061:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075ac400, rc 0) 00000100:00100000:3.0:1788541121.727128:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683558bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:384f52e3-0481-4979-9299-157aff7472d2+6:2396:x1875420955852672:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 216us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541121.727134:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 35 00000100:00100000:0.0:1788541121.730587:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541121.734113:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955852928 00000100:00100000:3.0:1788541121.734134:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955852928 00000100:00100000:3.0:1788541121.734208:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 90 00000100:00100000:3.0:1788541121.734220:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+19:11289:x1875420955852928:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788541121.734361:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+19:11289:x1875420955852928:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 142us (3786us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541121.734370:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 90 00000100:00100000:3.0:1788541121.738390:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541121.739095:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955853056 00000100:00100000:0.0:1788541121.739108:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955853056 00000100:00100000:0.0:1788541121.739171:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 36 00000100:00100000:0.0:1788541121.739182:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683558b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:384f52e3-0481-4979-9299-157aff7472d2+6:11289:x1875420955853056:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788541121.739203:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541121.739228:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009beddb9a/0x2aac941e5f4a7cfa lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3312ca expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.740101:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf469810/0x2aac941e5f4a7cf3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3312c3 expref: 7 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.740114:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541121.740119:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541121.740125:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009beddb9a/0x2aac941e5f4a7cfa lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3312ca expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.740167:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bf469810/0x2aac941e5f4a7cf3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3312c3 expref: 7 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.740183:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bf469810/0x2aac941e5f4a7cf3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3312c3 expref: 7 pid: 8432 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541121.740214:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670772bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8431:1875420981103104:192.168.202.56@tcp:104: 00000100:00100000:0.0:1788541121.741144:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6835519c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788541121.754132:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541121.754174:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955853184 00000100:00100000:3.0:1788541121.754183:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955853184 00010000:00010000:3.0:1788541121.754230:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bf469810/0x2aac941e5f4a7cf3 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3312c3 expref: 8 pid: 8432 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541121.754285:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 59 00000100:00100000:3.0:1788541121.754296:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683558ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:384f52e3-0481-4979-9299-157aff7472d2+8:2397:x1875420955853184:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541121.754314:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541121.754341:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bf469810/0x2aac941e5f4a7cf3 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3312c3 expref: 8 pid: 8432 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.754359:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bf469810/0x2aac941e5f4a7cf3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3312c3 expref: 8 pid: 8432 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.754407:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541121.754411:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541121.754422:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009beddb9a/0x2aac941e5f4a7cfa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3312ca expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.754431:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009beddb9a/0x2aac941e5f4a7cfa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3312ca expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.754480:0:6504:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009beddb9a/0x2aac941e5f4a7cfa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3312ca expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541121.754496:0:6504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683558a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6504:1875420981103232:192.168.202.56@tcp:105: 00000100:00100000:3.0:1788541121.754582:0:6504:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707871e40 going to sleep for 11 seconds 00010000:00010000:1.0:1788541121.758839:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf469810/0x2aac941e5f4a7cf3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3312c3 expref: 8 pid: 8432 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541121.758891:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670772bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8431:1875420981103104:192.168.202.56@tcp:104: 00010000:00010000:1.0:1788541121.758926:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009beddb9a/0x2aac941e5f4a7cfa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xa16473202a3312ca expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541121.758959:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75e600, rc 0) 00000100:00100000:1.0:1788541121.759037:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683558b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:384f52e3-0481-4979-9299-157aff7472d2+7:11289:x1875420955853056:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 19856us (20655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541121.759045:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 36 00000100:00100000:3.0:1788541121.766364:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541121.767033:0:6504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683558a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6504:1875420981103232:192.168.202.56@tcp:105: 00010000:00010000:1.0:1788541121.767057:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788541121.767114:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683558ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:384f52e3-0481-4979-9299-157aff7472d2+6:2397:x1875420955853184:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 12819us (12992us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541121.767127:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 59 00000100:00100000:1.0:1788541121.767176:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955853312 00000100:00100000:1.0:1788541121.767183:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955853312 00002000:00100000:1.0:1788541121.767227:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9a6835589f80 x1875420955853312/t0(0) o4->384f52e3-0481-4979-9299-157aff7472d2@192.168.202.56@tcp:492/0 lens 504/0 e 0 to 0 dl 1788541132 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788541121.767237:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6835589f80 with x1875420955853312 ext(0->8) 00002000:00010000:1.0:1788541121.767242:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a6835589f80 00000100:00100000:1.0:1788541121.767275:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 0 00000100:00100000:1.0:1788541121.767286:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835589f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:384f52e3-0481-4979-9299-157aff7472d2+6:2396:x1875420955853312:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788541121.768926:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835589f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:384f52e3-0481-4979-9299-157aff7472d2+8:2396:x1875420955853312:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 Request processed in 1633us (2564us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788541121.768938:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 0 00002000:00100000:1.0:1788541121.768948:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9a6835589f80 x1875420955853312/t4294967303(0) o4->384f52e3-0481-4979-9299-157aff7472d2@192.168.202.56@tcp:492/0 lens 504/448 e 0 to 0 dl 1788541132 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788541121.768974:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6835589f80 with x1875420955853312 ext(0->8) 00002000:00010000:1.0:1788541121.769378:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a6835589f80 00000100:00100000:3.0:1788541121.777045:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541121.777166:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955853440 00000100:00100000:0.0:1788541121.777182:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955853440 00000100:00100000:0.0:1788541121.777251:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 91 00000100:00100000:0.0:1788541121.777274:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683558a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+19:11289:x1875420955853440:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788541121.779214:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:3.0:1788541121.779230:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:3.0:1788541121.779252:0:6496:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:1.0:1788541121.779320:0:6549:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1788541121.779334:0:6549:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1788541121.779485:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788541121.779512:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6835652a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981103360:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788541121.779583:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541121.779744:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981103360 00000100:00100000:2.0:1788541121.779754:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981103360 00000100:00100000:2.0:1788541121.779834:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788541121.779845:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981103360:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788541121.780017:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788541121.780021:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788541121 00002000:00010000:2.0:1788541121.780023:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788541121.780026:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788541121 -> 1788541121 00002000:00010000:2.0:1788541121.780028:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1788541121.780080:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3643:x1875420981103360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 237us (495us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788541121.780088:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:2.0:1788541121.780136:0:3643:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a6835652a00/2, rc 0, transno 4294967304 00000100:00100000:2.0:1788541121.780143:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6835652a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981103360:0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1788541121.780261:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788541121.780360:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7cd0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.780372:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7cd0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.780380:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7cd0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.780386:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75f200 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541121.780392:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7cd0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.780400:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7cd0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.780419:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a68350c4100) 00010000:00010000:0.0:1788541121.780422:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788541121.780428:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7cd0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.780444:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7cd0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541121.780703:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683558a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+14:11289:x1875420955853440:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 Request processed in 3439us (3666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541121.780713:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 91 00000100:00100000:3.0:1788541121.783814:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541121.783967:0:8973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955853568 00000100:00100000:2.0:1788541121.783988:0:8973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955853568 00000100:00100000:2.0:1788541121.784061:0:8973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 38 00000100:00100000:2.0:1788541121.784096:0:8973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835588700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:384f52e3-0481-4979-9299-157aff7472d2+8:2397:x1875420955853568:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788541121.785855:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:0.0:1788541121.785898:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:2.0:1788541121.786082:0:8973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835588700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:384f52e3-0481-4979-9299-157aff7472d2+6:2397:x1875420955853568:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 Request processed in 1980us (2270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541121.786096:0:8973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 38 00000100:00100000:2.0:1788541121.788734:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541121.788822:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955853824 00000100:00100000:3.0:1788541121.788833:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955853824 00000100:00100000:3.0:1788541121.788926:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 92 00000100:00100000:3.0:1788541121.788936:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+14:11289:x1875420955853824:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788541121.789012:0:12149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541121.789046:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a7cec lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3312bc expref: 14 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.789088:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a68350c4100) 00010000:00010000:3.0:1788541121.789095:0:12149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788541121.789127:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a7d01 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.789141:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a7d01 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.789152:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a7d01 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788541121.789323:0:12149:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009b3032c8 reply state 000000001e31b1ae transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a7d01 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.789338:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a7d01 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.789345:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a68350c4100) 00010000:00010000:3.0:1788541121.789348:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788541121.789351:0:12149:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788541121.789480:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+15:11289:x1875420955853824:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 544us (758us total) trans 4294967357 rc 0/0 00000100:00100000:3.0:1788541121.789488:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 92 00000100:00100000:3.0:1788541121.792475:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541121.792580:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955853952 00000100:00100000:2.0:1788541121.792592:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955853952 00000100:00100000:2.0:1788541121.792673:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 39 00000100:00100000:2.0:1788541121.792683:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683558b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:384f52e3-0481-4979-9299-157aff7472d2+6:2396:x1875420955853952:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788541121.792909:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788541121.792914:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788541121 -> 1788541120 00002000:00010000:2.0:1788541121.792917:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788541118 00002000:00010000:2.0:1788541121.792919:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788541121 -> 1788541120 00002000:00010000:2.0:1788541121.792921:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788541121.793013:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683558b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:384f52e3-0481-4979-9299-157aff7472d2+7:2396:x1875420955853952:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 Request processed in 330us (583us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788541121.793022:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 39 00000100:00100000:0.0:1788541121.799598:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541121.799813:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955854208 00000100:00100000:2.0:1788541121.799826:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955854208 00000100:00100000:2.0:1788541121.799937:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 93 00000100:00100000:2.0:1788541121.799948:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670772b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+15:11289:x1875420955854208:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788541121.800043:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a7d08 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541121.800061:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049e00/0x2aac941e5f4a7cc9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3312ae expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541121.800095:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a7d08 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541121.800136:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049e00/0x2aac941e5f4a7cc9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3312ae expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541121.800151:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049e00/0x2aac941e5f4a7cc9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3312ae expref: 15 pid: 6519 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541121.800166:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707823b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1875420981103488:192.168.202.56@tcp:104: 00000100:00100000:3.0:1788541121.803444:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6706ab4180 going to sleep for 11 seconds 00000100:00100000:0.0:1788541121.807004:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541121.807809:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707823b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1875420981103488:192.168.202.56@tcp:104: 00010000:00010000:3.0:1788541121.807840:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a7d08 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541121.807905:0:9520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955854336 00000100:00100000:2.0:1788541121.807915:0:9520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955854336 00010000:00010000:2.0:1788541121.807956:0:9520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049e00/0x2aac941e5f4a7cc9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3312ae expref: 16 pid: 6519 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541121.807999:0:9520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 60 00000100:00100000:2.0:1788541121.808009:0:9520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707729500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:384f52e3-0481-4979-9299-157aff7472d2+16:2397:x1875420955854336:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541121.808025:0:9520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541121.808033:0:9520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049e00/0x2aac941e5f4a7cc9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3312ae expref: 16 pid: 6519 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541121.808047:0:9520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049e00/0x2aac941e5f4a7cc9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3312ae expref: 16 pid: 6519 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541121.808071:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049e00/0x2aac941e5f4a7cc9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3312ae expref: 16 pid: 6519 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541121.808100:0:9520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a68350c4100) 00010000:00010000:2.0:1788541121.808105:0:9520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a7d08 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541121.808114:0:9520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a7d08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541121.808123:0:9520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a7d08 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541121.808155:0:9520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541121.808214:0:9520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707729500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:384f52e3-0481-4979-9299-157aff7472d2+15:2397:x1875420955854336:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 206us (1224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541121.808221:0:9520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 60 00010000:00010000:0.0:1788541121.808406:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a7d08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.808416:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a7d08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.808463:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a7d08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.808471:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a7d08 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.808479:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a7d08 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.808485:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842049000 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541121.808489:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a7d08 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.808497:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a7d08 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.808507:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a68350c4100) 00010000:00010000:0.0:1788541121.808517:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788541121.808522:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a7d08 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.808527:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a7d08 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541121.808586:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670772b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+14:11289:x1875420955854208:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 Request processed in 8640us (8997us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788541121.808595:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 93 00000100:00100000:0.0:1788541121.815396:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541121.815468:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955854464 00000100:00100000:1.0:1788541121.815479:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955854464 00000100:00100000:1.0:1788541121.815573:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 40 00000100:00100000:1.0:1788541121.815583:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670772aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:384f52e3-0481-4979-9299-157aff7472d2+7:2395:x1875420955854464:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788541121.815718:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ed3f975b/0x2aac941e5f4a7d0f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541121.815740:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009beddb9a/0x2aac941e5f4a7cfa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xa16473202a3312ca expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541121.815749:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541121.815753:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788541121.815758:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed3f975b/0x2aac941e5f4a7d0f lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541121.815821:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009beddb9a/0x2aac941e5f4a7cfa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xa16473202a3312ca expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541121.815850:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009beddb9a/0x2aac941e5f4a7cfa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a3312ca expref: 7 pid: 8431 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541121.815865:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707884e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8431:1875420981103616:192.168.202.56@tcp:104: 00000100:00100000:0.0:1788541121.816065:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683572b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788541121.819083:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541121.819178:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955854592 00000100:00100000:0.0:1788541121.819181:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707884e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8431:1875420981103616:192.168.202.56@tcp:104: 00000100:00100000:3.0:1788541121.819186:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955854592 00010000:00010000:0.0:1788541121.819209:0:8431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ed3f975b/0x2aac941e5f4a7d0f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.819217:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009beddb9a/0x2aac941e5f4a7cfa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a3312ca expref: 8 pid: 8431 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541121.819252:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 61 00000100:00100000:3.0:1788541121.819261:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707887480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:384f52e3-0481-4979-9299-157aff7472d2+8:2397:x1875420955854592:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541121.819275:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541121.819298:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009beddb9a/0x2aac941e5f4a7cfa lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a3312ca expref: 8 pid: 8431 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.819312:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009beddb9a/0x2aac941e5f4a7cfa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a3312ca expref: 8 pid: 8431 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.819335:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009beddb9a/0x2aac941e5f4a7cfa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a3312ca expref: 8 pid: 8431 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.819353:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788541121.819357:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788541121.819363:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ed3f975b/0x2aac941e5f4a7d0f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.819372:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed3f975b/0x2aac941e5f4a7d0f lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.819523:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541121.819582:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707887480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:384f52e3-0481-4979-9299-157aff7472d2+7:2397:x1875420955854592:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 321us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541121.819590:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 61 00010000:00010000:0.0:1788541121.819978:0:8431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ed3f975b/0x2aac941e5f4a7d0f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.819990:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed3f975b/0x2aac941e5f4a7d0f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.820013:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ed3f975b/0x2aac941e5f4a7d0f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.820023:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed3f975b/0x2aac941e5f4a7d0f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.820044:0:8431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed3f975b/0x2aac941e5f4a7d0f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.820161:0:8431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68354daa00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788541121.820166:0:8431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed3f975b/0x2aac941e5f4a7d0f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.820175:0:8431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed3f975b/0x2aac941e5f4a7d0f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.820192:0:8431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed3f975b/0x2aac941e5f4a7d0f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.820200:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed3f975b/0x2aac941e5f4a7d0f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541121.820266:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670772aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:384f52e3-0481-4979-9299-157aff7472d2+6:2395:x1875420955854464:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 4684us (4877us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541121.820275:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 40 00000100:00100000:1.0:1788541121.823304:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541121.823415:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955854848 00000100:00100000:0.0:1788541121.823424:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955854848 00000100:00100000:0.0:1788541121.823497:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 94 00000100:00100000:0.0:1788541121.823507:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+14:11289:x1875420955854848:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788541121.823589:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7d16 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.823739:0:9339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7b56 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331253 expref: 14 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.823749:0:9339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7d16 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.823785:0:9339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7b56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331253 expref: 14 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.823798:0:9339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7b56 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331253 expref: 14 pid: 6519 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541121.823812:0:9339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707728000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9339:1875420981103744:192.168.202.56@tcp:104: 00000100:00100000:0.0:1788541121.823955:0:9339:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6835519480 going to sleep for 11 seconds 00000100:00100000:1.0:1788541121.828514:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541121.828671:0:9520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955854976 00000100:00100000:2.0:1788541121.828682:0:9520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955854976 00010000:00010000:2.0:1788541121.828734:0:9520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7b56 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331253 expref: 15 pid: 6519 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541121.828782:0:9520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 62 00000100:00100000:2.0:1788541121.828793:0:9520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680763dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:384f52e3-0481-4979-9299-157aff7472d2+15:2396:x1875420955854976:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541121.828813:0:9520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541121.828821:0:9520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7b56 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331253 expref: 15 pid: 6519 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541121.828838:0:9520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7b56 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331253 expref: 15 pid: 6519 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541121.828914:0:9520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a6809c1c300) 00010000:00010000:2.0:1788541121.828921:0:9520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7d16 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541121.828932:0:9520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7d16 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541121.828942:0:9520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7d16 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541121.828963:0:9520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541121.829027:0:9520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680763dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:384f52e3-0481-4979-9299-157aff7472d2+15:2396:x1875420955854976:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 235us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541121.829035:0:9520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 62 00010000:00010000:0.0:1788541121.829376:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7b56 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331253 expref: 14 pid: 6519 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541121.829396:0:9339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707728000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9339:1875420981103744:192.168.202.56@tcp:104: 00010000:00010000:0.0:1788541121.829421:0:9339:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7d16 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.829441:0:9339:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7d16 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.829448:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7d16 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.830764:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7d1d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.830795:0:9339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a7cd7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3312b5 expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.830803:0:9339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7d1d lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.830837:0:9339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a7cd7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3312b5 expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.830852:0:9339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a7cd7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3312b5 expref: 14 pid: 6517 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541121.830866:0:9339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707728000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9339:1875420981103872:192.168.202.56@tcp:104: 00000100:00100000:0.0:1788541121.830964:0:9339:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68355199c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788541121.833155:0:9339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707728000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9339:1875420981103872:192.168.202.56@tcp:104: 00010000:00010000:0.0:1788541121.833183:0:9339:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7d1d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541121.834838:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541121.834943:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955855104 00000100:00100000:3.0:1788541121.834952:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955855104 00010000:00010000:3.0:1788541121.835013:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a7cd7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3312b5 expref: 15 pid: 6517 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541121.835067:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 63 00000100:00100000:3.0:1788541121.835078:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707884700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:384f52e3-0481-4979-9299-157aff7472d2+15:2396:x1875420955855104:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541121.835094:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541121.835102:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a7cd7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3312b5 expref: 15 pid: 6517 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.835115:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a7cd7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3312b5 expref: 15 pid: 6517 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.835139:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a7cd7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3312b5 expref: 15 pid: 6517 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.835158:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a68350c4100) 00010000:00010000:3.0:1788541121.835163:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7d1d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.835172:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7d1d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.835199:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7d1d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541121.835235:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788541121.835286:0:9339:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7d1d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.835296:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7d1d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541121.835324:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707884700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:384f52e3-0481-4979-9299-157aff7472d2+14:2396:x1875420955855104:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 247us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541121.835332:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 63 00000001:00080000:0.0:1788541121.835448:0:9339:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:0.0:1788541121.835585:0:9339:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:0.0:1788541121.836244:0:9339:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:0.0:1788541121.836355:0:9339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707728000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9339:1875420981104000:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788541121.836443:0:9339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541121.836530:0:9339:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6835519540 going to sleep for 11 seconds 00000100:00100000:2.0:1788541121.837674:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981104000 00000100:00100000:2.0:1788541121.837687:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981104000 00000100:00100000:2.0:1788541121.837749:0:10866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788541121.837759:0:10866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707728380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:9339:x1875420981104000:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788541121.838093:0:10866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707728380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:9339:x1875420981104000:12345-0@lo:1000:mdt00_003.0 Request processed in 329us (1653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541121.838102:0:10866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788541121.838234:0:9339:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1788541121.838240:0:9339:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a6835652a00, transno 4294967304 00000100:00100000:3.0:1788541121.838418:0:9339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707728000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9339:1875420981104000:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788541121.838816:0:9339:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:2.0:1788541121.838972:0:9339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707820e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9339:1875420981104128:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788541121.839112:0:9339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541121.839200:0:9339:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6808989480 going to sleep for 11 seconds 00000100:00100000:1.0:1788541121.839249:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981104128 00000100:00100000:1.0:1788541121.839383:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981104128 00000100:00100000:1.0:1788541121.839484:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788541121.839496:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707823b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9339:x1875420981104128:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788541121.839728:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707823b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9339:x1875420981104128:12345-0@lo:1000:mdt00_003.0 Request processed in 234us (614us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788541121.839736:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788541121.839768:0:9339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707820e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9339:1875420981104128:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1788541121.839820:0:9339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7d1d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.839831:0:9339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7d1d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.839839:0:9339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7d1d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.839845:0:9339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75ec00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541121.839850:0:9339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7d1d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.839859:0:9339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7d1d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.839948:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a68350c4100) 00010000:00010000:0.0:1788541121.839952:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788541121.839958:0:9339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7d1d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.839966:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7d1d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.840002:0:9339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a7c4b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.840008:0:9339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a7c4b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.840031:0:9339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a7c4b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.840036:0:9339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075ad000 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541121.840039:0:9339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a7c4b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.840046:0:9339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a7c4b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.840107:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a6809c1c300) 00010000:00010000:0.0:1788541121.840109:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788541121.840111:0:9339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a7c4b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.840115:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a7c4b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.840135:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7d24 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.840147:0:9339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad200/0x2aac941e5f4a7c67 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331299 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.840154:0:9339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7d24 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.840179:0:9339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad200/0x2aac941e5f4a7c67 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331299 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.840199:0:9339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad200/0x2aac941e5f4a7c67 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331299 expref: 17 pid: 6518 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541121.840208:0:9339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670772b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9339:1875420981104256:192.168.202.56@tcp:104: 00000100:00100000:0.0:1788541121.840269:0:9339:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6835519240 going to sleep for 11 seconds 00000100:00100000:0.0:1788541121.844253:0:9339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670772b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9339:1875420981104256:192.168.202.56@tcp:104: 00010000:00010000:0.0:1788541121.844285:0:9339:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7d24 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541121.844706:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541121.844795:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955855232 00000100:00100000:3.0:1788541121.844803:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955855232 00010000:00010000:3.0:1788541121.844841:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad200/0x2aac941e5f4a7c67 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331299 expref: 18 pid: 6518 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541121.844925:0:9520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 64 00000100:00100000:2.0:1788541121.844937:0:9520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707886a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:384f52e3-0481-4979-9299-157aff7472d2+18:2397:x1875420955855232:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541121.844965:0:9520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541121.844972:0:9520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad200/0x2aac941e5f4a7c67 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331299 expref: 18 pid: 6518 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541121.844983:0:9520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad200/0x2aac941e5f4a7c67 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331299 expref: 18 pid: 6518 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541121.845005:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad200/0x2aac941e5f4a7c67 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331299 expref: 18 pid: 6518 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541121.845020:0:9520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a6809c1c300) 00010000:00010000:2.0:1788541121.845025:0:9520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7d24 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541121.845036:0:9520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7d24 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541121.845042:0:9520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7d24 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541121.845071:0:9520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541121.845117:0:9520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707886a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:384f52e3-0481-4979-9299-157aff7472d2+17:2397:x1875420955855232:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 182us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541121.845124:0:9520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 64 00010000:00010000:0.0:1788541121.845261:0:9339:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7d24 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.845269:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7d24 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.845282:0:9339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7d24 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.845288:0:9339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7d24 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.845295:0:9339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7d24 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.845301:0:9339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75fe00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541121.845305:0:9339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7d24 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.845313:0:9339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7d24 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.845331:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a6809c1c300) 00010000:00010000:0.0:1788541121.845333:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541121.845337:0:9339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7d24 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.845343:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7d24 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.845354:0:9339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7d16 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.845360:0:9339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7d16 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.845366:0:9339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7d16 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.845371:0:9339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75f200 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541121.845374:0:9339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7d16 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.845379:0:9339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7d16 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.845387:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a6809c1c300) 00010000:00010000:0.0:1788541121.845389:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788541121.845392:0:9339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7d16 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.845398:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7d16 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541121.845569:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707885500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+16:11289:x1875420955854848:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 22062us (22278us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1788541121.845577:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 94 00000020:00080000:0.0:1788541121.845581:0:9339:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788541121.845750:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788541121.845755:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788541121.845772:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788541121.845778:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788541121.848775:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541121.848928:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955855488 00000100:00100000:0.0:1788541121.848939:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955855488 00000100:00100000:0.0:1788541121.848986:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 20 00000100:00100000:0.0:1788541121.848996:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707884000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+16:11289:x1875420955855488:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788541121.849921:0:6521:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788541121.849955:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:0.0:1788541121.849989:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7d2b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.850013:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7d2b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.850026:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7d2b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.850035:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7d2b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.850042:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7d2b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.850047:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7d2b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541121.850149:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788541121.850177:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541121.850184:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7d2b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541121.850190:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75ee00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:2.0:1788541121.850200:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7d2b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541121.850208:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7d2b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541121.850222:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a68350c4100) 00010000:00010000:2.0:1788541121.850225:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788541121.850229:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7d2b lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541121.850235:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7d2b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541121.850246:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541121.850248:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541121.850250:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541121.850271:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707884000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+18:11289:x1875420955855488:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 1274us (1504us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1788541121.850282:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 20 00000020:00080000:0.0:1788541121.850287:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788541121.994376:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707885880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981104384:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788541121.994493:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541121.995154:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981104384 00000100:00100000:2.0:1788541121.995164:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981104384 00000100:00100000:2.0:1788541121.995225:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788541121.995236:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670772b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981104384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788541121.995271:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1788541122.003518:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670772b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981104384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 8264us (9005us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541122.003537:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788541122.013352:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707885880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981104384:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788541122.124557:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541123.019170:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981104512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788541123.019238:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541123.019398:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981104512 00000100:00100000:1.0:1788541123.019407:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981104512 00000100:00100000:1.0:1788541123.019478:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788541123.019487:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707729880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1875420981104512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788541123.019523:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:1.0:1788541123.019571:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707729880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1875420981104512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541123.019579:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788541123.019645:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981104512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788541123.019777:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788541123.019787:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981104640:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788541123.019815:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788541123.020047:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788541123.020059:0:14072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981104640 00000100:00100000:0.0:1788541123.020063:0:14072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981104640 00000100:00100000:0.0:1788541123.020107:0:14072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788541123.020114:0:14072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835652a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981104640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788541123.020124:0:14072:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:0.0:1788541123.020157:0:14072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835652a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981104640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541123.020164:0:14072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788541123.020195:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981104640:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788541123.020323:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788541123.021191:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875420981105152:0@lo:400:kworker.0 00000100:00100000:1.0:1788541123.021237:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541123.021287:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981105664:0@lo:400:kworker.0 00000100:00100000:1.0:1788541123.021312:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541123.021334:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788541123.021339:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6835652d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420981104768:0@lo:400:kworker.0 00000100:00100000:1.0:1788541123.021366:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541123.021385:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981105280:0@lo:400:kworker.0 00000100:00100000:1.0:1788541123.021408:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541123.021435:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981105792:0@lo:400:kworker.0 00000100:00100000:1.0:1788541123.021457:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541123.021488:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981105152 00000100:00100000:1.0:1788541123.021494:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981105152 00000100:00100000:1.0:1788541123.021534:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1788541123.021542:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875420981105152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541123.021585:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875420981105152:12345-0@lo:400:kworker.0 Request processed in 43us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541123.021592:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1788541123.021613:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981105664 00000100:00100000:1.0:1788541123.021623:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981105664 00000100:00100000:1.0:1788541123.021656:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981105792 00000100:00100000:1.0:1788541123.021659:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981105792 00000100:00100000:1.0:1788541123.021680:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788541123.021686:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707887800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981105664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541123.021717:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707887800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981105664:12345-0@lo:400:kworker.0 Request processed in 31us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541123.021723:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788541123.021734:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788541123.021740:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3643:x1875420981105792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541123.021765:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3643:x1875420981105792:12345-0@lo:400:kworker.0 Request processed in 25us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541123.021770:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788541123.021787:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981104768 00000100:00100000:1.0:1788541123.021790:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981104768 00000100:00100000:1.0:1788541123.021816:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1788541123.021823:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e78a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+24:3643:x1875420981104768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541123.021851:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e78a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+24:3643:x1875420981104768:12345-0@lo:400:kworker.0 Request processed in 29us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541123.021857:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1788541123.021902:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981105280 00000100:00100000:1.0:1788541123.021906:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981105280 00000100:00100000:1.0:1788541123.021930:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788541123.021937:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981105280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541123.021985:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981105280:12345-0@lo:400:kworker.0 Request processed in 49us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541123.021992:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:1.0:1788541123.022030:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788541123.022042:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981105024:0@lo:400:kworker.0 00000100:00100000:1.0:1788541123.022068:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541123.022095:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875420981105536:0@lo:400:kworker.0 00000100:00100000:1.0:1788541123.022116:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541123.022134:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875420981106048:0@lo:400:kworker.0 00000100:00100000:1.0:1788541123.022155:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541123.022175:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788541123.022180:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6835651180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875420981104896:0@lo:400:kworker.0 00000100:00100000:1.0:1788541123.022199:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541123.022213:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875420981105408:0@lo:400:kworker.0 00000100:00100000:1.0:1788541123.022230:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541123.022244:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875420981105920:0@lo:400:kworker.0 00000100:00100000:1.0:1788541123.022264:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541123.022287:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981105536 00000100:00100000:1.0:1788541123.022290:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981105536 00000100:00100000:1.0:1788541123.022311:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981106048 00000100:00100000:1.0:1788541123.022314:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981106048 00000100:00100000:1.0:1788541123.022324:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981104896 00000100:00100000:1.0:1788541123.022326:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981104896 00000100:00100000:1.0:1788541123.022334:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981105408 00000100:00100000:1.0:1788541123.022336:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981105408 00000100:00100000:1.0:1788541123.022346:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981105920 00000100:00100000:1.0:1788541123.022348:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981105920 00000100:00100000:1.0:1788541123.022375:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1788541123.022382:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875420981105536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541123.022412:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875420981105536:12345-0@lo:400:kworker.0 Request processed in 31us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541123.022440:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1788541123.022453:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1788541123.022458:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707885c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875420981106048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541123.022483:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707885c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875420981106048:12345-0@lo:400:kworker.0 Request processed in 26us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541123.022488:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1788541123.022498:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1788541123.022503:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707885180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875420981104896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541123.022528:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707885180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875420981104896:12345-0@lo:400:kworker.0 Request processed in 25us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541123.022533:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1788541123.022544:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1788541123.022550:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875420981105408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541123.022574:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707884a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875420981105408:12345-0@lo:400:kworker.0 Request processed in 25us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541123.022580:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1788541123.022592:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1788541123.022597:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875420981105920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541123.022621:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707886680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875420981105920:12345-0@lo:400:kworker.0 Request processed in 24us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541123.022627:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00080000:1.0:1788541123.022644:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788541123.022647:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788541123.022672:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6835652d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420981104768:0@lo:400:kworker.0 00000100:00100000:1.0:1788541123.022693:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981105280:0@lo:400:kworker.0 00000100:00100000:1.0:1788541123.022705:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981105792:0@lo:400:kworker.0 00000100:00100000:1.0:1788541123.022714:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875420981105152:0@lo:400:kworker.0 00000100:00100000:1.0:1788541123.022723:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981105664:0@lo:400:kworker.0 00000100:00100000:1.0:1788541123.022758:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6835651180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875420981104896:0@lo:400:kworker.0 00000100:00100000:1.0:1788541123.022766:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875420981105408:0@lo:400:kworker.0 00000100:00100000:1.0:1788541123.022773:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875420981105920:0@lo:400:kworker.0 00010000:00080000:1.0:1788541123.022785:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670831e300 x1875420981105536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541123.022795:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875420981105536:0@lo:400:kworker.0 00010000:00080000:1.0:1788541123.022803:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670831d180 x1875420981106048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541123.022811:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875420981106048:0@lo:400:kworker.0 00000100:00100000:2.0:1788541123.023524:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981105024 00000100:00100000:2.0:1788541123.023533:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981105024 00000100:00100000:1.0:1788541123.023641:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788541123.023650:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707885f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981105024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541123.023717:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707885f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981105024:12345-0@lo:400:kworker.0 Request processed in 69us (1648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541123.023724:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788541123.023797:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981105024:0@lo:400:kworker.0 00010000:00010000:3.0:1788541123.146361:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788541123.482486:0:14260:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788541123.482495:0:14260:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788541123.482520:0:14260:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788541123.482526:0:14260:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788541123.626438:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541123.626520:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955855744 00000100:00100000:1.0:1788541123.626530:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955855744 00000100:00100000:1.0:1788541123.626605:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 95 00000100:00100000:1.0:1788541123.626627:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683558ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+18:11308:x1875420955855744:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1788541123.626652:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541123.626672:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a7d32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3312d1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541123.626779:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da000/0x2aac941e5f4a7d39 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541123.626794:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da000/0x2aac941e5f4a7d39 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541123.626806:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da000/0x2aac941e5f4a7d39 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788541123.626816:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788541123.626942:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a7d32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3312d1 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541123.626960:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da000/0x2aac941e5f4a7d39 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3312d1 expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541123.626979:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68350c4300) 00010000:00010000:1.0:1788541123.626983:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788541123.626986:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68354da000, rc 0) 00000100:00100000:1.0:1788541123.627043:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683558ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+20:11308:x1875420955855744:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 417us (625us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1788541123.627051:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 95 00000100:00080000:3.0:1788541123.628134:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788541123.638374:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541123.638409:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955855872 00000100:00100000:1.0:1788541123.638436:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955855872 00000100:00100000:1.0:1788541123.638500:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 96 00000100:00100000:1.0:1788541123.638510:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+20:11308:x1875420955855872:12345-192.168.202.56@tcp:34:lfs.0 00010000:00010000:1.0:1788541123.638589:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354daa00/0x2aac941e5f4a7d47 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541123.638679:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354daa00/0x2aac941e5f4a7d47 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541123.638695:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354daa00/0x2aac941e5f4a7d47 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541123.638785:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbc00/0x2aac941e5f4a7d4e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541123.638794:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbc00/0x2aac941e5f4a7d4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541123.638802:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbc00/0x2aac941e5f4a7d4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541123.639045:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a7d55 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541123.639055:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a7d55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541123.639062:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a7d55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788541123.639116:0:12149:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a7d55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541123.639142:0:12149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354daa00/0x2aac941e5f4a7d47 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541123.639148:0:12149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354daa00/0x2aac941e5f4a7d47 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541123.639155:0:12149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354daa00/0x2aac941e5f4a7d47 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541123.639160:0:12149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68354daa00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541123.639165:0:12149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354daa00/0x2aac941e5f4a7d47 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541123.639171:0:12149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354daa00/0x2aac941e5f4a7d47 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541123.639184:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68350c4300) 00010000:00010000:1.0:1788541123.639187:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541123.639192:0:12149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354daa00/0x2aac941e5f4a7d47 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541123.639199:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354daa00/0x2aac941e5f4a7d47 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541123.639210:0:12149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbc00/0x2aac941e5f4a7d4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541123.641578:0:12149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbc00/0x2aac941e5f4a7d4e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541123.641584:0:12149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbc00/0x2aac941e5f4a7d4e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541123.641599:0:12149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68354dbc00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541123.641612:0:12149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbc00/0x2aac941e5f4a7d4e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541123.641619:0:12149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbc00/0x2aac941e5f4a7d4e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541123.641632:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a6809c1cd00) 00010000:00010000:1.0:1788541123.641634:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541123.641638:0:12149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbc00/0x2aac941e5f4a7d4e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541123.641643:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbc00/0x2aac941e5f4a7d4e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541123.641660:0:12149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a7d55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541123.641663:0:12149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a7d55 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541123.641667:0:12149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a7d55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541123.641670:0:12149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68354dba00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541123.641672:0:12149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a7d55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541123.641675:0:12149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a7d55 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541123.641687:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a6809c1c600) 00010000:00010000:1.0:1788541123.641688:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541123.641690:0:12149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a7d55 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541123.641694:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a7d55 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541123.641783:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+20:11308:x1875420955855872:12345-192.168.202.56@tcp:34:lfs.0 Request processed in 3272us (3414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541123.641790:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 96 00000100:00100000:0.0:1788541123.695409:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541123.697836:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955856128 00000100:00100000:2.0:1788541123.697852:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955856128 00000100:00100000:2.0:1788541123.698477:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 97 00000100:00100000:2.0:1788541123.698501:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670772a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+20:11311:x1875420955856128:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1788541123.698525:0:9339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541123.698548:0:9339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048600/0x2aac941e5f4a7d5c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3312d8 expref: -99 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.698641:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048800/0x2aac941e5f4a7d63 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.698657:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048800/0x2aac941e5f4a7d63 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.698669:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048800/0x2aac941e5f4a7d63 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.698684:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a7d6a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.698691:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a7d6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.698699:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a7d6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.699857:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048e00/0x2aac941e5f4a7d71 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.699893:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048e00/0x2aac941e5f4a7d71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.699917:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048e00/0x2aac941e5f4a7d71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541123.699929:0:9339:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1788541123.700005:0:9339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048800/0x2aac941e5f4a7d63 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.700014:0:9339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048800/0x2aac941e5f4a7d63 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.700021:0:9339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048800/0x2aac941e5f4a7d63 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.700028:0:9339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842048800 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:2.0:1788541123.700033:0:9339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048800/0x2aac941e5f4a7d63 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.700040:0:9339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048800/0x2aac941e5f4a7d63 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.700053:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68350c4300) 00010000:00010000:2.0:1788541123.700057:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541123.700062:0:9339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048800/0x2aac941e5f4a7d63 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.700069:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048800/0x2aac941e5f4a7d63 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.700080:0:9339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a7d6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.700086:0:9339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a7d6a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.700098:0:9339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a7d6a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.700104:0:9339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842049000 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:2.0:1788541123.700107:0:9339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a7d6a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.700113:0:9339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a7d6a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.700122:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a68350c0500) 00010000:00010000:2.0:1788541123.700125:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541123.700128:0:9339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a7d6a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.700134:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a7d6a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.700178:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048600/0x2aac941e5f4a7d5c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3312d8 expref: 23 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.700193:0:9339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048e00/0x2aac941e5f4a7d71 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3312d8 expref: 22 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.700200:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a68350c0100) 00010000:00010000:2.0:1788541123.700203:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788541123.700205:0:9339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6842048e00, rc 0) 00000100:00100000:2.0:1788541123.700275:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670772a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+22:11311:x1875420955856128:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1787us (4876us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1788541123.700675:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 97 00000100:00100000:2.0:1788541123.724906:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541123.724976:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955856256 00000100:00100000:2.0:1788541123.724988:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955856256 00000100:00100000:2.0:1788541123.725051:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 98 00000100:00100000:2.0:1788541123.725061:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+22:11311:x1875420955856256:12345-192.168.202.56@tcp:54:lfs.0 00010000:00010000:2.0:1788541123.725136:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048600/0x2aac941e5f4a7d7f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.725156:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048600/0x2aac941e5f4a7d7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.725169:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048600/0x2aac941e5f4a7d7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.725204:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048600/0x2aac941e5f4a7d7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.725212:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048600/0x2aac941e5f4a7d7f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.725218:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048600/0x2aac941e5f4a7d7f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.725223:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842048600 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:2.0:1788541123.725227:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048600/0x2aac941e5f4a7d7f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.725234:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048600/0x2aac941e5f4a7d7f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.725258:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a68350c0100) 00010000:00010000:2.0:1788541123.725260:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788541123.725266:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048600/0x2aac941e5f4a7d7f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.725273:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048600/0x2aac941e5f4a7d7f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541123.738121:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+22:11311:x1875420955856256:12345-192.168.202.56@tcp:54:lfs.0 Request processed in 13051us (14194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541123.738137:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 98 00000100:00100000:2.0:1788541123.756158:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541123.756585:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955856512 00000100:00100000:0.0:1788541123.756785:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955856512 00000100:00100000:0.0:1788541123.756843:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 21 00000100:00100000:0.0:1788541123.756854:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6811403450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+22:11311:x1875420955856512:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:0.0:1788541123.757232:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6811403450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+23:11311:x1875420955856512:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 379us (1084us total) trans 4294967367 rc 0/0 00000100:00100000:0.0:1788541123.757241:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 21 00000100:00100000:2.0:1788541123.827806:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541123.828140:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955856768 00000100:00100000:1.0:1788541123.828151:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955856768 00000100:00100000:2.0:1788541123.828680:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 99 00000100:00100000:2.0:1788541123.828691:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+23:10829:x1875420955856768:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:2.0:1788541123.828719:0:12149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541123.828741:0:12149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048800/0x2aac941e5f4a7d86 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3312df expref: -99 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.829755:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049e00/0x2aac941e5f4a7d8d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.829775:0:12149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048e00/0x2aac941e5f4a7d71 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3312d8 expref: 24 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.829784:0:12149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049e00/0x2aac941e5f4a7d8d lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.830899:0:12149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048e00/0x2aac941e5f4a7d71 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3312d8 expref: 24 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.830916:0:12149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048e00/0x2aac941e5f4a7d71 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3312d8 expref: 24 pid: 9339 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541123.830931:0:12149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831c380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12149:1875420981106176:192.168.202.56@tcp:104: 00000100:00100000:2.0:1788541123.831094:0:12149:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a680529c780 going to sleep for 11 seconds 00000100:00100000:2.0:1788541123.841693:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541123.841787:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955856896 00000100:00100000:3.0:1788541123.841798:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955856896 00010000:00010000:3.0:1788541123.841852:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048e00/0x2aac941e5f4a7d71 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3312d8 expref: 25 pid: 9339 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541123.841945:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 65 00000100:00100000:3.0:1788541123.841957:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:384f52e3-0481-4979-9299-157aff7472d2+25:2396:x1875420955856896:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541123.841973:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541123.841993:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048e00/0x2aac941e5f4a7d71 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3312d8 expref: 25 pid: 9339 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541123.842008:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048e00/0x2aac941e5f4a7d71 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3312d8 expref: 25 pid: 9339 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541123.842034:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a68350c0100) 00010000:00010000:3.0:1788541123.842039:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049e00/0x2aac941e5f4a7d8d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541123.842050:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049e00/0x2aac941e5f4a7d8d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541123.842057:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049e00/0x2aac941e5f4a7d8d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541123.842075:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541123.842128:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:384f52e3-0481-4979-9299-157aff7472d2+25:2396:x1875420955856896:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 173us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541123.842136:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 65 00010000:00010000:1.0:1788541123.843854:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048e00/0x2aac941e5f4a7d71 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3312d8 expref: 24 pid: 9339 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541123.843896:0:12149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831c380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12149:1875420981106176:192.168.202.56@tcp:104: 00010000:00010000:1.0:1788541123.843922:0:12149:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049e00/0x2aac941e5f4a7d8d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541123.843933:0:12149:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049e00/0x2aac941e5f4a7d8d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541123.843940:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049e00/0x2aac941e5f4a7d8d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788541123.843963:0:12149:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788541123.844106:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048800/0x2aac941e5f4a7d86 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3312df expref: 25 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541123.844141:0:12149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049e00/0x2aac941e5f4a7d8d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3312df expref: 24 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541123.844153:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a68350c0100) 00010000:00010000:1.0:1788541123.844157:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788541123.844161:0:12149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6842049e00, rc 0) 00000100:00100000:1.0:1788541123.844492:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+24:10829:x1875420955856768:12345-192.168.202.56@tcp:101:bash.0 Request processed in 15801us (16707us total) trans 4294967368 rc 0/0 00000100:00100000:1.0:1788541123.844501:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 99 00000100:00100000:2.0:1788541123.850162:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541123.851121:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955857024 00000100:00100000:0.0:1788541123.851133:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955857024 00000100:00100000:1.0:1788541123.851507:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 100 00000100:00100000:1.0:1788541123.851518:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+24:10829:x1875420955857024:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:1.0:1788541123.851544:0:9339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541123.851567:0:9339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a7d9b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3312e6 expref: -99 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541123.851603:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbc00/0x2aac941e5f4a7da2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541123.851619:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbc00/0x2aac941e5f4a7da2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541123.851631:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbc00/0x2aac941e5f4a7da2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541123.851764:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a7d9b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3312e6 expref: 26 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541123.851810:0:9339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbc00/0x2aac941e5f4a7da2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3312e6 expref: 25 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541123.851819:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a68350c0100) 00010000:00010000:1.0:1788541123.851823:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788541123.851827:0:9339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68354dbc00, rc 0) 00000100:00100000:1.0:1788541123.852045:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+25:10829:x1875420955857024:12345-192.168.202.56@tcp:101:bash.0 Request processed in 527us (1891us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541123.852053:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 100 00000100:00100000:1.0:1788541123.864378:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541123.864698:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955857280 00000100:00100000:2.0:1788541123.864780:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955857280 00000100:00100000:2.0:1788541123.864844:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 101 00000100:00100000:2.0:1788541123.864855:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707884000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+25:10829:x1875420955857280:12345-192.168.202.56@tcp:36:bash.0 00010000:00010000:2.0:1788541123.865121:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a7da9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.865140:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a7da9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.865152:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a7da9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788541123.865194:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:2.0:1788541123.865217:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ae1ca7fb reply state 000000008616409d transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a7da9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.865230:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a7da9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.865774:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a68350c0100) 00010000:00010000:2.0:1788541123.865777:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788541123.865781:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788541123.865829:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:2.0:1788541123.866081:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707884000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+29:10829:x1875420955857280:12345-192.168.202.56@tcp:36:bash.0 Request processed in 1224us (1707us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1788541123.866089:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 101 00000020:00080000:2.0:1788541123.866093:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788541123.868595:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541123.868759:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955857408 00000100:00100000:2.0:1788541123.868769:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955857408 00000100:00100000:2.0:1788541123.868830:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 102 00000100:00100000:2.0:1788541123.868840:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+29:10829:x1875420955857408:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:2.0:1788541123.868864:0:12149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541123.869115:0:12149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048800/0x2aac941e5f4a7db0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3312ed expref: -99 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.869175:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048800/0x2aac941e5f4a7db0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3312ed expref: 30 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.869190:0:12149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048800/0x2aac941e5f4a7db0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3312ed expref: 30 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541123.869207:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a68350c0100) 00010000:00010000:2.0:1788541123.869210:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788541123.869213:0:12149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6842048800, rc 0) 00000100:00100000:2.0:1788541123.869284:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707885880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+30:10829:x1875420955857408:12345-192.168.202.56@tcp:101:bash.0 Request processed in 445us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541123.869510:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 102 00000100:00100000:3.0:1788541123.875269:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541123.875706:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955857536 00000100:00100000:1.0:1788541123.876006:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955857536 00000100:00100000:1.0:1788541123.876100:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 41 00000100:00100000:1.0:1788541123.876110:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835588000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:384f52e3-0481-4979-9299-157aff7472d2+6:10829:x1875420955857536:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:1.0:1788541123.876128:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541123.876150:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de5a30ec/0x2aac941e5f4a7db7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3312f4 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788541123.876178:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9af8c0, atime: 0x6a9af8be, ctime: 0x6a9af8c0, blocks: 0x8 00010000:00010000:1.0:1788541123.876201:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=404s v=(0 0) 00010000:00010000:1.0:1788541123.876206:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541123.876215:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de5a30ec/0x2aac941e5f4a7db7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3312f4 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541123.876255:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000de5a30ec/0x2aac941e5f4a7db7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3312f4 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541123.876269:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68354dbe00, rc 0) 00000100:00080000:3.0:1788541123.876791:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788541123.877061:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835588000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:384f52e3-0481-4979-9299-157aff7472d2+7:10829:x1875420955857536:12345-192.168.202.56@tcp:101:bash.0 Request processed in 950us (1800us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541123.877071:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 41 00000100:00100000:1.0:1788541123.883669:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541123.883785:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955857664 00000100:00100000:3.0:1788541123.883799:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955857664 00002000:00010000:3.0:1788541123.883850:0:8435:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:3.0:1788541123.883856:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6707887480 with x1875420955857664 ext(0->18446744073709551615) 00002000:00010000:3.0:1788541123.883907:0:8435:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a6707887480. 00000100:00100000:3.0:1788541123.883940:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1 00000100:00100000:3.0:1788541123.883951:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707887480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:384f52e3-0481-4979-9299-157aff7472d2+7:2394:x1875420955857664:12345-192.168.202.56@tcp:10:bash.0 00002000:00010000:3.0:1788541123.884301:0:8435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788541123.884305:0:8435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788541120 -> 1788541123 00002000:00010000:3.0:1788541123.884307:0:8435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1788541118 -> 1788541118 00002000:00010000:3.0:1788541123.884309:0:8435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788541120 -> 1788541123 00002000:00010000:3.0:1788541123.884311:0:8435:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1788541123.884389:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707887480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:384f52e3-0481-4979-9299-157aff7472d2+8:2394:x1875420955857664:12345-192.168.202.56@tcp:10:bash.0 Request processed in 439us (730us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788541123.884398:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1 00002000:00010000:3.0:1788541123.884402:0:8435:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:3.0:1788541123.884405:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6707887480 with x1875420955857664 ext(0->18446744073709551615) 00002000:00010000:3.0:1788541123.884410:0:8435:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a6707887480. 00000100:00100000:2.0:1788541123.983059:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541123.990484:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955857792 00000100:00100000:0.0:1788541123.990569:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955857792 00000100:00100000:0.0:1788541123.990652:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 103 00000100:00100000:0.0:1788541123.990664:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+30:11325:x1875420955857792:12345-192.168.202.56@tcp:34:lfs.0 00010000:00010000:0.0:1788541123.994545:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7dbe lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541123.994575:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7dbe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541123.994588:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7dbe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541123.994628:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7dc5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541123.994635:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7dc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541123.994640:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7dc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541123.994745:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7dcc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541123.994753:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7dcc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541123.994759:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7dcc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788541123.994806:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7dcc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541123.994831:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7dbe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541123.994838:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7dbe lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541123.994846:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7dbe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541123.994851:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75fe00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541123.994861:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7dbe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541123.994887:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7dbe lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541123.994900:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68350c4300) 00010000:00010000:0.0:1788541123.994903:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541123.994908:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7dbe lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541123.994921:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7dbe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541123.994936:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7dc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541123.994941:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7dc5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541123.994946:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7dc5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541123.994951:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75f200 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541123.994954:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7dc5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541123.994960:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7dc5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541123.994967:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a67078a1400) 00010000:00010000:0.0:1788541123.994969:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541123.994972:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7dc5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541123.994978:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7dc5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541123.994992:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7dcc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541123.994998:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7dcc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541123.995009:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7dcc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541123.995013:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75ee00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541123.995016:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7dcc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541123.995022:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7dcc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541123.995029:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a68350c0100) 00010000:00010000:0.0:1788541123.995031:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541123.995034:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7dcc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541123.995041:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7dcc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541123.995126:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+30:11325:x1875420955857792:12345-192.168.202.56@tcp:34:lfs.0 Request processed in 4461us (12074us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541123.995135:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 103 00000001:00080000:2.0:1788541124.054086:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:2.0:1788541124.054103:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000100:00100000:2.0:1788541124.064842:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541124.065048:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955858048 00000100:00100000:0.0:1788541124.065057:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955858048 00000100:00100000:0.0:1788541124.065133:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 104 00000100:00100000:0.0:1788541124.065143:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+30:11328:x1875420955858048:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1788541124.065167:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541124.065188:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7dd3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3312fb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.065279:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7dda lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.065302:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7dda lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.065312:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7dda lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.065328:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7de1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.065335:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7de1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.065340:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7de1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.065445:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a7de8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.065453:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a7de8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.065460:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a7de8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541124.065471:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788541124.065547:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7dda lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.065554:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7dda lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.065566:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7dda lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.065572:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75f200 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541124.065576:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7dda lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.065585:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7dda lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.065601:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68350c4300) 00010000:00010000:0.0:1788541124.065604:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541124.065609:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7dda lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.065615:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7dda lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.065629:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7de1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.065635:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7de1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.065642:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7de1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.065647:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75fe00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541124.065650:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7de1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.065671:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7de1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.065682:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a67078a1400) 00010000:00010000:0.0:1788541124.065684:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541124.065687:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7de1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.065692:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7de1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.065731:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7dd3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3312fb expref: 33 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.065744:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a7de8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3312fb expref: 32 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.065752:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a68350c0100) 00010000:00010000:0.0:1788541124.065754:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788541124.065756:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75e600, rc 0) 00000100:00100000:0.0:1788541124.065831:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+32:11328:x1875420955858048:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 689us (997us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1788541124.065838:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 104 00000100:00100000:1.0:1788541124.070605:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541124.070710:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955858176 00000100:00100000:2.0:1788541124.070721:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955858176 00000100:00100000:2.0:1788541124.070786:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 105 00000100:00100000:2.0:1788541124.070795:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+32:11328:x1875420955858176:12345-192.168.202.56@tcp:54:lfs.0 00010000:00010000:2.0:1788541124.070902:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048600/0x2aac941e5f4a7df6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.070920:0:12149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049e00/0x2aac941e5f4a7d8d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3312df expref: 32 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.070929:0:12149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048600/0x2aac941e5f4a7df6 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.070962:0:12149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049e00/0x2aac941e5f4a7d8d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3312df expref: 32 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.070976:0:12149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049e00/0x2aac941e5f4a7d8d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3312df expref: 32 pid: 12149 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541124.070992:0:12149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12149:1875420981106304:192.168.202.56@tcp:104: 00000100:00100000:2.0:1788541124.071095:0:12149:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a680529ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1788541124.075564:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541124.075681:0:12149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12149:1875420981106304:192.168.202.56@tcp:104: 00010000:00010000:2.0:1788541124.075711:0:12149:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048600/0x2aac941e5f4a7df6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541124.076185:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955858432 00000100:00100000:0.0:1788541124.076194:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955858432 00000100:00100000:0.0:1788541124.076257:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 22 00000100:00100000:0.0:1788541124.076267:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68052e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+33:9914:x1875420955858432:12345-192.168.202.56@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788541124.076733:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68052e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+34:9914:x1875420955858432:12345-192.168.202.56@tcp:35:ldlm_bl.0 Request processed in 465us (1176us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1788541124.076741:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 22 00000100:00100000:3.0:1788541124.080748:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541124.081093:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955858560 00000100:00100000:2.0:1788541124.081104:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955858560 00010000:00010000:2.0:1788541124.081145:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049e00/0x2aac941e5f4a7d8d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3312df expref: 34 pid: 12149 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541124.081248:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 66 00000100:00100000:2.0:1788541124.081259:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68052e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:384f52e3-0481-4979-9299-157aff7472d2+34:2397:x1875420955858560:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541124.081277:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541124.081286:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049e00/0x2aac941e5f4a7d8d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3312df expref: 34 pid: 12149 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.081299:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049e00/0x2aac941e5f4a7d8d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3312df expref: 34 pid: 12149 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.081321:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049e00/0x2aac941e5f4a7d8d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3312df expref: 34 pid: 12149 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.081339:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a68350c0100) 00010000:00010000:2.0:1788541124.081344:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048600/0x2aac941e5f4a7df6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.081354:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048600/0x2aac941e5f4a7df6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.081363:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048600/0x2aac941e5f4a7df6 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.081420:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541124.081478:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68052e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:384f52e3-0481-4979-9299-157aff7472d2+33:2397:x1875420955858560:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 221us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541124.081486:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 66 00010000:00010000:1.0:1788541124.081550:0:12149:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048600/0x2aac941e5f4a7df6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.081558:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048600/0x2aac941e5f4a7df6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.081596:0:12149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048600/0x2aac941e5f4a7df6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.081604:0:12149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048600/0x2aac941e5f4a7df6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.081611:0:12149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048600/0x2aac941e5f4a7df6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.081616:0:12149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842048600 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541124.081620:0:12149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048600/0x2aac941e5f4a7df6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.081638:0:12149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048600/0x2aac941e5f4a7df6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.081648:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a68350c0100) 00010000:00010000:1.0:1788541124.081651:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788541124.081655:0:12149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048600/0x2aac941e5f4a7df6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.081661:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048600/0x2aac941e5f4a7df6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541124.081700:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707884e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+32:11328:x1875420955858176:12345-192.168.202.56@tcp:54:lfs.0 Request processed in 10906us (11108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541124.081708:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 105 00000100:00100000:1.0:1788541124.084753:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541124.084828:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955858816 00000100:00100000:2.0:1788541124.084837:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955858816 00000100:00100000:2.0:1788541124.085097:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 23 00000100:00100000:2.0:1788541124.085108:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835651f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+32:11328:x1875420955858816:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:2.0:1788541124.085344:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835651f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+33:11328:x1875420955858816:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 237us (600us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1788541124.085352:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 23 00010000:00010000:2.0:1788541124.170587:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541124.189034:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541124.189184:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955859072 00000100:00100000:0.0:1788541124.189196:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955859072 00000100:00100000:0.0:1788541124.189268:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 106 00000100:00100000:0.0:1788541124.189290:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68052e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+33:11339:x1875420955859072:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:0.0:1788541124.189424:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541124.189448:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7dfd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331302 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.189522:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7e04 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.189538:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7e04 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.189551:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7e04 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.189567:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7e0b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.189575:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7e0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.189582:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7e0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.189688:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7e12 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.189709:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7e12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.189717:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7e12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541124.189728:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:0.0:1788541124.189807:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7e04 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.189815:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7e04 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.189822:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7e04 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.189827:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75fe00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541124.189831:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7e04 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.189838:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7e04 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.189851:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68350c4300) 00010000:00010000:0.0:1788541124.189854:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541124.189858:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7e04 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.189864:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7e04 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.189909:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7e0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.189922:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7e0b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.189927:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7e0b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.189932:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75f200 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541124.189935:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7e0b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.189941:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7e0b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.189949:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a67078a1400) 00010000:00010000:0.0:1788541124.189953:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541124.189956:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7e0b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.189961:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7e0b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.190004:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7dfd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331302 expref: 36 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.190018:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7e12 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331302 expref: 35 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.190024:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a68350c0100) 00010000:00010000:0.0:1788541124.190027:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788541124.190037:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75ec00, rc 0) 00000100:00100000:0.0:1788541124.190107:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68052e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+35:11339:x1875420955859072:12345-192.168.202.56@tcp:101:cat.0 Request processed in 829us (1084us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1788541124.190115:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 106 00000100:00100000:3.0:1788541124.198041:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541124.198164:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955859328 00000100:00100000:0.0:1788541124.198174:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955859328 00000100:00100000:0.0:1788541124.198244:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 24 00000100:00100000:0.0:1788541124.198254:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68052e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+35:11339:x1875420955859328:12345-192.168.202.56@tcp:35:cat.0 00000100:00100000:0.0:1788541124.198572:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68052e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+36:11339:x1875420955859328:12345-192.168.202.56@tcp:35:cat.0 Request processed in 318us (543us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1788541124.198589:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 24 00000100:00100000:1.0:1788541124.217172:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541124.217259:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955859584 00000100:00100000:2.0:1788541124.217268:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955859584 00000100:00100000:2.0:1788541124.217321:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 107 00000100:00100000:2.0:1788541124.217332:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835651180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+36:11340:x1875420955859584:12345-192.168.202.56@tcp:36:rm.0 00010000:00010000:2.0:1788541124.217397:0:9339:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1788541124.217432:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048800/0x2aac941e5f4a7db0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3312ed expref: 36 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.217456:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7e12 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331302 expref: 35 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.217469:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a7de8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3312fb expref: 34 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.217499:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbc00/0x2aac941e5f4a7da2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3312e6 expref: 33 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.217510:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a68350c0100) 00010000:00010000:2.0:1788541124.217515:0:9339:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788541124.217535:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049e00/0x2aac941e5f4a7e20 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.217548:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049e00/0x2aac941e5f4a7e20 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.217558:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049e00/0x2aac941e5f4a7e20 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.217571:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048e00/0x2aac941e5f4a7e27 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.217577:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048e00/0x2aac941e5f4a7e27 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.217584:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048e00/0x2aac941e5f4a7e27 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.217654:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048600/0x2aac941e5f4a7e2e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.217662:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048600/0x2aac941e5f4a7e2e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.217668:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048600/0x2aac941e5f4a7e2e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788541124.217922:0:9339:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1788541124.217932:0:9339:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 405136061337ns, next at 406136059086ns, rc = 0 00010000:00010000:2.0:1788541124.217972:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a7e35 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.217981:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a7e35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.217989:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a7e35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.217996:0:9339:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a7e35 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.218003:0:9339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a7e35 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.218009:0:9339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a7e35 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.218029:0:9339:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788541124.218044:0:9339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048600/0x2aac941e5f4a7e2e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.218050:0:9339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048600/0x2aac941e5f4a7e2e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.218057:0:9339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048600/0x2aac941e5f4a7e2e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.218062:0:9339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842048600 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:2.0:1788541124.218072:0:9339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048600/0x2aac941e5f4a7e2e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.218076:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541124.218081:0:9339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048600/0x2aac941e5f4a7e2e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.218085:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a7e35 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.218094:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a68350c0100) 00010000:00010000:2.0:1788541124.218098:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788541124.218108:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551b400 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788541124.218114:0:8446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a7e35 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.218122:0:8446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a7e35 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.218134:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a68350c0100) 00010000:00010000:0.0:1788541124.218137:0:8446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788541124.218141:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a7e35 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.218147:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a7e35 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.218173:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541124.218175:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541124.218178:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541124.218208:0:9339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048600/0x2aac941e5f4a7e2e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.218218:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048600/0x2aac941e5f4a7e2e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.218232:0:9339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049e00/0x2aac941e5f4a7e20 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.218238:0:9339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049e00/0x2aac941e5f4a7e20 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.218244:0:9339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049e00/0x2aac941e5f4a7e20 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.218249:0:9339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842049e00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:2.0:1788541124.218252:0:9339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049e00/0x2aac941e5f4a7e20 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.218259:0:9339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049e00/0x2aac941e5f4a7e20 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.218266:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68350c4300) 00010000:00010000:2.0:1788541124.218268:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541124.218276:0:9339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049e00/0x2aac941e5f4a7e20 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.218282:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049e00/0x2aac941e5f4a7e20 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788541124.218294:0:9339:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000623bac01 reply state 00000000bd22a1d9 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048e00/0x2aac941e5f4a7e27 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.218304:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048e00/0x2aac941e5f4a7e27 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.218310:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a68350c0e00) 00010000:00010000:2.0:1788541124.218313:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788541124.218315:0:9339:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788541124.218424:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835651180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+34:11340:x1875420955859584:12345-192.168.202.56@tcp:36:rm.0 Request processed in 1093us (1259us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1788541124.218432:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 107 00000100:00100000:3.0:1788541124.274764:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541124.275068:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955859840 00000100:00100000:1.0:1788541124.275078:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955859840 00000100:00100000:1.0:1788541124.275187:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 108 00000100:00100000:1.0:1788541124.275199:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68052e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+34:11346:x1875420955859840:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:1.0:1788541124.277501:0:12149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541124.277535:0:12149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354daa00/0x2aac941e5f4a7e3c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331309 expref: -99 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.277637:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7e43 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.277652:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7e43 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.277676:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7e43 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.277689:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da200/0x2aac941e5f4a7e4a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.277696:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da200/0x2aac941e5f4a7e4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.277702:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da200/0x2aac941e5f4a7e4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788541124.278029:0:12149:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:1.0:1788541124.278163:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da800/0x2aac941e5f4a7e51 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.278172:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da800/0x2aac941e5f4a7e51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.278184:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da800/0x2aac941e5f4a7e51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.278217:0:12149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7e43 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.278223:0:12149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7e43 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.278230:0:12149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7e43 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.278235:0:12149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68354db800 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541124.278245:0:12149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7e43 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.278252:0:12149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7e43 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.278262:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68350c4300) 00010000:00010000:1.0:1788541124.278268:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541124.278272:0:12149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7e43 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.278278:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7e43 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788541124.278292:0:12149:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000008693f9b reply state 000000002256300a transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da200/0x2aac941e5f4a7e4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.278302:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da200/0x2aac941e5f4a7e4a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.278307:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a68350c0e00) 00010000:00010000:1.0:1788541124.278309:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788541124.278312:0:12149:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788541124.278419:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354daa00/0x2aac941e5f4a7e3c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331309 expref: 37 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.278433:0:12149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da800/0x2aac941e5f4a7e51 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331309 expref: 36 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.278441:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a6809c1ce00) 00010000:00010000:1.0:1788541124.278443:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788541124.278450:0:12149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68354da800, rc 0) 00000100:00100000:1.0:1788541124.278598:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68052e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+37:11346:x1875420955859840:12345-192.168.202.56@tcp:101:bash.0 Request processed in 3401us (3841us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1788541124.278606:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 108 00000100:00100000:3.0:1788541124.285495:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541124.285608:0:8973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955859968 00000100:00100000:1.0:1788541124.285619:0:8973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955859968 00000100:00100000:1.0:1788541124.285697:0:8973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 42 00000100:00100000:1.0:1788541124.285707:0:8973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68052e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:384f52e3-0481-4979-9299-157aff7472d2+5:2394:x1875420955859968:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:1.0:1788541124.285725:0:8973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541124.285745:0:8973:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed3f975b/0x2aac941e5f4a7e5f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331310 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788541124.285772:0:8973:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788541124.285795:0:8973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=405s v=(0 0) 00010000:00010000:1.0:1788541124.285801:0:8973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541124.285810:0:8973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed3f975b/0x2aac941e5f4a7e5f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331310 expref: 6 pid: 8973 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.285830:0:8973:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ed3f975b/0x2aac941e5f4a7e5f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331310 expref: 6 pid: 8973 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.285842:0:8973:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68354daa00, rc 0) 00000100:00100000:1.0:1788541124.285939:0:8973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68052e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:384f52e3-0481-4979-9299-157aff7472d2+6:2394:x1875420955859968:12345-192.168.202.56@tcp:101:bash.0 Request processed in 232us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541124.285945:0:8973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 42 00000100:00080000:3.0:1788541124.285987:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788541124.294577:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541124.294707:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955860096 00000100:00100000:1.0:1788541124.294717:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955860096 00000100:00100000:1.0:1788541124.294831:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 43 00000100:00100000:1.0:1788541124.294842:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:384f52e3-0481-4979-9299-157aff7472d2+6:11346:x1875420955860096:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:1.0:1788541124.294860:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541124.294916:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067ec5533/0x2aac941e5f4a7e66 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331317 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.294958:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ed3f975b/0x2aac941e5f4a7e5f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331310 expref: 7 pid: 8973 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.294967:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541124.294972:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541124.294979:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067ec5533/0x2aac941e5f4a7e66 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331317 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.295011:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ed3f975b/0x2aac941e5f4a7e5f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331310 expref: 7 pid: 8973 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.295026:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ed3f975b/0x2aac941e5f4a7e5f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331310 expref: 7 pid: 8973 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541124.295050:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6835652d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1875420981106432:192.168.202.56@tcp:104: 00000100:00100000:1.0:1788541124.295134:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a682ff91180 going to sleep for 11 seconds 00000100:00100000:2.0:1788541124.298528:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541124.298693:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6835652d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1875420981106432:192.168.202.56@tcp:104: 00010000:00010000:1.0:1788541124.298727:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067ec5533/0x2aac941e5f4a7e66 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xa16473202a331317 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.298768:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68354db800, rc 0) 00000100:00100000:1.0:1788541124.298861:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:384f52e3-0481-4979-9299-157aff7472d2+7:11346:x1875420955860096:12345-192.168.202.56@tcp:101:bash.0 Request processed in 4021us (4294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541124.298900:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 43 00000100:00100000:3.0:1788541124.299149:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955860224 00000100:00100000:3.0:1788541124.299157:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955860224 00010000:00010000:3.0:1788541124.299189:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ed3f975b/0x2aac941e5f4a7e5f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331310 expref: 7 pid: 8973 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541124.299250:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 67 00000100:00100000:3.0:1788541124.299269:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:384f52e3-0481-4979-9299-157aff7472d2+7:2396:x1875420955860224:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541124.299283:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541124.299313:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ed3f975b/0x2aac941e5f4a7e5f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331310 expref: 7 pid: 8973 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541124.299327:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ed3f975b/0x2aac941e5f4a7e5f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331310 expref: 7 pid: 8973 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541124.299352:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed3f975b/0x2aac941e5f4a7e5f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331310 expref: 7 pid: 8973 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541124.299367:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541124.299371:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541124.299380:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067ec5533/0x2aac941e5f4a7e66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xa16473202a331317 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541124.299389:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067ec5533/0x2aac941e5f4a7e66 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xa16473202a331317 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541124.299434:0:6504:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000067ec5533/0x2aac941e5f4a7e66 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xa16473202a331317 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541124.299448:0:6504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68052e6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6504:1875420981106560:192.168.202.56@tcp:105: 00000100:00100000:3.0:1788541124.299512:0:6504:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707570540 going to sleep for 11 seconds 00000100:00100000:3.0:1788541124.306501:0:6504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68052e6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6504:1875420981106560:192.168.202.56@tcp:105: 00010000:00010000:3.0:1788541124.306535:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541124.306567:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541124.306656:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955860480 00000100:00100000:0.0:1788541124.306666:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955860480 00000100:00100000:0.0:1788541124.306722:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 25 00000100:00100000:0.0:1788541124.306732:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+37:11346:x1875420955860480:12345-192.168.202.56@tcp:35:bash.0 00000100:00100000:3.0:1788541124.306807:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:384f52e3-0481-4979-9299-157aff7472d2+6:2396:x1875420955860224:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 7547us (8288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541124.306831:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 67 00000100:00100000:0.0:1788541124.311678:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+38:11346:x1875420955860480:12345-192.168.202.56@tcp:35:bash.0 Request processed in 4933us (5099us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1788541124.311694:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 25 00000100:00100000:1.0:1788541124.494405:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541124.494863:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955860608 00000100:00100000:2.0:1788541124.494892:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955860608 00000100:00100000:2.0:1788541124.494969:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 109 00000100:00100000:2.0:1788541124.494980:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835652d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+38:11362:x1875420955860608:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1788541124.495009:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541124.495046:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a7e6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a33131e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.495118:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a7e74 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.495146:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a7e74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.495158:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a7e74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541124.495204:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788541124.495208:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788541124.495228:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a7e74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.495254:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a7e6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33131e expref: 40 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.495285:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a7e74 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33131e expref: 39 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.495293:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68350c4300) 00010000:00010000:2.0:1788541124.495296:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788541124.495300:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a683551b200, rc 0) 00000100:00100000:2.0:1788541124.495371:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835652d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+39:11362:x1875420955860608:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 393us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541124.495378:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 109 00000100:00100000:2.0:1788541124.501991:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541124.502196:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955860864 00000100:00100000:1.0:1788541124.502206:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955860864 00000100:00100000:1.0:1788541124.502275:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 110 00000100:00100000:1.0:1788541124.502286:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+39:11362:x1875420955860864:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1788541124.502307:0:9339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541124.502329:0:9339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354daa00/0x2aac941e5f4a7e7b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331325 expref: -99 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.502713:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbc00/0x2aac941e5f4a7e82 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.502729:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbc00/0x2aac941e5f4a7e82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.502742:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbc00/0x2aac941e5f4a7e82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788541124.502754:0:9339:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788541124.502865:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354daa00/0x2aac941e5f4a7e7b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331325 expref: 42 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.503153:0:9339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbc00/0x2aac941e5f4a7e82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331325 expref: 41 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.503180:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a6809c1ce00) 00010000:00010000:1.0:1788541124.503183:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788541124.503186:0:9339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68354dbc00, rc 0) 00000100:00100000:0.0:1788541124.503319:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+41:11362:x1875420955860864:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1035us (1338us total) trans 4294967380 rc 0/0 00000100:00100000:0.0:1788541124.503327:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 110 00000100:00100000:3.0:1788541124.508371:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541124.508602:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541124.508787:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955861248 00000100:00100000:1.0:1788541124.508798:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955861248 00000100:00100000:1.0:1788541124.508852:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 111 00000100:00100000:1.0:1788541124.508861:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68052e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+41:11362:x1875420955861248:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1788541124.508912:0:12149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541124.508942:0:12149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354daa00/0x2aac941e5f4a7e90 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a33132c expref: -99 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.509205:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a7e97 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.509220:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a7e97 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.509231:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a7e97 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788541124.509242:0:12149:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788541124.509339:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354daa00/0x2aac941e5f4a7e90 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33132c expref: 44 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.509358:0:12149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a7e97 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33132c expref: 43 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.509366:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a6809c1ce00) 00010000:00010000:1.0:1788541124.509385:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788541124.509396:0:12149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68354db600, rc 0) 00000100:00100000:1.0:1788541124.509545:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68052e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+43:11362:x1875420955861248:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 684us (943us total) trans 4294967381 rc 0/0 00000100:00100000:1.0:1788541124.509554:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 111 00000100:00100000:0.0:1788541124.509843:0:9520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955860992 00000100:00100000:0.0:1788541124.509848:0:9520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955860992 00000100:00100000:0.0:1788541124.509894:0:9520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 7 00000100:00100000:0.0:1788541124.509903:0:9520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68052e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:384f52e3-0481-4979-9299-157aff7472d2+43:2397:x1875420955860992:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788541124.509913:0:9520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541124.510145:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbc00/0x2aac941e5f4a7e82 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331325 expref: 43 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.510155:0:9520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a6809c1ce00) 00010000:00010000:0.0:1788541124.510158:0:9520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541124.510185:0:9520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68052e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:384f52e3-0481-4979-9299-157aff7472d2+42:2397:x1875420955860992:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 285us (1825us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541124.510198:0:9520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 7 00000100:00100000:3.0:1788541124.515443:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541124.515613:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955861376 00000100:00100000:0.0:1788541124.515624:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955861376 00000100:00100000:0.0:1788541124.515686:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 44 00000100:00100000:0.0:1788541124.515697:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68052e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:384f52e3-0481-4979-9299-157aff7472d2+6:2397:x1875420955861376:12345-192.168.202.56@tcp:1:lfs.0 00010000:00010000:0.0:1788541124.515757:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d13f9ad/0x2aac941e5f4a7ea5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.515778:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067ec5533/0x2aac941e5f4a7e66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xa16473202a331317 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.515787:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541124.515791:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788541124.515796:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d13f9ad/0x2aac941e5f4a7ea5 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.515833:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000067ec5533/0x2aac941e5f4a7e66 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xa16473202a331317 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.515848:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000067ec5533/0x2aac941e5f4a7e66 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a331317 expref: 6 pid: 8430 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541124.515862:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707728e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8431:1875420981106688:192.168.202.56@tcp:104: 00000100:00100000:0.0:1788541124.516729:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6835519480 going to sleep for 11 seconds 00000100:00100000:0.0:1788541124.529774:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707728e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8431:1875420981106688:192.168.202.56@tcp:104: 00010000:00010000:0.0:1788541124.529840:0:8431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002d13f9ad/0x2aac941e5f4a7ea5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541124.536911:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541124.537082:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955861504 00000100:00100000:1.0:1788541124.537092:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955861504 00002000:00100000:1.0:1788541124.537147:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9a670831d180 x1875420955861504/t0(0) o4->384f52e3-0481-4979-9299-157aff7472d2@192.168.202.56@tcp:495/0 lens 504/0 e 0 to 0 dl 1788541135 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788541124.537160:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a670831d180 with x1875420955861504 ext(0->8) 00010000:00010000:1.0:1788541124.537171:0:8437:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000067ec5533/0x2aac941e5f4a7e66 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a331317 expref: 7 pid: 8430 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.537189:0:8437:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000067ec5533/0x2aac941e5f4a7e66 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a331317 expref: 7 pid: 8430 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788541124.537197:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a670831d180 00000100:00100000:1.0:1788541124.537230:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1 00000100:00100000:1.0:1788541124.537240:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:384f52e3-0481-4979-9299-157aff7472d2+7:2396:x1875420955861504:12345-192.168.202.56@tcp:4:lfs.0 00000100:00100000:1.0:1788541124.538670:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:384f52e3-0481-4979-9299-157aff7472d2+9:2396:x1875420955861504:12345-192.168.202.56@tcp:4:lfs.0 Request processed in 1422us (1791us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788541124.538683:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1 00002000:00100000:1.0:1788541124.538696:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9a670831d180 x1875420955861504/t4294967303(0) o4->384f52e3-0481-4979-9299-157aff7472d2@192.168.202.56@tcp:495/0 lens 504/448 e 0 to 0 dl 1788541135 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788541124.538706:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a670831d180 with x1875420955861504 ext(0->8) 00010000:00010000:1.0:1788541124.538729:0:8437:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000067ec5533/0x2aac941e5f4a7e66 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a331317 expref: 9 pid: 8430 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.538749:0:8437:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000067ec5533/0x2aac941e5f4a7e66 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a331317 expref: 9 pid: 8430 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788541124.538756:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a670831d180 00000100:00100000:1.0:1788541124.541727:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541124.541980:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955861632 00000100:00100000:0.0:1788541124.541995:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955861632 00010000:00010000:0.0:1788541124.542052:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000067ec5533/0x2aac941e5f4a7e66 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a331317 expref: 9 pid: 8430 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541124.542103:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 68 00000100:00100000:0.0:1788541124.542113:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680763ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:384f52e3-0481-4979-9299-157aff7472d2+9:2394:x1875420955861632:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788541124.542129:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788541124.542153:0:6502:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788541124.542157:0:6502:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788541124 00002000:00010000:0.0:1788541124.542159:0:6502:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788541124 00002000:00010000:0.0:1788541124.542162:0:6502:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1788541124 00002000:00010000:0.0:1788541124.542164:0:6502:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788541124.542176:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000067ec5533/0x2aac941e5f4a7e66 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a331317 expref: 9 pid: 8430 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.542191:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000067ec5533/0x2aac941e5f4a7e66 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a331317 expref: 9 pid: 8430 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.542215:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067ec5533/0x2aac941e5f4a7e66 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a331317 expref: 9 pid: 8430 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.542238:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788541124.542257:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788541124.542264:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002d13f9ad/0x2aac941e5f4a7ea5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.542274:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d13f9ad/0x2aac941e5f4a7ea5 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.542316:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541124.542378:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680763ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:384f52e3-0481-4979-9299-157aff7472d2+8:2394:x1875420955861632:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 266us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541124.542387:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 68 00010000:00010000:1.0:1788541124.543010:0:8431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002d13f9ad/0x2aac941e5f4a7ea5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.543021:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d13f9ad/0x2aac941e5f4a7ea5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.543052:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d13f9ad/0x2aac941e5f4a7ea5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.543062:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d13f9ad/0x2aac941e5f4a7ea5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.543070:0:8431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d13f9ad/0x2aac941e5f4a7ea5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.543077:0:8431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75ee00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:1.0:1788541124.543082:0:8431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d13f9ad/0x2aac941e5f4a7ea5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.543106:0:8431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d13f9ad/0x2aac941e5f4a7ea5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.543120:0:8431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d13f9ad/0x2aac941e5f4a7ea5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.543128:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d13f9ad/0x2aac941e5f4a7ea5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541124.543197:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68052e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:384f52e3-0481-4979-9299-157aff7472d2+7:2397:x1875420955861376:12345-192.168.202.56@tcp:1:lfs.0 Request processed in 27500us (27764us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541124.543206:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 44 00000100:00100000:1.0:1788541124.559175:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541124.559377:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955861888 00000100:00100000:2.0:1788541124.559399:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955861888 00000100:00100000:2.0:1788541124.559470:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 26 00000100:00100000:2.0:1788541124.559481:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6811403c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+42:11362:x1875420955861888:12345-192.168.202.56@tcp:35:lfs.0 00000004:00010000:2.0:1788541124.559562:0:6520:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a7e97 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33132c expref: 42 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788541124.559763:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:2.0:1788541124.559798:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1788541124.560760:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:2.0:1788541124.560825:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a7eac lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.560842:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da800/0x2aac941e5f4a7e51 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331309 expref: 46 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.560851:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a7eac lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.560917:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da800/0x2aac941e5f4a7e51 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331309 expref: 46 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.560933:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da800/0x2aac941e5f4a7e51 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331309 expref: 46 pid: 12149 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541124.560948:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6520:1875420981106816:192.168.202.56@tcp:104: 00000100:00100000:2.0:1788541124.561482:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a680529c780 going to sleep for 11 seconds 00000100:00100000:0.0:1788541124.574344:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541124.574465:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6520:1875420981106816:192.168.202.56@tcp:104: 00010000:00010000:2.0:1788541124.574494:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a7eac lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541124.575812:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955862016 00000100:00100000:3.0:1788541124.575825:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955862016 00010000:00010000:3.0:1788541124.575911:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da800/0x2aac941e5f4a7e51 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331309 expref: 47 pid: 12149 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541124.576193:0:9520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 69 00000100:00100000:0.0:1788541124.576206:0:9520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707728e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:384f52e3-0481-4979-9299-157aff7472d2+47:2396:x1875420955862016:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788541124.576225:0:9520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541124.576234:0:9520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da800/0x2aac941e5f4a7e51 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331309 expref: 47 pid: 12149 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.576247:0:9520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da800/0x2aac941e5f4a7e51 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331309 expref: 47 pid: 12149 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.576270:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da800/0x2aac941e5f4a7e51 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331309 expref: 47 pid: 12149 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.576287:0:9520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a6809c1ce00) 00010000:00010000:0.0:1788541124.576292:0:9520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a7eac lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.576319:0:9520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a7eac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.576326:0:9520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a7eac lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.576359:0:9520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541124.576461:0:9520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707728e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:384f52e3-0481-4979-9299-157aff7472d2+46:2396:x1875420955862016:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 257us (2125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541124.576469:0:9520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 69 00010000:00010000:2.0:1788541124.576604:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a7eac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.576619:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a7eac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788541124.576735:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:2.0:1788541124.576862:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:2.0:1788541124.576984:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6520:1875420981106944:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788541124.577054:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541124.577092:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6706875d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788541124.577455:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981106944 00000100:00100000:3.0:1788541124.577463:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981106944 00000100:00100000:3.0:1788541124.577509:0:10866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788541124.577518:0:10866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6520:x1875420981106944:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788541124.577613:0:10866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6520:x1875420981106944:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 95us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541124.577621:0:10866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788541124.578568:0:6520:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:2.0:1788541124.578578:0:6520:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967302 00000004:00080000:2.0:1788541124.578597:0:6520:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a6835652680, transno 4294967302 00000100:00100000:2.0:1788541124.578621:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6520:1875420981106944:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788541124.578775:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:2.0:1788541124.579313:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6520:1875420981107072:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788541124.579380:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541124.579517:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a680529ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788541124.579571:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981107072 00000100:00100000:0.0:1788541124.579579:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981107072 00000100:00100000:0.0:1788541124.579635:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788541124.579647:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6520:x1875420981107072:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788541124.580184:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6520:x1875420981107072:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 538us (802us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788541124.580192:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788541124.580279:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6520:1875420981107072:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788541124.580334:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:2.0:1788541124.580380:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a7eac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.580476:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a7eac lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.580486:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a7eac lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.580491:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551b800 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:2.0:1788541124.580512:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a7eac lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.580521:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a7eac lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.580536:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a6809c1ce00) 00010000:00010000:2.0:1788541124.580539:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788541124.580544:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a7eac lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.580551:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a7eac lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788541124.580643:0:6520:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788541124.580697:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:2.0:1788541124.580982:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 405499110239ns, next at 406499106699ns, rc = 0 00000001:00080000:2.0:1788541124.580992:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:2.0:1788541124.581023:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a6809c1ce00) 00010000:00010000:2.0:1788541124.581027:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788541124.581900:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a7e97 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33132c expref: 50 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541124.582212:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6811403c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+49:11362:x1875420955861888:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 22731us (23047us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1788541124.582222:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 26 00000020:00080000:2.0:1788541124.582227:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788541124.591831:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541124.591955:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955862144 00000100:00100000:2.0:1788541124.591971:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955862144 00000100:00100000:2.0:1788541124.592066:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 112 00000100:00100000:2.0:1788541124.592078:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707728700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+49:11362:x1875420955862144:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1788541124.592111:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541124.592135:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a7eb3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331333 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.592197:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a7eb3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331333 expref: 50 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.592213:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a7eb3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331333 expref: 50 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.592232:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a68350c0800) 00010000:00010000:2.0:1788541124.592236:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788541124.592240:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a683551a000, rc 0) 00000100:00100000:2.0:1788541124.592297:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707728700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+50:11362:x1875420955862144:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 222us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541124.592304:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 112 00000100:00100000:1.0:1788541124.605099:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541124.605298:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955862400 00000100:00100000:0.0:1788541124.605308:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955862400 00000100:00100000:0.0:1788541124.605368:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 27 00000100:00100000:0.0:1788541124.605380:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835651f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+50:11362:x1875420955862400:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:0.0:1788541124.605664:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835651f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+51:11362:x1875420955862400:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 285us (577us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1788541124.605672:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 27 00000100:00100000:1.0:1788541124.701550:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541124.701660:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955862528 00000100:00100000:0.0:1788541124.701686:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955862528 00000100:00100000:0.0:1788541124.701751:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 113 00000100:00100000:0.0:1788541124.701763:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835652680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+51:11372:x1875420955862528:12345-192.168.202.56@tcp:34:lfs.0 00010000:00010000:0.0:1788541124.701844:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7eba lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.701862:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7eba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.701906:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7eba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.701919:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7ec1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.701926:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.701932:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.702004:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7ec8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.702012:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.702018:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788541124.702080:0:9339:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.702109:0:9339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7eba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.702116:0:9339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7eba lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.702123:0:9339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7eba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.702128:0:9339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75fc00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541124.702132:0:9339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7eba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.702140:0:9339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7eba lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.702152:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68350c4300) 00010000:00010000:0.0:1788541124.702155:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541124.702160:0:9339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7eba lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.702166:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7eba lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.702179:0:9339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.702184:0:9339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7ec1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.702189:0:9339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7ec1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.702199:0:9339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75ee00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541124.702202:0:9339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7ec1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.702208:0:9339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7ec1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.702215:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a68350c0e00) 00010000:00010000:0.0:1788541124.702217:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541124.702220:0:9339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7ec1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.702225:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7ec1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.702234:0:9339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.702240:0:9339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7ec8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.702245:0:9339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7ec8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.702249:0:9339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75fe00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541124.702251:0:9339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7ec8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.702255:0:9339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7ec8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.702269:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a68350c0800) 00010000:00010000:0.0:1788541124.702272:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541124.702274:0:9339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7ec8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.702280:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7ec8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541124.702351:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835652680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+51:11372:x1875420955862528:12345-192.168.202.56@tcp:34:lfs.0 Request processed in 590us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541124.702359:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 113 00000100:00100000:3.0:1788541124.752021:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541124.752195:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955862784 00000100:00100000:1.0:1788541124.752208:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955862784 00000100:00100000:1.0:1788541124.752286:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 114 00000100:00100000:1.0:1788541124.752296:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68052e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+51:11375:x1875420955862784:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1788541124.752332:0:12149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541124.752357:0:12149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a7ecf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a33133a expref: -99 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.752658:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbc00/0x2aac941e5f4a7ed6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.752699:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbc00/0x2aac941e5f4a7ed6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.752714:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbc00/0x2aac941e5f4a7ed6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.752727:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a7edd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.752735:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a7edd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.752741:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a7edd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.752865:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da800/0x2aac941e5f4a7ee4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.752920:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da800/0x2aac941e5f4a7ee4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.752927:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da800/0x2aac941e5f4a7ee4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788541124.752937:0:12149:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788541124.754435:0:12149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbc00/0x2aac941e5f4a7ed6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.754448:0:12149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbc00/0x2aac941e5f4a7ed6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.754454:0:12149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbc00/0x2aac941e5f4a7ed6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.754475:0:12149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68354dbc00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541124.754480:0:12149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbc00/0x2aac941e5f4a7ed6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.754488:0:12149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbc00/0x2aac941e5f4a7ed6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.754501:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68350c4300) 00010000:00010000:1.0:1788541124.754504:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541124.754508:0:12149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbc00/0x2aac941e5f4a7ed6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.754515:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbc00/0x2aac941e5f4a7ed6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.754532:0:12149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a7edd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.754537:0:12149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a7edd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.754543:0:12149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a7edd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.754547:0:12149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68354db600 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541124.754550:0:12149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a7edd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.754556:0:12149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a7edd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.754573:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a68350c0e00) 00010000:00010000:1.0:1788541124.754576:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541124.754579:0:12149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a7edd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.754584:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a7edd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.754632:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a7ecf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33133a expref: 54 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.754648:0:12149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da800/0x2aac941e5f4a7ee4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33133a expref: 53 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541124.754655:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a68350c0800) 00010000:00010000:1.0:1788541124.754658:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788541124.754660:0:12149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68354da800, rc 0) 00000100:00100000:1.0:1788541124.754748:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68052e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+53:11375:x1875420955862784:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 2452us (2736us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1788541124.754757:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 114 00000100:00100000:1.0:1788541124.759333:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541124.760540:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955862912 00000100:00100000:0.0:1788541124.760557:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955862912 00000100:00100000:0.0:1788541124.760637:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 115 00000100:00100000:0.0:1788541124.760648:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+53:11375:x1875420955862912:12345-192.168.202.56@tcp:54:lfs.0 00010000:00010000:0.0:1788541124.760731:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7ef2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.760751:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7ef2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.760763:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7ef2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.760799:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7ef2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.760806:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7ef2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.760828:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7ef2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.760833:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75fe00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541124.760837:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7ef2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.760845:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7ef2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.760857:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a68350c0800) 00010000:00010000:0.0:1788541124.760860:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788541124.760864:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7ef2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.760912:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7ef2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541124.760996:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+53:11375:x1875420955862912:12345-192.168.202.56@tcp:54:lfs.0 Request processed in 349us (1673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541124.761004:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 115 00000100:00100000:2.0:1788541124.764505:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541124.764592:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955863168 00000100:00100000:0.0:1788541124.764602:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955863168 00000100:00100000:0.0:1788541124.764650:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 28 00000100:00100000:0.0:1788541124.764660:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+53:11375:x1875420955863168:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:0.0:1788541124.764918:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+54:11375:x1875420955863168:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 258us (421us total) trans 4294967393 rc 0/0 00000100:00100000:0.0:1788541124.764926:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 28 00000100:00100000:1.0:1788541124.877722:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541124.877828:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955863424 00000100:00100000:0.0:1788541124.877839:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955863424 00000100:00100000:0.0:1788541124.878153:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 116 00000100:00100000:0.0:1788541124.878165:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+54:11385:x1875420955863424:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:0.0:1788541124.878193:0:9339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541124.878197:0:9339:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788541124.878222:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a7e74 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33131e expref: 54 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.878243:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68350c4300) 00010000:00010000:0.0:1788541124.878249:0:9339:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788541124.878263:0:9339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7ef9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331341 expref: -99 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.878370:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7f00 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.878385:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7f00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.878395:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7f00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541124.878419:0:9339:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788541124.878520:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7ef9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331341 expref: 56 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.878534:0:9339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7f00 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331341 expref: 55 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.878562:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a68350c0800) 00010000:00010000:0.0:1788541124.878565:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788541124.878568:0:9339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75ee00, rc 0) 00000100:00100000:0.0:1788541124.878634:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+55:11385:x1875420955863424:12345-192.168.202.56@tcp:101:bash.0 Request processed in 471us (921us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1788541124.878641:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 116 00000100:00100000:1.0:1788541124.887746:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541124.887795:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541124.887904:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955863680 00000100:00100000:0.0:1788541124.887914:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955863680 00000100:00100000:0.0:1788541124.887977:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 8 00000100:00100000:0.0:1788541124.887987:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:384f52e3-0481-4979-9299-157aff7472d2+55:2394:x1875420955863680:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788541124.888004:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541124.888028:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a7f00 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331341 expref: 55 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.888046:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a68350c0800) 00010000:00010000:0.0:1788541124.888052:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541124.888101:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:384f52e3-0481-4979-9299-157aff7472d2+54:2394:x1875420955863680:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 115us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541124.888108:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 8 00000100:00100000:2.0:1788541124.888778:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955863552 00000100:00100000:2.0:1788541124.888788:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955863552 00000100:00100000:2.0:1788541124.888835:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 117 00000100:00100000:2.0:1788541124.888843:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+54:11385:x1875420955863552:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:2.0:1788541124.888902:0:12149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541124.888919:0:12149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a7f0e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331348 expref: -99 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.888951:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a7f15 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.888984:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a7f15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.888996:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a7f15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.889112:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a7f0e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331348 expref: 56 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.889130:0:12149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a7f15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331348 expref: 55 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541124.889138:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a68350c0800) 00010000:00010000:2.0:1788541124.889140:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788541124.889143:0:12149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a683551b000, rc 0) 00000100:00100000:2.0:1788541124.889197:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+55:11385:x1875420955863552:12345-192.168.202.56@tcp:101:bash.0 Request processed in 355us (1463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541124.889205:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 117 00000100:00100000:1.0:1788541124.899011:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541124.899058:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541124.899093:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541124.899142:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541124.899209:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955864064 00000100:00100000:2.0:1788541124.899220:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955864064 00000100:00100000:2.0:1788541124.899271:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 108 00000100:00100000:2.0:1788541124.899281:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:384f52e3-0481-4979-9299-157aff7472d2+8:2397:x1875420955864064:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1788541124.899370:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:384f52e3-0481-4979-9299-157aff7472d2+8:2397:x1875420955864064:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 91us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541124.899379:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 108 00000100:00100000:2.0:1788541124.899436:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541124.899508:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955863808 00000100:00100000:0.0:1788541124.899513:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955863808 00000100:00100000:0.0:1788541124.899547:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 385 00000100:00100000:0.0:1788541124.899555:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e78bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:2397:x1875420955863808:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541124.899585:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e78bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:2397:x1875420955863808:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 30us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541124.899599:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 385 00000100:00100000:3.0:1788541124.903633:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955864320 00000100:00100000:3.0:1788541124.903655:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955864320 00000100:00100000:2.0:1788541124.903729:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541124.903747:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955863936 00000100:00100000:3.0:1788541124.903752:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955863936 00000100:00100000:2.0:1788541124.903774:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955864192 00000100:00100000:3.0:1788541124.903778:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955864576 00000100:00100000:2.0:1788541124.903781:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955864192 00000100:00100000:3.0:1788541124.903784:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955864576 00000100:00100000:2.0:1788541124.903818:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 302 00000100:00100000:2.0:1788541124.903830:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2397:x1875420955864320:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541124.903836:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 303 00000100:00100000:3.0:1788541124.903848:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+5:2397:x1875420955863936:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1788541124.903933:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2397:x1875420955864320:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 103us (4837us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541124.903934:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+5:2397:x1875420955863936:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 86us (4790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541124.903947:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 302 00000100:00100000:3.0:1788541124.903960:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 303 00000100:00100000:2.0:1788541124.903971:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 304 00000100:00100000:2.0:1788541124.903980:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2397:x1875420955864192:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541124.903986:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 118 00000100:00100000:3.0:1788541124.903998:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+55:11385:x1875420955864576:12345-192.168.202.56@tcp:36:bash.0 00000100:00100000:2.0:1788541124.904015:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2397:x1875420955864192:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 36us (4578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541124.904022:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 304 00000100:00080000:2.0:1788541124.904187:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788541124.904191:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788541124.904597:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541124.904627:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da800/0x2aac941e5f4a7ee4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33133a expref: 55 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541124.904649:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a68350c0800) 00010000:00010000:3.0:1788541124.904654:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788541124.904984:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a7f1c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541124.905001:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a7f1c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541124.905011:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a7f1c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788541124.905122:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:3.0:1788541124.905146:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c726d43b reply state 0000000063623829 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a7f1c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541124.905158:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a7f1c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541124.905166:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a68350c0800) 00010000:00010000:3.0:1788541124.905169:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788541124.905172:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788541124.905483:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+57:11385:x1875420955864576:12345-192.168.202.56@tcp:36:bash.0 Request processed in 1485us (1757us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1788541124.905503:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 118 00000020:00080000:3.0:1788541124.905508:0:6517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788541124.914968:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541124.915141:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955864704 00000100:00100000:0.0:1788541124.915152:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955864704 00000100:00100000:0.0:1788541124.915213:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 119 00000100:00100000:0.0:1788541124.915223:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+57:11385:x1875420955864704:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:0.0:1788541124.915494:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541124.915515:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7f23 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a33134f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.915604:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7f2a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.915621:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7f2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.915633:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7f2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541124.915663:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788541124.915667:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788541124.915685:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7f2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.915711:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7f23 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33134f expref: 59 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.915731:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7f2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33134f expref: 58 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541124.915761:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a68350c0800) 00010000:00010000:0.0:1788541124.915764:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788541124.915767:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75fc00, rc 0) 00000100:00100000:0.0:1788541124.916010:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+58:11385:x1875420955864704:12345-192.168.202.56@tcp:101:bash.0 Request processed in 787us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541124.916018:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 119 00000100:00100000:1.0:1788541124.921638:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541124.925380:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955864960 00000100:00100000:0.0:1788541124.925395:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955864960 00000100:00100000:0.0:1788541124.925481:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 29 00000100:00100000:0.0:1788541124.925493:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+58:11385:x1875420955864960:12345-192.168.202.56@tcp:35:bash.0 00000100:00100000:0.0:1788541124.925728:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+59:11385:x1875420955864960:12345-192.168.202.56@tcp:35:bash.0 Request processed in 237us (4098us total) trans 4294967397 rc 0/0 00000100:00100000:0.0:1788541124.925736:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 29 00000100:00100000:2.0:1788541125.046644:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541125.050552:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955865088 00000100:00100000:3.0:1788541125.050570:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955865088 00000100:00100000:3.0:1788541125.050662:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 120 00000100:00100000:3.0:1788541125.050675:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+59:11391:x1875420955865088:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1788541125.050698:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541125.050719:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a7f31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331356 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541125.050788:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a7f38 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541125.050804:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a7f38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541125.050815:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a7f38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541125.050861:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788541125.050865:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00080000:2.0:1788541125.050977:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:3.0:1788541125.052177:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a7f38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541125.052216:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a7f31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331356 expref: 61 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541125.053350:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a7f38 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331356 expref: 60 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541125.053386:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68350c4300) 00010000:00010000:3.0:1788541125.053389:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788541125.053393:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075ad800, rc 0) 00000100:00100000:2.0:1788541125.053823:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+60:11391:x1875420955865088:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 3148us (7183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541125.053833:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 120 00000100:00100000:1.0:1788541125.061678:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541125.061774:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955865216 00000100:00100000:0.0:1788541125.061785:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955865216 00000100:00100000:0.0:1788541125.061849:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 121 00000100:00100000:0.0:1788541125.061860:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+60:11391:x1875420955865216:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1788541125.061911:0:9339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541125.061934:0:9339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7f3f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a33135d expref: -99 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541125.062001:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7f46 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541125.062017:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7f46 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541125.062056:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7f46 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541125.062069:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a7f4d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541125.062076:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a7f4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541125.062083:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a7f4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541125.062146:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7f54 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541125.062155:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7f54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541125.062162:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7f54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541125.062198:0:9339:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788541125.062202:0:9339:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788541125.062220:0:9339:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7f54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541125.062243:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7f54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541125.062252:0:9339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7f46 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541125.062267:0:9339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7f46 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541125.062273:0:9339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7f46 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541125.062279:0:9339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75f200 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541125.062283:0:9339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7f46 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541125.062291:0:9339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7f46 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541125.062303:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68350c4300) 00010000:00010000:0.0:1788541125.062306:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541125.062310:0:9339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7f46 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541125.062316:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7f46 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541125.062327:0:9339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a7f4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541125.062333:0:9339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a7f4d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541125.062339:0:9339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a7f4d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541125.062344:0:9339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75e600 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541125.062352:0:9339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a7f4d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541125.062359:0:9339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a7f4d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541125.062366:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a68350c0e00) 00010000:00010000:0.0:1788541125.062369:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541125.062371:0:9339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a7f4d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541125.062377:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a7f4d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541125.062411:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7f3f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33135d expref: 62 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541125.062427:0:9339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7f54 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33135d expref: 61 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541125.062434:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a68350c0800) 00010000:00010000:0.0:1788541125.062436:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788541125.062438:0:9339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75ec00, rc 0) 00000100:00100000:0.0:1788541125.062505:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+61:11391:x1875420955865216:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 646us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541125.062513:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 121 00000100:00100000:3.0:1788541125.069259:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541125.069303:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541125.069441:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955865472 00000100:00100000:0.0:1788541125.069452:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955865472 00000100:00100000:0.0:1788541125.069519:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 122 00000100:00100000:0.0:1788541125.069529:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68052e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+61:11391:x1875420955865472:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1788541125.069566:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541125.069588:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7f5b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331364 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541125.069713:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a7f62 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541125.069729:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7f2a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33134f expref: 62 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541125.069738:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7f54 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33135d expref: 62 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541125.069747:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a7f62 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541125.069782:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7f54 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33135d expref: 62 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541125.069797:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7f54 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33135d expref: 62 pid: 9339 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541125.069812:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670772b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6518:1875420981107200:192.168.202.56@tcp:104: 00010000:00010000:0.0:1788541125.069951:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7f2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33134f expref: 62 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541125.069961:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7f2a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33134f expref: 62 pid: 6518 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541125.069982:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707729f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6518:1875420981107328:192.168.202.56@tcp:104: 00000100:00100000:0.0:1788541125.070009:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6835519180 going to sleep for 11 seconds 00000100:00100000:2.0:1788541125.071146:0:9520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955865600 00000100:00100000:2.0:1788541125.071156:0:9520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955865600 00010000:00010000:2.0:1788541125.071194:0:9520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7f54 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33135d expref: 63 pid: 9339 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541125.071237:0:9520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 70 00000100:00100000:2.0:1788541125.071247:0:9520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68052e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:384f52e3-0481-4979-9299-157aff7472d2+63:2396:x1875420955865600:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541125.071269:0:9520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541125.071275:0:9520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7f54 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33135d expref: 63 pid: 9339 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541125.071288:0:9520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7f54 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33135d expref: 63 pid: 9339 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541125.071307:0:9520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a68350c0800) 00010000:00010000:2.0:1788541125.071311:0:9520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a7f62 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541125.071320:0:9520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a7f62 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541125.071326:0:9520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541125.071367:0:9520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68052e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:384f52e3-0481-4979-9299-157aff7472d2+63:2396:x1875420955865600:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 122us (2063us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541125.071375:0:9520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 70 00000100:00100000:1.0:1788541125.080163:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00010000:00010000:0.0:1788541125.080344:0:6518:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.56@tcp) returned -22 from blocking AST (req@000000008a97d2ad x1875420981107200) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7f54 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33135d expref: 62 pid: 9339 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541125.080367:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7f54 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33135d expref: 62 pid: 9339 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541125.080394:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670772b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6518:1875420981107200:192.168.202.56@tcp:104: 00000100:00100000:0.0:1788541125.080420:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707729f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6518:1875420981107328:192.168.202.56@tcp:104: 00010000:00010000:0.0:1788541125.080447:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a68350c0800) 00010000:00010000:0.0:1788541125.080452:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a7f62 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541125.080461:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a7f62 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541125.080471:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a7f62 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541125.080595:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955865728 00000100:00100000:2.0:1788541125.080602:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955865728 00010000:00010000:2.0:1788541125.080638:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7f2a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33134f expref: 62 pid: 6518 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541125.080678:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 71 00000100:00100000:2.0:1788541125.080688:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:384f52e3-0481-4979-9299-157aff7472d2+62:2397:x1875420955865728:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541125.080702:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541125.080708:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7f2a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33134f expref: 62 pid: 6518 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541125.080736:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7f2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33134f expref: 62 pid: 6518 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541125.080756:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a7f2a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33134f expref: 62 pid: 6518 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541125.080767:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a68350c0800) 00010000:00010000:2.0:1788541125.080771:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a7f62 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541125.080780:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a7f62 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541125.080788:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a7f62 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541125.080816:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788541125.081052:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a7f62 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541125.081060:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a7f62 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541125.081092:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788541125.081247:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7f5b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331364 expref: 63 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541125.081264:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a7f62 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331364 expref: 62 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541125.081273:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a68350c0800) 00010000:00010000:0.0:1788541125.081275:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788541125.081278:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75e600, rc 0) 00000100:00100000:2.0:1788541125.081393:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:384f52e3-0481-4979-9299-157aff7472d2+62:2397:x1875420955865728:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 696us (1230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541125.081410:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 71 00000100:00100000:0.0:1788541125.082535:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68052e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+61:11391:x1875420955865472:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 12999us (13277us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1788541125.082547:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 122 00000100:00100000:3.0:1788541125.098348:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541125.098499:0:9520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955865984 00000100:00100000:2.0:1788541125.098509:0:9520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955865984 00000100:00100000:2.0:1788541125.098575:0:9520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 9 00000100:00100000:2.0:1788541125.098586:0:9520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68052e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:384f52e3-0481-4979-9299-157aff7472d2+61:11391:x1875420955865984:12345-192.168.202.56@tcp:103:lfs.0 00010000:00010000:2.0:1788541125.098601:0:9520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541125.098632:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a7eb3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331333 expref: 61 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541125.098683:0:9520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a68350c0800) 00010000:00010000:2.0:1788541125.098688:0:9520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541125.098743:0:9520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68052e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:384f52e3-0481-4979-9299-157aff7472d2+60:11391:x1875420955865984:12345-192.168.202.56@tcp:103:lfs.0 Request processed in 158us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541125.098751:0:9520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 9 00000100:00100000:1.0:1788541125.110028:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541125.110248:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955866112 00000100:00100000:2.0:1788541125.110260:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955866112 00000100:00100000:2.0:1788541125.110332:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 123 00000100:00100000:2.0:1788541125.110342:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+60:11391:x1875420955866112:12345-192.168.202.56@tcp:58:lfs.0 00010000:00010000:2.0:1788541125.110488:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a7f70 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541125.110505:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a7f70 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541125.110518:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a7f70 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788541125.110612:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1788541125.110698:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+60:11391:x1875420955866112:12345-192.168.202.56@tcp:58:lfs.0 Request processed in 356us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541125.110706:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 123 00000100:00100000:1.0:1788541125.113621:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541125.113695:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955866240 00000100:00100000:3.0:1788541125.113706:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955866240 00000100:00100000:3.0:1788541125.113772:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 124 00000100:00100000:3.0:1788541125.113783:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+60:11391:x1875420955866240:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1788541125.113806:0:12149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541125.113829:0:12149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a7f77 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a33136b expref: -99 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541125.113933:0:12149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a7f70 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541125.113946:0:12149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a7f77 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33136b expref: 61 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541125.113976:0:12149:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a7f70 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541125.113989:0:12149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a7f77 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33136b expref: 61 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541125.114005:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a68350c0800) 00010000:00010000:3.0:1788541125.114025:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788541125.114030:0:12149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a7f77 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33136b expref: 61 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541125.114040:0:12149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075ad400, rc 0) 00000100:00100000:3.0:1788541125.114102:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+61:11391:x1875420955866240:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 321us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541125.114110:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 124 00010000:00010000:3.0:1788541125.196144:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788541125.962816:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788541125.962829:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788541125.962921:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1788541125.962932:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788541125.963082:0:13798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835fb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1875420981107456:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788541125.963594:0:13798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a682ff91540 going to sleep for 11 seconds 00000100:00100000:1.0:1788541125.978333:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541125.978598:0:13798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835fb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1875420981107456:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788541125.987034:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955866368 00000100:00100000:2.0:1788541125.987052:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955866368 00000100:00100000:2.0:1788541125.987138:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 125 00000100:00100000:2.0:1788541125.987150:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+61:11392:x1875420955866368:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788541125.987564:0:6518:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788541125.987734:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+61:11392:x1875420955866368:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 584us (9409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541125.987743:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 125 00000100:00100000:3.0:1788541126.004385:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541126.004948:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955866496 00000100:00100000:0.0:1788541126.004959:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955866496 00000100:00100000:0.0:1788541126.005028:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 126 00000100:00100000:0.0:1788541126.005038:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68052e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+61:11392:x1875420955866496:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788541126.005116:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7f7e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.005135:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7f7e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.005146:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7f7e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.005173:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7f85 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.005181:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7f85 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.005187:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7f85 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.005210:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7f8c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.005220:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7f8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.005228:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7f8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541126.005281:0:9339:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788541126.005285:0:9339:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788541126.005296:0:9339:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7f8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.005307:0:9339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7f7e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.005314:0:9339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7f7e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.005321:0:9339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7f7e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.005335:0:9339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75f200 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541126.005340:0:9339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7f7e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.005347:0:9339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7f7e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.005367:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a68350c0d00) 00010000:00010000:0.0:1788541126.005370:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541126.005374:0:9339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7f7e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.005381:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7f7e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.005401:0:9339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7f85 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.005406:0:9339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7f85 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.005412:0:9339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7f85 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.005417:0:9339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75ec00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541126.005419:0:9339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7f85 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.005424:0:9339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7f85 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.005439:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff9a67078a1400) 00010000:00010000:0.0:1788541126.005441:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541126.005444:0:9339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7f85 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.005450:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7f85 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.005461:0:9339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7f8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.005466:0:9339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7f8c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.005471:0:9339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7f8c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.005476:0:9339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75fe00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541126.005479:0:9339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7f8c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.005484:0:9339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7f8c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.005491:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a68350c0800) 00010000:00010000:0.0:1788541126.005493:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541126.005496:0:9339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7f8c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.005501:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a7f8c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541126.005615:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68052e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+61:11392:x1875420955866496:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 Request processed in 576us (1240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541126.005623:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 126 00000100:00100000:0.0:1788541126.014105:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541126.014344:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955866752 00000100:00100000:1.0:1788541126.014419:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955866752 00000100:00100000:1.0:1788541126.014538:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 127 00000100:00100000:1.0:1788541126.014549:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707729f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+61:11392:x1875420955866752:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788541126.014584:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541126.014620:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a7f93 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331372 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.014751:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7f9a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.014768:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7f9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.014781:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7f9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788541126.014814:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788541126.014932:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7f9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.014941:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7f9a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.014949:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7f9a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.014954:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68354db800 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541126.014959:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7f9a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.014967:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7f9a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.014981:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a68350c0800) 00010000:00010000:1.0:1788541126.014984:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788541126.014988:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7f9a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.014995:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7f9a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.015043:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a7f93 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331372 expref: 63 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.015054:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a68350c0d00) 00010000:00010000:1.0:1788541126.015056:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788541126.015067:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a7f93 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331372 expref: 63 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.015077:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68354dba00, rc 0) 00000100:00100000:1.0:1788541126.015148:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707729f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+62:11392:x1875420955866752:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 600us (1058us total) trans 4294967399 rc 301/301 00000100:00100000:1.0:1788541126.015155:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 127 00000100:00100000:1.0:1788541126.020146:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541126.020430:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955866880 00000100:00100000:2.0:1788541126.020440:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955866880 00000100:00100000:2.0:1788541126.020499:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 128 00000100:00100000:2.0:1788541126.020510:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+62:11392:x1875420955866880:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788541126.020548:0:6518:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788541126.021106:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+62:11392:x1875420955866880:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 596us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541126.021114:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 128 00000100:00100000:2.0:1788541126.026964:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541126.027345:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955867136 00000100:00100000:3.0:1788541126.027428:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955867136 00000100:00100000:3.0:1788541126.027543:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 129 00000100:00100000:3.0:1788541126.027555:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+62:11392:x1875420955867136:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788541126.027591:0:12149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541126.027594:0:12149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788541126.027634:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a7f38 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331356 expref: 62 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.027655:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68350c4300) 00010000:00010000:3.0:1788541126.027661:0:12149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788541126.027676:0:12149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a7fa8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331379 expref: -99 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788541126.028503:0:12149:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:3.0:1788541126.028820:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075acc00/0x2aac941e5f4a7faf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.028855:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075acc00/0x2aac941e5f4a7faf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.028866:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075acc00/0x2aac941e5f4a7faf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.029815:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a7fa8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331379 expref: 64 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.029839:0:12149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075acc00/0x2aac941e5f4a7faf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331379 expref: 63 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.029849:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a683531ba00) 00010000:00010000:0.0:1788541126.029853:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788541126.029856:0:12149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075acc00, rc 0) 00000100:00100000:0.0:1788541126.030088:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+63:11392:x1875420955867136:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 2534us (3142us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1788541126.030098:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 129 00000100:00100000:0.0:1788541126.036279:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541126.036496:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955867392 00000100:00100000:1.0:1788541126.036507:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955867392 00000100:00100000:1.0:1788541126.036769:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 130 00000100:00100000:1.0:1788541126.036782:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670772b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+63:11392:x1875420955867392:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788541126.036914:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541126.036952:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075acc00/0x2aac941e5f4a7faf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331379 expref: 63 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.036972:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a683531ba00) 00010000:00010000:1.0:1788541126.036984:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788541126.037007:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7fbd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.037021:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7fbd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.037033:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7fbd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.037046:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a7fc4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xd729e436 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.037066:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a7fc4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xd729e436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.037074:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a7fc4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xd729e436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.037119:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7fbd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.037127:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7fbd lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.037134:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7fbd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.037139:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68354db800 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541126.037144:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7fbd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.037152:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7fbd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.037160:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68350c4300) 00010000:00010000:1.0:1788541126.037163:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541126.037168:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7fbd lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.037173:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a7fbd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.037183:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a7fc4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xd729e436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.037195:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a7fc4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xd729e436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.037201:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a7fc4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xd729e436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.037206:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68354dba00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541126.037209:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a7fc4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xd729e436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.037215:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a7fc4 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xd729e436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.037223:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xd729e436 (ffff9a6809c1c100) 00010000:00010000:1.0:1788541126.037226:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541126.037229:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a7fc4 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xd729e436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.037246:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a7fc4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xd729e436 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541126.037334:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670772b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+62:11392:x1875420955867392:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 555us (1065us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788541126.037341:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 130 00000100:00100000:2.0:1788541126.043301:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541126.043517:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955867520 00000100:00100000:1.0:1788541126.043528:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955867520 00000100:00100000:1.0:1788541126.043763:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 131 00000100:00100000:1.0:1788541126.043775:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+62:11392:x1875420955867520:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788541126.043798:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541126.043842:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbc00/0x2aac941e5f4a7fcb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331380 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.043900:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a7fd2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.043916:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a7fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.043930:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a7fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.044110:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbc00/0x2aac941e5f4a7fcb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331380 expref: 64 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.044131:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a7fd2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331380 expref: 63 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.044139:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a6809c1c200) 00010000:00010000:1.0:1788541126.044142:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788541126.044145:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68354db600, rc 0) 00000100:00100000:1.0:1788541126.044214:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+63:11392:x1875420955867520:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 441us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541126.044343:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 131 00000100:00100000:2.0:1788541126.048801:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541126.049248:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955867776 00000100:00100000:0.0:1788541126.049259:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955867776 00000100:00100000:0.0:1788541126.049328:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 132 00000100:00100000:0.0:1788541126.049339:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+63:11392:x1875420955867776:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788541126.050323:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7fd9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.050344:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7fd9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.051153:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7fd9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788541126.051350:0:12149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:0.0:1788541126.051508:0:12149:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 406969636743ns, next at 407969633693ns, rc = 0 00000004:00010000:0.0:1788541126.051789:0:12149:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b467ca37 reply state 0000000046500f84 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7fd9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.051806:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7fd9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.051816:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a6809c1c200) 00010000:00010000:0.0:1788541126.051819:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788541126.051824:0:12149:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788541126.052078:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+65:11392:x1875420955867776:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 2735us (3287us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1788541126.052089:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 132 00000100:00100000:2.0:1788541126.056067:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541126.056199:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955867904 00000100:00100000:0.0:1788541126.056211:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955867904 00000100:00100000:0.0:1788541126.056482:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 133 00000100:00100000:0.0:1788541126.056495:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708313100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+65:11392:x1875420955867904:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788541126.056526:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541126.056572:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7fe0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331387 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.056649:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7fe0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331387 expref: 66 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.056679:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7fe0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331387 expref: 66 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.056700:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a6809c1c200) 00010000:00010000:0.0:1788541126.056704:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788541126.056707:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75f200, rc 0) 00000100:00100000:0.0:1788541126.056777:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708313100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+66:11392:x1875420955867904:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 285us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541126.056785:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 133 00000100:00100000:2.0:1788541126.059643:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541126.059840:0:8973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955868032 00000100:00100000:3.0:1788541126.059851:0:8973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955868032 00000100:00100000:3.0:1788541126.059934:0:8973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 45 00000100:00100000:3.0:1788541126.059956:0:8973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708311c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:384f52e3-0481-4979-9299-157aff7472d2+8:2396:x1875420955868032:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788541126.060169:0:8973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708311c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:384f52e3-0481-4979-9299-157aff7472d2+9:2396:x1875420955868032:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 Request processed in 216us (534us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788541126.060177:0:8973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 45 00000100:00080000:2.0:1788541126.061589:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788541126.076247:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541126.076496:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955868288 00000100:00100000:0.0:1788541126.076508:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955868288 00000100:00100000:0.0:1788541126.076780:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 30 00000100:00100000:0.0:1788541126.076790:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708311180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+66:11392:x1875420955868288:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788541126.077045:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708311180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+67:11392:x1875420955868288:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 256us (808us total) trans 4294967402 rc 0/0 00000100:00100000:0.0:1788541126.077053:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 30 00000100:00100000:3.0:1788541126.086041:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541126.086169:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955868544 00000100:00100000:1.0:1788541126.086180:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955868544 00000100:00100000:1.0:1788541126.086256:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 134 00000100:00100000:1.0:1788541126.086268:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68052e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+67:11392:x1875420955868544:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788541126.086392:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68052e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+67:11392:x1875420955868544:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 125us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541126.086420:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 134 00000004:00080000:0.0:1788541126.090131:0:8971:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 407008258039ns, next at 408008255068ns, rc = 0 00000100:00100000:2.0:1788541126.090303:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981107584:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788541126.090384:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541126.090460:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788541126.090467:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68052e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981107712:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788541126.090506:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541126.090746:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981107840:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788541126.090778:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541126.090842:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981107584 00000100:00100000:1.0:1788541126.090850:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981107584 00000100:00100000:1.0:1788541126.090924:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981107712 00000100:00100000:1.0:1788541126.090928:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981107712 00000100:00100000:1.0:1788541126.090947:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788541126.090955:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708310a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875420981107584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788541126.090985:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788541126.090991:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981107840 00000100:00100000:0.0:1788541126.090995:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981107840 00000100:00100000:0.0:1788541126.091025:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788541126.091030:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708310a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875420981107584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541126.091032:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708310380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981107840:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788541126.091038:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788541126.091056:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000004:00000024:0.0:1788541126.091056:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788541126.091061:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708312680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981107712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788541126.091069:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788541126.091985:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708312680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981107712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 28us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541126.092002:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:1.0:1788541126.092033:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788541126.092092:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68052e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981107712:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788541126.092109:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981107584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788541126.096760:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541126.096868:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955868672 00000100:00100000:3.0:1788541126.096907:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955868672 00000100:00100000:3.0:1788541126.096968:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 135 00000100:00100000:3.0:1788541126.096978:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+67:11392:x1875420955868672:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788541126.097001:0:12149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541126.097024:0:12149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a7fe7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a33138e expref: -99 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.097098:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac200/0x2aac941e5f4a7fee lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.097115:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac200/0x2aac941e5f4a7fee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.097154:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac200/0x2aac941e5f4a7fee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541126.097205:0:12149:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788541126.097226:0:12149:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac200/0x2aac941e5f4a7fee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.097268:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a7fe7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33138e expref: 69 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.097287:0:12149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac200/0x2aac941e5f4a7fee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33138e expref: 68 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.097296:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a6809c1c200) 00010000:00010000:3.0:1788541126.097299:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788541126.097303:0:12149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075ac200, rc 0) 00000100:00100000:3.0:1788541126.097860:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+68:11392:x1875420955868672:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 880us (1518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541126.097896:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 135 00000100:00100000:1.0:1788541126.101420:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541126.101581:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955868800 00000100:00100000:3.0:1788541126.101591:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955868800 00000100:00100000:3.0:1788541126.101648:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 46 00000100:00100000:3.0:1788541126.101659:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:384f52e3-0481-4979-9299-157aff7472d2+9:2397:x1875420955868800:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788541126.101678:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541126.101699:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e6d1dbf/0x2aac941e5f4a7ff5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331395 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788541126.101746:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9af8c6, blocks: 0x0 00010000:00010000:3.0:1788541126.101766:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=407s v=(0 0) 00010000:00010000:3.0:1788541126.101771:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541126.101779:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e6d1dbf/0x2aac941e5f4a7ff5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331395 expref: 10 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.101797:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000e6d1dbf/0x2aac941e5f4a7ff5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331395 expref: 10 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.101809:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075aca00, rc 0) 00000100:00100000:3.0:1788541126.101860:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:384f52e3-0481-4979-9299-157aff7472d2+10:2397:x1875420955868800:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 203us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541126.101891:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 46 00000100:00100000:0.0:1788541126.103632:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708310380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981107840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 12582us (12835us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541126.103674:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788541126.107509:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981107840:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788541126.113604:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541126.114100:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955869056 00000100:00100000:2.0:1788541126.114116:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955869056 00000100:00100000:2.0:1788541126.114183:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 136 00000100:00100000:2.0:1788541126.114196:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707729500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+68:11392:x1875420955869056:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788541126.114346:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707729500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+68:11392:x1875420955869056:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 151us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541126.114354:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 136 00000100:00100000:3.0:1788541126.118091:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541126.118274:0:8973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955869184 00000100:00100000:1.0:1788541126.118285:0:8973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955869184 00000100:00100000:1.0:1788541126.118355:0:8973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 47 00000100:00100000:1.0:1788541126.118365:0:8973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68052e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:384f52e3-0481-4979-9299-157aff7472d2+10:11392:x1875420955869184:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788541126.118405:0:8973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541126.118430:0:8973:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087b02810/0x2aac941e5f4a7ffc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a33139c expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.118472:0:8973:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000e6d1dbf/0x2aac941e5f4a7ff5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331395 expref: 11 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.118483:0:8973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541126.118487:0:8973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541126.118492:0:8973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087b02810/0x2aac941e5f4a7ffc lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33139c expref: 11 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.118535:0:8973:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000e6d1dbf/0x2aac941e5f4a7ff5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331395 expref: 11 pid: 8432 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.118550:0:8973:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000e6d1dbf/0x2aac941e5f4a7ff5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331395 expref: 11 pid: 8432 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541126.118580:0:8973:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8973:1875420981107968:192.168.202.56@tcp:104: 00000100:00100000:1.0:1788541126.118696:0:8973:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a682ff91540 going to sleep for 11 seconds 00000100:00100000:1.0:1788541126.122175:0:8973:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8973:1875420981107968:192.168.202.56@tcp:104: 00010000:00010000:1.0:1788541126.122216:0:8973:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000087b02810/0x2aac941e5f4a7ffc lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xa16473202a33139c expref: 11 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.122238:0:8973:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68354dba00, rc 0) 00000100:00100000:1.0:1788541126.122317:0:8973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68052e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:384f52e3-0481-4979-9299-157aff7472d2+11:11392:x1875420955869184:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 3952us (4236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541126.122326:0:8973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 47 00000100:00100000:0.0:1788541126.124739:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541126.124913:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955869312 00000100:00100000:1.0:1788541126.124925:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955869312 00010000:00010000:1.0:1788541126.124968:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000e6d1dbf/0x2aac941e5f4a7ff5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331395 expref: 11 pid: 8432 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541126.125014:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 72 00000100:00100000:1.0:1788541126.125024:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670772bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:384f52e3-0481-4979-9299-157aff7472d2+11:2397:x1875420955869312:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788541126.125041:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541126.125068:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000e6d1dbf/0x2aac941e5f4a7ff5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331395 expref: 11 pid: 8432 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.125082:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000e6d1dbf/0x2aac941e5f4a7ff5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331395 expref: 11 pid: 8432 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.125111:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e6d1dbf/0x2aac941e5f4a7ff5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331395 expref: 11 pid: 8432 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.125130:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541126.125135:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541126.125143:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000087b02810/0x2aac941e5f4a7ffc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xa16473202a33139c expref: 10 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.125154:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087b02810/0x2aac941e5f4a7ffc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xa16473202a33139c expref: 10 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.125221:0:6504:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000087b02810/0x2aac941e5f4a7ffc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xa16473202a33139c expref: 10 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541126.125238:0:6504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6504:1875420981108096:192.168.202.56@tcp:105: 00000100:00100000:1.0:1788541126.125320:0:6504:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a682ff91540 going to sleep for 11 seconds 00000100:00100000:3.0:1788541126.132818:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541126.132971:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955869440 00000100:00100000:0.0:1788541126.132982:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955869440 00002000:00100000:0.0:1788541126.133044:0:8436:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9a68052e4700 x1875420955869440/t0(0) o4->384f52e3-0481-4979-9299-157aff7472d2@192.168.202.56@tcp:497/0 lens 504/0 e 0 to 0 dl 1788541137 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788541126.133057:0:8436:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a68052e4700 with x1875420955869440 ext(0->12) 00002000:00010000:0.0:1788541126.133063:0:8436:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a68052e4700 00000100:00100000:0.0:1788541126.133103:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 2 00000100:00100000:0.0:1788541126.133113:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68052e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:384f52e3-0481-4979-9299-157aff7472d2+11:2397:x1875420955869440:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788541126.133706:0:6504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6504:1875420981108096:192.168.202.56@tcp:105: 00010000:00010000:1.0:1788541126.133730:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788541126.133797:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670772bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:384f52e3-0481-4979-9299-157aff7472d2+11:2397:x1875420955869312:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 8773us (9067us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541126.133808:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 72 00000100:00100000:0.0:1788541126.135118:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68052e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:384f52e3-0481-4979-9299-157aff7472d2+12:2397:x1875420955869440:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 Request processed in 1998us (2302us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788541126.135130:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 2 00002000:00100000:0.0:1788541126.135142:0:8436:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9a68052e4700 x1875420955869440/t4294967309(0) o4->384f52e3-0481-4979-9299-157aff7472d2@192.168.202.56@tcp:497/0 lens 504/448 e 0 to 0 dl 1788541137 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788541126.135153:0:8436:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a68052e4700 with x1875420955869440 ext(0->12) 00002000:00010000:0.0:1788541126.135158:0:8436:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a68052e4700 00000100:00100000:3.0:1788541126.137789:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541126.137914:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955869568 00000100:00100000:2.0:1788541126.137927:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955869568 00000100:00100000:2.0:1788541126.137996:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 137 00000100:00100000:2.0:1788541126.138008:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68052e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+68:11392:x1875420955869568:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 00000004:00080000:0.0:1788541126.144832:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000001:00080000:0.0:1788541126.144947:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:0.0:1788541126.144956:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:0.0:1788541126.144995:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1788541126.145006:0:6496:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a67068759c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1788541126.145012:0:6496:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a6706b2e800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a6706875d80 00000020:00080000:0.0:1788541126.145035:0:6496:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a6706b2e600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a6803784a00 00000004:00080000:0.0:1788541126.145063:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1788541126.145086:0:6496:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a6706ab4480 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1788541126.145089:0:6496:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a680a09d100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a6706ab4240 00000020:00080000:0.0:1788541126.145093:0:6496:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a680a09d200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a6707b8ec00 00010000:00010000:3.0:1788541126.145244:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a7d01 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.145268:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a7d01 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.145277:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a7d01 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.145282:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075ac600 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541126.145294:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a7d01 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.145302:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a7d01 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.145321:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9a68350c4100) 00010000:00010000:3.0:1788541126.145325:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541126.145330:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a7d01 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.145336:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a7d01 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.145362:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a7da9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.145369:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a7da9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.145374:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a7da9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.145379:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842049000 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541126.145382:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a7da9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.145388:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a7da9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.145516:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9a68350c0100) 00010000:00010000:3.0:1788541126.145520:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541126.145529:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a7da9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.145535:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a7da9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.145555:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048e00/0x2aac941e5f4a7e27 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.145561:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048e00/0x2aac941e5f4a7e27 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.145566:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048e00/0x2aac941e5f4a7e27 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.145571:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842048e00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541126.145574:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048e00/0x2aac941e5f4a7e27 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.145579:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048e00/0x2aac941e5f4a7e27 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.145587:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a68350c0e00) 00010000:00010000:3.0:1788541126.145590:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541126.145592:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048e00/0x2aac941e5f4a7e27 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.145598:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048e00/0x2aac941e5f4a7e27 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.145607:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da200/0x2aac941e5f4a7e4a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.145622:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da200/0x2aac941e5f4a7e4a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.145628:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da200/0x2aac941e5f4a7e4a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.145633:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68354da200 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541126.145635:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da200/0x2aac941e5f4a7e4a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.145642:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da200/0x2aac941e5f4a7e4a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.145650:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a68350c0e00) 00010000:00010000:3.0:1788541126.145652:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541126.145654:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da200/0x2aac941e5f4a7e4a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.145659:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da200/0x2aac941e5f4a7e4a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.145674:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a7f1c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.145679:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a7f1c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.145684:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a7f1c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.145688:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075ada00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541126.145696:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a7f1c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.145702:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a7f1c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.145711:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a68350c0800) 00010000:00010000:3.0:1788541126.145713:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541126.145716:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a7f1c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.145721:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a7f1c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.145733:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7fd9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.145739:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7fd9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.145744:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7fd9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.145750:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75ec00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541126.145752:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7fd9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.145758:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7fd9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.145765:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a6809c1c200) 00010000:00010000:3.0:1788541126.145767:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788541126.145778:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7fd9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.145784:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a7fd9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541126.146151:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68052e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+16:11392:x1875420955869568:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 Request processed in 8137us (8367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541126.146165:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 137 00000100:00100000:0.0:1788541126.146531:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708310e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981108224:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788541126.146609:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1788541126.146779:0:6549:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1788541126.146846:0:6549:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1788541126.146858:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981108480:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788541126.146943:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541126.146967:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788541126.146974:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981108352:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788541126.146999:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541126.147029:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981108224 00000100:00100000:1.0:1788541126.147037:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981108224 00000100:00100000:1.0:1788541126.147078:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981108480 00000100:00100000:1.0:1788541126.147081:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981108480 00000100:00100000:1.0:1788541126.147107:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981108352 00000100:00100000:1.0:1788541126.147111:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981108352 00000100:00100000:1.0:1788541126.147125:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788541126.147135:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707728000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3642:x1875420981108224:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788541126.147175:0:8430:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00010000:1.0:1788541126.147220:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9af8c4, atime: 0x6a9af8c4, ctime: 0x6a9af8c4, blocks: 0x8 00010000:00010000:1.0:1788541126.147229:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067ec5533/0x2aac941e5f4a8003 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.147249:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=407s v=(0 0) 00010000:00010000:1.0:1788541126.147253:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541126.147260:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067ec5533/0x2aac941e5f4a8003 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.147278:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067ec5533/0x2aac941e5f4a8003 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.147288:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067ec5533/0x2aac941e5f4a8003 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.147297:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067ec5533/0x2aac941e5f4a8003 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.147315:0:8430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788541126.147467:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707728000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3642:x1875420981108224:12345-0@lo:6:osp-syn-0-0.0 Request processed in 332us (856us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788541126.147475:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788541126.147495:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788541126.147502:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708272300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3644:x1875420981108480:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788541126.147607:0:8430:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788541126.147616:0:8430:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788541126 00002000:00010000:1.0:1788541126.147619:0:8430:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788541126.147621:0:8430:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788541126 -> 1788541126 00002000:00010000:1.0:1788541126.147623:0:8430:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788541126.147662:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708272300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3644:x1875420981108480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 162us (719us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788541126.147669:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788541126.147682:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788541126.147690:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708271f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3644:x1875420981108352:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788541126.147701:0:8430:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:1.0:1788541126.147714:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056f0c80e/0x2aac941e5f4a800a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.147729:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000de5a30ec/0x2aac941e5f4a7db7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3312f4 expref: 11 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.147737:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1788541126.147740:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788541126.147743:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056f0c80e/0x2aac941e5f4a800a lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.147772:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000de5a30ec/0x2aac941e5f4a7db7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.56@tcp remote: 0xa16473202a3312f4 expref: 11 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.147789:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000de5a30ec/0x2aac941e5f4a7db7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.56@tcp remote: 0xa16473202a3312f4 expref: 11 pid: 8432 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541126.147816:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708273100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1875420981108608:192.168.202.56@tcp:104: 00000004:00080000:3.0:1788541126.147838:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a670835fb80/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788541126.147847:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981108480:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788541126.147914:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a682ff91d80 going to sleep for 11 seconds 00000100:00080000:1.0:1788541126.147934:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788541126.147946:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788541126.147952:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067ec5533/0x2aac941e5f4a8003 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.147959:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68354db800 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:1.0:1788541126.147963:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067ec5533/0x2aac941e5f4a8003 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.147973:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067ec5533/0x2aac941e5f4a8003 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.147989:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067ec5533/0x2aac941e5f4a8003 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.147996:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067ec5533/0x2aac941e5f4a8003 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.148019:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541126.148021:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541126.148023:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788541126.148046:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a6708310e00/2, rc 0, transno 4294967305 00000100:00100000:1.0:1788541126.148052:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708310e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981108224:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788541126.150746:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541126.151502:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708273100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1875420981108608:192.168.202.56@tcp:104: 00010000:00010000:1.0:1788541126.151530:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000056f0c80e/0x2aac941e5f4a800a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541126.151699:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541126.152864:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955869824 00000100:00100000:1.0:1788541126.152896:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955869824 00000100:00100000:1.0:1788541126.152958:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 51 00000100:00100000:1.0:1788541126.152968:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68052e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:384f52e3-0481-4979-9299-157aff7472d2+12:2395:x1875420955869824:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788541126.156621:0:9520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955869696 00000100:00100000:2.0:1788541126.156644:0:9520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955869696 00010000:00010000:1.0:1788541126.157219:0:9520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000de5a30ec/0x2aac941e5f4a7db7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.56@tcp remote: 0xa16473202a3312f4 expref: 13 pid: 8432 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541126.157482:0:9520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 73 00000100:00100000:1.0:1788541126.157496:0:9520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a680763d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:384f52e3-0481-4979-9299-157aff7472d2+13:2396:x1875420955869696:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788541126.157516:0:9520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541126.157523:0:9520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000de5a30ec/0x2aac941e5f4a7db7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.56@tcp remote: 0xa16473202a3312f4 expref: 13 pid: 8432 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.157538:0:9520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000de5a30ec/0x2aac941e5f4a7db7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.56@tcp remote: 0xa16473202a3312f4 expref: 13 pid: 8432 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.157565:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de5a30ec/0x2aac941e5f4a7db7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.56@tcp remote: 0xa16473202a3312f4 expref: 13 pid: 8432 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.157585:0:9520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788541126.157605:0:9520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788541126.157613:0:9520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000056f0c80e/0x2aac941e5f4a800a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.157624:0:9520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056f0c80e/0x2aac941e5f4a800a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.157722:0:9520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788541126.157791:0:9520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a680763d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:384f52e3-0481-4979-9299-157aff7472d2+12:2396:x1875420955869696:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 298us (7055us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541126.157799:0:9520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 73 00010000:00010000:2.0:1788541126.159001:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000056f0c80e/0x2aac941e5f4a800a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.159016:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056f0c80e/0x2aac941e5f4a800a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.159024:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056f0c80e/0x2aac941e5f4a800a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.159028:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056f0c80e/0x2aac941e5f4a800a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.159054:0:8430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788541126.159482:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708271f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3644:x1875420981108352:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11790us (12479us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788541126.159493:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:3.0:1788541126.159622:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a670835e300/2, rc 0, transno 4294967311 00000100:00100000:3.0:1788541126.159629:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981108352:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788541126.160851:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541126.160864:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056f0c80e/0x2aac941e5f4a800a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.160915:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68354da800 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788541126.160921:0:8446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056f0c80e/0x2aac941e5f4a800a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.160933:0:8446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056f0c80e/0x2aac941e5f4a800a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.160956:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056f0c80e/0x2aac941e5f4a800a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.160965:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056f0c80e/0x2aac941e5f4a800a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.160991:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541126.161011:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541126.161012:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788541126.161728:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:0.0:1788541126.161751:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:1.0:1788541126.161958:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68052e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:384f52e3-0481-4979-9299-157aff7472d2+6:2395:x1875420955869824:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 Request processed in 8984us (10252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541126.161970:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 51 00000100:00100000:3.0:1788541126.165712:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541126.165804:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955870080 00000100:00100000:1.0:1788541126.165815:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955870080 00000100:00100000:1.0:1788541126.165932:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 138 00000100:00100000:1.0:1788541126.165943:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68052e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+16:11392:x1875420955870080:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788541126.165999:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541126.166025:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac200/0x2aac941e5f4a7fee lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33138e expref: 16 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.166045:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a6809c1c200) 00010000:00010000:1.0:1788541126.166050:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788541126.166081:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a8011 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.166096:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a8011 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.166122:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a8011 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788541126.166242:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f7f2a7d4 reply state 00000000867a017f transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a8011 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.166268:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a8011 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.166275:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a6809c1c200) 00010000:00010000:1.0:1788541126.166277:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788541126.166280:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788541126.166370:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68052e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+17:11392:x1875420955870080:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 428us (666us total) trans 4294967403 rc 0/0 00000100:00100000:1.0:1788541126.166388:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 138 00000100:00100000:3.0:1788541126.171692:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541126.171776:0:8973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955870208 00000100:00100000:1.0:1788541126.171786:0:8973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955870208 00000100:00100000:1.0:1788541126.171839:0:8973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 52 00000100:00100000:1.0:1788541126.171849:0:8973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68052e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:384f52e3-0481-4979-9299-157aff7472d2+6:2397:x1875420955870208:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788541126.172025:0:8973:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788541126.172029:0:8973:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1788541126 -> 1788541124 00002000:00010000:1.0:1788541126.172032:0:8973:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788541124 00002000:00010000:1.0:1788541126.172034:0:8973:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788541126 -> 1788541124 00002000:00010000:1.0:1788541126.172036:0:8973:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788541126.172096:0:8973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68052e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:384f52e3-0481-4979-9299-157aff7472d2+7:2397:x1875420955870208:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 Request processed in 248us (413us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788541126.172104:0:8973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 52 00000100:00100000:3.0:1788541126.175559:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541126.177542:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955870464 00000100:00100000:1.0:1788541126.177559:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955870464 00000100:00100000:1.0:1788541126.177643:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 139 00000100:00100000:1.0:1788541126.177655:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68052e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+17:11392:x1875420955870464:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788541126.177729:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a8018 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.177746:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a7fd2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331380 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.177755:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a8018 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.177791:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a7fd2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331380 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.177805:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a7fd2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331380 expref: 17 pid: 6517 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541126.177817:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708273100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1875420981108736:192.168.202.56@tcp:104: 00000100:00100000:1.0:1788541126.178015:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a682ff91000 going to sleep for 11 seconds 00000100:00100000:1.0:1788541126.187639:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708273100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1875420981108736:192.168.202.56@tcp:104: 00010000:00010000:1.0:1788541126.187674:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a8018 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541126.191190:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541126.194018:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955870592 00000100:00100000:2.0:1788541126.194033:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955870592 00010000:00010000:2.0:1788541126.194089:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a7fd2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331380 expref: 18 pid: 6517 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541126.194138:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 74 00000100:00100000:2.0:1788541126.194150:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68052e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:384f52e3-0481-4979-9299-157aff7472d2+18:2397:x1875420955870592:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541126.194167:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541126.194175:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a7fd2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331380 expref: 18 pid: 6517 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.194191:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a7fd2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331380 expref: 18 pid: 6517 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.194215:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a7fd2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331380 expref: 18 pid: 6517 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.194235:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a6809c1c200) 00010000:00010000:2.0:1788541126.194241:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a8018 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.194252:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a8018 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.194276:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a8018 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.194314:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541126.194390:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68052e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:384f52e3-0481-4979-9299-157aff7472d2+17:2397:x1875420955870592:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 242us (3208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541126.194409:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 74 00010000:00010000:1.0:1788541126.195029:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a8018 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.195039:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a8018 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.195083:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a8018 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.195090:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a8018 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.195097:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a8018 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.195102:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68354db800 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541126.195107:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a8018 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.195114:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a8018 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.195125:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a6809c1c200) 00010000:00010000:1.0:1788541126.195128:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788541126.195131:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a8018 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.195137:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a8018 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541126.195193:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68052e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+16:11392:x1875420955870464:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 Request processed in 17540us (19643us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788541126.195201:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 139 00000100:00100000:3.0:1788541126.199143:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541126.200036:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955870720 00000100:00100000:2.0:1788541126.200049:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955870720 00000100:00100000:2.0:1788541126.200109:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 53 00000100:00100000:2.0:1788541126.200122:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68357b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:384f52e3-0481-4979-9299-157aff7472d2+7:2396:x1875420955870720:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788541126.200168:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000003ed1e60/0x2aac941e5f4a801f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.200191:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000087b02810/0x2aac941e5f4a7ffc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xa16473202a33139c expref: 7 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.200198:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541126.200202:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788541126.200206:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003ed1e60/0x2aac941e5f4a801f lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.200241:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000087b02810/0x2aac941e5f4a7ffc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xa16473202a33139c expref: 7 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.200256:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000087b02810/0x2aac941e5f4a7ffc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a33139c expref: 7 pid: 8973 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541126.200284:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708313480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1875420981108864:192.168.202.56@tcp:104: 00000100:00100000:2.0:1788541126.200374:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707964d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788541126.210289:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541126.210635:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955870848 00000100:00100000:3.0:1788541126.210648:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955870848 00010000:00010000:3.0:1788541126.210694:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000087b02810/0x2aac941e5f4a7ffc lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a33139c expref: 8 pid: 8973 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541126.210736:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 75 00000100:00100000:3.0:1788541126.210745:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707728e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:384f52e3-0481-4979-9299-157aff7472d2+8:2396:x1875420955870848:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541126.210759:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541126.210780:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000087b02810/0x2aac941e5f4a7ffc lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a33139c expref: 8 pid: 8973 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.210810:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000087b02810/0x2aac941e5f4a7ffc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a33139c expref: 8 pid: 8973 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.210831:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788541126.210835:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788541126.210842:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000003ed1e60/0x2aac941e5f4a801f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.210852:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003ed1e60/0x2aac941e5f4a801f lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.210900:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541126.210960:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707728e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:384f52e3-0481-4979-9299-157aff7472d2+8:2396:x1875420955870848:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 216us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541126.210966:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 75 00010000:00010000:2.0:1788541126.211499:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087b02810/0x2aac941e5f4a7ffc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a33139c expref: 7 pid: 8973 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541126.211518:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708313480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1875420981108864:192.168.202.56@tcp:104: 00010000:00010000:2.0:1788541126.211539:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000003ed1e60/0x2aac941e5f4a801f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.211550:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000003ed1e60/0x2aac941e5f4a801f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.211557:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003ed1e60/0x2aac941e5f4a801f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.211589:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000003ed1e60/0x2aac941e5f4a801f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.211598:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003ed1e60/0x2aac941e5f4a801f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.211606:0:8430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003ed1e60/0x2aac941e5f4a801f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.211625:0:8430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551b200 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:2.0:1788541126.211629:0:8430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003ed1e60/0x2aac941e5f4a801f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.211639:0:8430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003ed1e60/0x2aac941e5f4a801f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.211652:0:8430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003ed1e60/0x2aac941e5f4a801f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.211660:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003ed1e60/0x2aac941e5f4a801f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541126.211712:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68357b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:384f52e3-0481-4979-9299-157aff7472d2+6:2396:x1875420955870720:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 11594us (12578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541126.211721:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 53 00010000:00010000:3.0:1788541126.219173:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541126.222599:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541126.222672:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955871104 00000100:00100000:2.0:1788541126.222681:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955871104 00000100:00100000:2.0:1788541126.222736:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 140 00000100:00100000:2.0:1788541126.222744:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708273100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+16:11392:x1875420955871104:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788541126.222818:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a8026 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.222834:0:9339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a7f15 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331348 expref: 16 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.222862:0:9339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a8026 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.222930:0:9339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a7f15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331348 expref: 16 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.223280:0:9339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a7f15 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331348 expref: 16 pid: 12149 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541126.223295:0:9339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708311c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9339:1875420981108992:192.168.202.56@tcp:104: 00000100:00100000:2.0:1788541126.223416:0:9339:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707964d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788541126.237317:0:9339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708311c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9339:1875420981108992:192.168.202.56@tcp:104: 00010000:00010000:2.0:1788541126.237357:0:9339:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a8026 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541126.238340:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541126.240229:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955871232 00000100:00100000:3.0:1788541126.240244:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955871232 00010000:00010000:3.0:1788541126.240302:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a7f15 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331348 expref: 17 pid: 12149 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541126.240355:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 76 00000100:00100000:3.0:1788541126.240365:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708271c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:384f52e3-0481-4979-9299-157aff7472d2+17:2397:x1875420955871232:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541126.240381:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541126.240388:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a7f15 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331348 expref: 17 pid: 12149 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.240429:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a7f15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331348 expref: 17 pid: 12149 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.240454:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a7f15 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331348 expref: 17 pid: 12149 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.240472:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a68350c0800) 00010000:00010000:3.0:1788541126.240478:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a7f77 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33136b expref: 16 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.240489:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a8026 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.240497:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a8026 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.240505:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a8026 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.240546:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788541126.240672:0:9339:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a8026 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.240682:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a8026 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.240854:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a802d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.240866:0:9339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7fe0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331387 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.240919:0:9339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a802d lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.240966:0:9339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7fe0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331387 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.240983:0:9339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7fe0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331387 expref: 17 pid: 6518 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541126.240997:0:9339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670772bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9339:1875420981109120:192.168.202.56@tcp:104: 00000100:00100000:0.0:1788541126.241096:0:9339:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68355193c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788541126.241366:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708271c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:384f52e3-0481-4979-9299-157aff7472d2+17:2397:x1875420955871232:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 1001us (3028us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541126.241376:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 76 00000100:00100000:0.0:1788541126.248001:0:9339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670772bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9339:1875420981109120:192.168.202.56@tcp:104: 00010000:00010000:0.0:1788541126.248041:0:9339:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a802d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541126.253332:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541126.253450:0:9520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955871360 00000100:00100000:0.0:1788541126.253461:0:9520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955871360 00010000:00010000:0.0:1788541126.253511:0:9520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7fe0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331387 expref: 17 pid: 6518 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541126.253554:0:9520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 77 00000100:00100000:0.0:1788541126.254027:0:9520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708271180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:384f52e3-0481-4979-9299-157aff7472d2+17:2397:x1875420955871360:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788541126.254050:0:9520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541126.254059:0:9520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7fe0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331387 expref: 17 pid: 6518 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.254074:0:9520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7fe0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331387 expref: 17 pid: 6518 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.254097:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a7fe0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331387 expref: 17 pid: 6518 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.254116:0:9520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a6809c1c200) 00010000:00010000:0.0:1788541126.254121:0:9520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a802d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.254131:0:9520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a802d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.254139:0:9520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a802d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.254512:0:9520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541126.254586:0:9520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708271180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:384f52e3-0481-4979-9299-157aff7472d2+16:2397:x1875420955871360:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 565us (1267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541126.254595:0:9520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 77 00010000:00010000:2.0:1788541126.258536:0:9339:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a802d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.258556:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a802d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788541126.258743:0:9339:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:2.0:1788541126.259040:0:9339:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:2.0:1788541126.259081:0:9339:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:2.0:1788541126.259171:0:9339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708311c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9339:1875420981109248:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788541126.259257:0:9339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541126.260010:0:9339:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707964480 going to sleep for 11 seconds 00000100:00100000:0.0:1788541126.263736:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981109248 00000100:00100000:0.0:1788541126.263755:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981109248 00000100:00100000:0.0:1788541126.263819:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788541126.263830:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708313480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9339:x1875420981109248:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788541126.264293:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708313480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9339:x1875420981109248:12345-0@lo:1000:mdt00_003.0 Request processed in 464us (5033us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541126.264302:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788541126.264388:0:9339:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1788541126.264403:0:9339:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:2.0:1788541126.264425:0:9339:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a670835fb80, transno 4294967310 00000100:00100000:2.0:1788541126.264438:0:9339:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9a670835e300 x1875420981108352/t4294967311(4294967311) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788541142 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541126.264452:0:9339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708311c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9339:1875420981109248:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788541126.264608:0:9339:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:2.0:1788541126.264681:0:9339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708311c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9339:1875420981109376:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788541126.264721:0:9339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541126.264748:0:9339:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707964840 going to sleep for 11 seconds 00000100:00100000:0.0:1788541126.265653:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981109376 00000100:00100000:0.0:1788541126.265661:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981109376 00000100:00100000:0.0:1788541126.265708:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788541126.265718:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708311500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9339:x1875420981109376:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788541126.265951:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708311500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:9339:x1875420981109376:12345-0@lo:1000:mdt00_003.0 Request processed in 234us (1229us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1788541126.265959:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788541126.266089:0:9339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708311c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9339:1875420981109376:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1788541126.266132:0:9339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a802d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.266141:0:9339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a802d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.266149:0:9339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a802d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.266155:0:9339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75fe00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:2.0:1788541126.266159:0:9339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a802d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.266167:0:9339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a802d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.266183:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a6809c1c200) 00010000:00010000:2.0:1788541126.266187:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788541126.266206:0:9339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a802d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.266213:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a802d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.266237:0:9339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a7f70 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.266243:0:9339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a7f70 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.266248:0:9339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a7f70 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.266253:0:9339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551a000 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:2.0:1788541126.266256:0:9339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a7f70 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.266262:0:9339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a7f70 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.266271:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a68350c0800) 00010000:00010000:2.0:1788541126.266273:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788541126.266281:0:9339:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a7f77 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33136b expref: 19 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.266293:0:9339:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a7f77 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33136b expref: 19 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.266303:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a7f77 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33136b expref: 19 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.266348:0:9339:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a7f77 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33136b expref: 19 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541126.266361:0:9339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708310700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9339:1875420981109504:192.168.202.56@tcp:105: 00000100:00100000:2.0:1788541126.266445:0:9339:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707964840 going to sleep for 11 seconds 00000100:00100000:1.0:1788541126.269202:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541126.269330:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955871488 00000100:00100000:3.0:1788541126.269339:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955871488 00000100:00100000:3.0:1788541126.269407:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 31 00000100:00100000:3.0:1788541126.269417:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708270a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+20:11391:x1875420955871488:12345-192.168.202.56@tcp:49:lfs.0 00000100:00100000:3.0:1788541126.269585:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708270a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+20:11391:x1875420955871488:12345-192.168.202.56@tcp:49:lfs.0 Request processed in 170us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541126.269593:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 31 00000100:00100000:2.0:1788541126.270381:0:9339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708310700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9339:1875420981109504:192.168.202.56@tcp:105: 00010000:00010000:2.0:1788541126.270691:0:9339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a7f70 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.270702:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a7f70 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.270736:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a8034 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.270752:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a8034 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.270764:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a8034 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.270774:0:9339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a8034 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.270781:0:9339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a8034 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.270787:0:9339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a8034 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.270805:0:9339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551b200 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:2.0:1788541126.270810:0:9339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a8034 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.270817:0:9339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a8034 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541126.271606:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00010000:00010000:2.0:1788541126.271632:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a68350c0800) 00010000:00010000:2.0:1788541126.271636:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541126.271641:0:9339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a8034 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.271648:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a8034 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.271661:0:9339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a8026 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.271667:0:9339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a8026 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.271673:0:9339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a8026 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.271678:0:9339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551b600 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:2.0:1788541126.271681:0:9339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a8026 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.271688:0:9339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a8026 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.271712:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a68350c0800) 00010000:00010000:2.0:1788541126.271715:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788541126.271718:0:9339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a8026 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.271723:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a8026 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541126.271725:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955871744 00000100:00100000:1.0:1788541126.271733:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955871744 00000100:00100000:1.0:1788541126.271789:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 141 00000100:00100000:1.0:1788541126.271798:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68052e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+20:11391:x1875420955871744:12345-192.168.202.56@tcp:58:lfs.0 00000040:00080000:1.0:1788541126.271978:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1788541126.272043:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68052e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+20:11391:x1875420955871744:12345-192.168.202.56@tcp:58:lfs.0 Request processed in 244us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541126.272051:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 141 00000040:00080000:2.0:1788541126.273140:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788541126.273146:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788541126.273184:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788541126.273193:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788541126.273313:0:13798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708310700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1875420981109632:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788541126.273388:0:13798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707964180 going to sleep for 11 seconds 00000100:00100000:3.0:1788541126.273596:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708273100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+20:11392:x1875420955871104:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 50849us (51004us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1788541126.273606:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 140 00000020:00080000:3.0:1788541126.273611:0:9339:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788541126.279745:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541126.280060:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955872000 00000100:00100000:2.0:1788541126.280075:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955872000 00000100:00100000:2.0:1788541126.280135:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 32 00000100:00100000:2.0:1788541126.280148:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6811402050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+20:11392:x1875420955872000:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788541126.280461:0:6520:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788541126.280496:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:2.0:1788541126.281267:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a803b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.281288:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a803b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.281302:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a803b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.281331:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a803b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.281338:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a803b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.281344:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a803b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541126.281404:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788541126.281515:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6811402050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+22:11392:x1875420955872000:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 1367us (1778us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1788541126.281525:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 32 00000020:00080000:2.0:1788541126.281545:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788541126.282410:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788541126.282422:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a803b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.282432:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551b400 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:1.0:1788541126.282437:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a803b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.282446:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a803b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.282463:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a6809c1c200) 00010000:00010000:1.0:1788541126.282466:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788541126.282470:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a803b lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.282476:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a803b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.282501:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541126.282503:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541126.282519:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541126.285529:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541126.285727:0:13798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708310700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1875420981109632:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788541126.286012:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955872128 00000100:00100000:1.0:1788541126.286020:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955872128 00000100:00100000:1.0:1788541126.286197:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 142 00000100:00100000:1.0:1788541126.286211:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68052e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+21:11393:x1875420955872128:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788541126.286250:0:6519:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788541126.286378:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68052e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+21:11393:x1875420955872128:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 169us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541126.287216:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 142 00000100:00100000:2.0:1788541126.295337:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541126.296243:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955872384 00000100:00100000:1.0:1788541126.296255:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955872384 00000100:00100000:1.0:1788541126.296331:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 143 00000100:00100000:1.0:1788541126.296342:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708310700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+21:11393:x1875420955872384:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788541126.296370:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541126.296407:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da200/0x2aac941e5f4a8042 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3313a3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.296521:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbc00/0x2aac941e5f4a8049 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.296536:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbc00/0x2aac941e5f4a8049 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.296549:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbc00/0x2aac941e5f4a8049 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788541126.296562:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788541126.296677:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da200/0x2aac941e5f4a8042 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3313a3 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.296715:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbc00/0x2aac941e5f4a8049 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3313a3 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.296725:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a68350c0800) 00010000:00010000:1.0:1788541126.296728:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788541126.296731:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68354dbc00, rc 0) 00000100:00100000:1.0:1788541126.296818:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708310700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+23:11393:x1875420955872384:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 477us (1490us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1788541126.296825:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 143 00000100:00100000:3.0:1788541126.317115:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541126.317290:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955872640 00000100:00100000:0.0:1788541126.317301:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955872640 00000100:00100000:0.0:1788541126.317372:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 144 00000100:00100000:0.0:1788541126.317383:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68052e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+23:11393:x1875420955872640:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788541126.317478:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a8057 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.317497:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a8057 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.317509:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a8057 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.317669:0:9339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a8057 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.317677:0:9339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a8057 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.317684:0:9339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a8057 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.317690:0:9339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75f200 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541126.317694:0:9339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a8057 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.317702:0:9339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a8057 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.317715:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a68350c0800) 00010000:00010000:0.0:1788541126.317718:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788541126.317723:0:9339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a8057 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541126.317729:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a8057 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541126.318488:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68052e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+24:11393:x1875420955872640:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 1094us (1370us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1788541126.318499:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 144 00000040:00080000:2.0:1788541126.319209:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788541126.319215:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788541126.319708:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788541126.319717:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788541126.325863:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541126.326233:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955872896 00000100:00100000:0.0:1788541126.326246:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955872896 00000100:00100000:0.0:1788541126.326317:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 33 00000100:00100000:0.0:1788541126.326344:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68052e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+24:11393:x1875420955872896:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788541126.327277:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541126.327924:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955873024 00000100:00100000:1.0:1788541126.327946:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955873024 00000100:00100000:1.0:1788541126.328003:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 145 00000100:00100000:1.0:1788541126.328012:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68052e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+26:11395:x1875420955873024:12345-192.168.202.56@tcp:101:lfs.0 00000100:00100000:0.0:1788541126.328806:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68052e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+26:11393:x1875420955872896:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 2460us (2951us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1788541126.328817:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 33 00010000:00010000:1.0:1788541126.328909:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541126.328932:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da200/0x2aac941e5f4a805e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3313aa expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.329009:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da800/0x2aac941e5f4a8065 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.329024:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da800/0x2aac941e5f4a8065 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.329037:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da800/0x2aac941e5f4a8065 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.329053:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354daa00/0x2aac941e5f4a806c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.329074:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354daa00/0x2aac941e5f4a806c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.329082:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354daa00/0x2aac941e5f4a806c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.329152:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a8073 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.329163:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a7f62 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331364 expref: 26 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.329172:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a8073 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.329226:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a7f62 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331364 expref: 26 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.329242:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a7f62 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331364 expref: 26 pid: 6518 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541126.329257:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708272680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1875420981109760:192.168.202.56@tcp:104: 00000100:00100000:1.0:1788541126.329348:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a682ff91180 going to sleep for 11 seconds 00000100:00100000:1.0:1788541126.331596:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708272680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1875420981109760:192.168.202.56@tcp:104: 00010000:00010000:1.0:1788541126.331630:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a8073 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541126.338695:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541126.338805:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955873280 00000100:00100000:3.0:1788541126.338815:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955873280 00000100:00100000:3.0:1788541126.338882:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 34 00000100:00100000:3.0:1788541126.338892:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708311180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+27:6166:x1875420955873280:12345-192.168.202.56@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788541126.339137:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708311180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+28:6166:x1875420955873280:12345-192.168.202.56@tcp:35:ldlm_bl.0 Request processed in 245us (451us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1788541126.339145:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 34 00000100:00100000:3.0:1788541126.350729:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541126.350909:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955873408 00000100:00100000:1.0:1788541126.350936:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955873408 00010000:00010000:1.0:1788541126.351166:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a7f62 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331364 expref: 28 pid: 6518 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541126.351212:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 78 00000100:00100000:1.0:1788541126.351326:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68052e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:384f52e3-0481-4979-9299-157aff7472d2+28:2396:x1875420955873408:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788541126.351342:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541126.351350:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a7f62 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331364 expref: 28 pid: 6518 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.351364:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a7f62 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331364 expref: 28 pid: 6518 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.351387:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a7f62 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331364 expref: 28 pid: 6518 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.351415:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a68350c0800) 00010000:00010000:1.0:1788541126.351421:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a8073 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.351431:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a8073 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.351439:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a8073 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541126.351478:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788541126.351542:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68052e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:384f52e3-0481-4979-9299-157aff7472d2+27:2396:x1875420955873408:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 219us (823us total) trans 0 rc 0/0 00010000:00010000:3.0:1788541126.351603:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a8073 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.351611:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a8073 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541126.351674:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788541126.351679:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788541126.351701:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a8073 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.351714:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a8073 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.351723:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da800/0x2aac941e5f4a8065 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.351730:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da800/0x2aac941e5f4a8065 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.351738:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da800/0x2aac941e5f4a8065 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.351743:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68354da800 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541126.351747:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da800/0x2aac941e5f4a8065 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.351754:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da800/0x2aac941e5f4a8065 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.351763:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68350c4300) 00010000:00010000:3.0:1788541126.351766:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541126.351769:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da800/0x2aac941e5f4a8065 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.351776:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da800/0x2aac941e5f4a8065 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.351799:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354daa00/0x2aac941e5f4a806c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.351805:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354daa00/0x2aac941e5f4a806c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.351811:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354daa00/0x2aac941e5f4a806c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.351817:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68354daa00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541126.351820:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354daa00/0x2aac941e5f4a806c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.351825:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354daa00/0x2aac941e5f4a806c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.351832:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9a6809c1c100) 00010000:00010000:3.0:1788541126.351834:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541126.351837:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354daa00/0x2aac941e5f4a806c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.351843:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354daa00/0x2aac941e5f4a806c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.351911:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da200/0x2aac941e5f4a805e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3313aa expref: 28 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.351924:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a8073 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3313aa expref: 27 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541126.351957:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a68350c0800) 00010000:00010000:3.0:1788541126.351960:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788541126.351963:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68354db600, rc 0) 00000100:00100000:3.0:1788541126.352013:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68052e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+27:11395:x1875420955873024:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 24003us (24743us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541126.352021:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 145 00000100:00100000:1.0:1788541126.362443:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 78 00000100:00100000:1.0:1788541127.114469:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788541127.114492:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708272680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981109888:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788541127.114557:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541127.114627:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981109888 00000100:00100000:1.0:1788541127.114634:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981109888 00000100:00100000:1.0:1788541127.114675:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788541127.114684:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708270380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981109888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788541127.114713:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1788541127.114755:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708270380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981109888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541127.114762:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788541127.114805:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708272680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981109888:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788541127.244347:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788541127.302431:0:14312:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788541127.302440:0:14312:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788541127.302733:0:14312:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788541127.302740:0:14312:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788541127.442704:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541127.442773:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955873664 00000100:00100000:2.0:1788541127.442783:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955873664 00000100:00100000:2.0:1788541127.442889:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 146 00000100:00100000:2.0:1788541127.442901:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708272680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+26:11418:x1875420955873664:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1788541127.442930:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541127.442951:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a807a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3313b1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541127.443073:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a8081 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541127.443091:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a8081 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541127.443106:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a8081 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541127.443117:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788541127.443252:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a807a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3313b1 expref: 29 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541127.443269:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a8081 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3313b1 expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541127.443278:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a68350c0800) 00010000:00010000:2.0:1788541127.443281:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788541127.443284:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a683551b000, rc 0) 00000100:00100000:2.0:1788541127.443353:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708272680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+28:11418:x1875420955873664:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 454us (659us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1788541127.443361:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 146 00000100:00080000:1.0:1788541127.443792:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788541127.447764:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541127.447840:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955873792 00000100:00100000:3.0:1788541127.447858:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955873792 00000100:00100000:3.0:1788541127.450355:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 147 00000100:00100000:3.0:1788541127.450371:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670772bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+28:11418:x1875420955873792:12345-192.168.202.56@tcp:54:lfs.0 00010000:00010000:3.0:1788541127.450449:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a808f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541127.450468:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a808f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541127.450480:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a808f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541127.450518:0:9339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a808f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541127.450525:0:9339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a808f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541127.450532:0:9339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a808f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541127.450538:0:9339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075ada00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541127.450549:0:9339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a808f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541127.450557:0:9339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a808f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541127.450571:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a68350c0800) 00010000:00010000:3.0:1788541127.450574:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788541127.450580:0:9339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a808f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541127.450588:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a808f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541127.450666:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670772bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+28:11418:x1875420955873792:12345-192.168.202.56@tcp:54:lfs.0 Request processed in 301us (2913us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541127.450674:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 147 00000100:00100000:0.0:1788541127.586163:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541127.586417:0:8973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955873920 00000100:00100000:1.0:1788541127.586428:0:8973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955873920 00000100:00100000:1.0:1788541127.586549:0:8973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 54 00000100:00100000:1.0:1788541127.586561:0:8973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670772aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:384f52e3-0481-4979-9299-157aff7472d2+6:2396:x1875420955873920:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:1.0:1788541127.586582:0:8973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541127.586603:0:8973:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006450c9ea/0x2aac941e5f4a8096 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3313b8 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788541127.586644:0:8973:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9af8c4, atime: 0x6a9af8c4, ctime: 0x6a9af8c4, blocks: 0x8 00010000:00010000:1.0:1788541127.586664:0:8973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=408s v=(0 0) 00010000:00010000:1.0:1788541127.586669:0:8973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541127.586678:0:8973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006450c9ea/0x2aac941e5f4a8096 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3313b8 expref: 7 pid: 8973 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541127.586698:0:8973:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006450c9ea/0x2aac941e5f4a8096 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3313b8 expref: 7 pid: 8973 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541127.586717:0:8973:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68354da200, rc 0) 00000100:00100000:1.0:1788541127.586781:0:8973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670772aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:384f52e3-0481-4979-9299-157aff7472d2+7:2396:x1875420955873920:12345-192.168.202.56@tcp:101:cat.0 Request processed in 222us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541127.586787:0:8973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 54 00000100:00100000:2.0:1788541127.593131:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541127.598441:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955874048 00000100:00100000:3.0:1788541127.598459:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955874048 00002000:00100000:2.0:1788541127.601092:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff9a6708312a00 x1875420955874048/t0(0) o3->384f52e3-0481-4979-9299-157aff7472d2@192.168.202.56@tcp:498/0 lens 488/0 e 0 to 0 dl 1788541138 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788541127.601107:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6708312a00 with x1875420955874048 ext(0->4095) 00002000:00010000:2.0:1788541127.601113:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a6708312a00 00000100:00100000:2.0:1788541127.601212:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 3 00000100:00100000:2.0:1788541127.601222:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708312a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:384f52e3-0481-4979-9299-157aff7472d2+7:2397:x1875420955874048:12345-192.168.202.56@tcp:3:cat.0 00000100:00100000:2.0:1788541127.601432:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708312a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:384f52e3-0481-4979-9299-157aff7472d2+7:2397:x1875420955874048:12345-192.168.202.56@tcp:3:cat.0 Request processed in 210us (8314us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788541127.601439:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 3 00002000:00100000:2.0:1788541127.601446:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff9a6708312a00 x1875420955874048/t0(0) o3->384f52e3-0481-4979-9299-157aff7472d2@192.168.202.56@tcp:498/0 lens 488/4536 e 0 to 0 dl 1788541138 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788541127.601455:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6708312a00 with x1875420955874048 ext(0->4095) 00002000:00010000:2.0:1788541127.601459:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a6708312a00 00000100:00100000:2.0:1788541128.138446:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708270e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981110016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788541128.138537:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541128.138928:0:14072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981110016 00000100:00100000:1.0:1788541128.138937:0:14072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981110016 00000100:00100000:1.0:1788541128.139028:0:14072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788541128.139038:0:14072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708310000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1875420981110016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788541128.139072:0:14072:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788541128.139124:0:14072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708310000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1875420981110016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541128.139132:0:14072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788541128.139817:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707886300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981110400:0@lo:400:kworker.0 00000100:00100000:0.0:1788541128.139861:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541128.139903:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683f0fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875420981110912:0@lo:400:kworker.0 00000100:00100000:0.0:1788541128.139928:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541128.139950:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875420981111424:0@lo:400:kworker.0 00000100:00100000:0.0:1788541128.139986:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541128.140144:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707887800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875420981110272:0@lo:400:kworker.0 00000100:00100000:3.0:1788541128.140185:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541128.140221:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708080700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875420981110784:0@lo:400:kworker.0 00000100:00100000:3.0:1788541128.140243:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541128.140265:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875420981111296:0@lo:400:kworker.0 00000100:00100000:3.0:1788541128.140286:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541128.140309:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1788541128.140315:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:425687b6-1d99-41d2-88d8-2fb230997596:3644:1875420981110144:0@lo:400:kworker.0 00000100:00100000:3.0:1788541128.140354:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541128.140373:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981110656:0@lo:400:kworker.0 00000100:00100000:3.0:1788541128.140424:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541128.140441:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981111168:0@lo:400:kworker.0 00000100:00100000:3.0:1788541128.140674:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541128.140695:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67076f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981111680:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788541128.140721:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541128.140753:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981110912 00000100:00100000:3.0:1788541128.140760:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981110912 00000100:00100000:3.0:1788541128.140799:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981111424 00000100:00100000:3.0:1788541128.140801:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981111424 00000100:00100000:3.0:1788541128.140815:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981110272 00000100:00100000:3.0:1788541128.140817:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981110272 00000100:00100000:3.0:1788541128.140828:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981110784 00000100:00100000:3.0:1788541128.140830:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981110784 00000100:00100000:3.0:1788541128.140845:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1788541128.140851:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875420981110912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541128.140929:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875420981110912:12345-0@lo:400:kworker.0 Request processed in 77us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541128.140936:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1788541128.140950:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981111296 00000100:00100000:3.0:1788541128.140953:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981111296 00010000:00080000:0.0:1788541128.141582:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a683f0fe680 x1875420981110912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541128.141597:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683f0fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875420981110912:0@lo:400:kworker.0 00000100:00100000:0.0:1788541128.141613:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788541128.141621:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707884700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875420981110528:0@lo:400:kworker.0 00000100:00100000:0.0:1788541128.141655:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541128.141677:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981111040:0@lo:400:kworker.0 00000100:00100000:0.0:1788541128.141698:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541128.141716:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981111552:0@lo:400:kworker.0 00000100:00100000:0.0:1788541128.141736:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541128.141769:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981110528 00000100:00100000:0.0:1788541128.141773:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981110528 00000100:00100000:0.0:1788541128.141812:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788541128.141819:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875420981111424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541128.141860:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875420981111424:12345-0@lo:400:kworker.0 Request processed in 41us (1873us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541128.141866:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788541128.141896:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1788541128.141903:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67076f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875420981110272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541128.141939:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67076f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875420981110272:12345-0@lo:400:kworker.0 Request processed in 36us (1753us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541128.141945:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1788541128.141959:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1788541128.141981:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875420981110784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541128.142747:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1788541128.142758:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875420981110528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541128.142807:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875420981110528:12345-0@lo:400:kworker.0 Request processed in 53us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541128.142814:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1788541128.142830:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1788541128.142836:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875420981111296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541128.142893:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875420981111296:12345-0@lo:400:kworker.0 Request processed in 57us (2605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541128.142899:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1788541128.142931:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981111168 00000100:00100000:3.0:1788541128.142936:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981111168 00000100:00100000:3.0:1788541128.142963:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981111040 00000100:00100000:3.0:1788541128.142979:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981111040 00000100:00100000:3.0:1788541128.142995:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981111552 00000100:00080000:2.0:1788541128.143692:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788541128.143698:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788541128.143701:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788541128.143704:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788541128.143728:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788541128.143751:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3644:x1875420981111168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541128.143800:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3644:x1875420981111168:12345-0@lo:400:kworker.0 Request processed in 54us (3126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541128.143807:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788541128.143821:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788541128.143828:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981111040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541128.143855:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981111040:12345-0@lo:400:kworker.0 Request processed in 29us (2156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541128.143861:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788541128.143945:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708270e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981110016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788541128.144559:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707884700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875420981110528:0@lo:400:kworker.0 00000100:00100000:2.0:1788541128.144576:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981111040:0@lo:400:kworker.0 00010000:00080000:2.0:1788541128.144592:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67078ee300 x1875420981111424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541128.144602:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875420981111424:0@lo:400:kworker.0 00000100:00100000:1.0:1788541128.144901:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981110400 00000100:00100000:1.0:1788541128.144908:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981110400 00000100:00100000:1.0:1788541128.144943:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981110656 00000100:00100000:1.0:1788541128.144947:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981110656 00000100:00100000:1.0:1788541128.144986:0:10866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788541128.144994:0:10866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981110400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541128.145067:0:10866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981110400:12345-0@lo:400:kworker.0 Request processed in 74us (5205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541128.145074:0:10866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788541128.145089:0:10866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788541128.145095:0:10866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981110656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541128.145122:0:10866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981110656:12345-0@lo:400:kworker.0 Request processed in 28us (4697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541128.145127:0:10866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788541128.145144:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981110144 00000100:00100000:1.0:1788541128.145147:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981110144 00000100:00100000:1.0:1788541128.145176:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1788541128.145182:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e78a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+24:3644:x1875420981110144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541128.145225:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e78a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+24:3644:x1875420981110144:12345-0@lo:400:kworker.0 Request processed in 43us (4871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541128.145232:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1788541128.145294:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981111680 00000100:00100000:1.0:1788541128.145299:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981111680 00000100:00100000:0.0:1788541128.145930:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875420981110784:12345-0@lo:400:kworker.0 Request processed in 3962us (5684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541128.145940:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00080000:2.0:1788541128.146133:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788541128.146160:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707886300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981110400:0@lo:400:kworker.0 00000100:00100000:1.0:1788541128.146319:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788541128.146663:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981111552 00000100:00100000:3.0:1788541128.146710:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788541128.146717:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3641:x1875420981111552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541128.146775:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3641:x1875420981111552:12345-0@lo:400:kworker.0 Request processed in 59us (5038us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541128.146782:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788541128.146900:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:425687b6-1d99-41d2-88d8-2fb230997596:3644:1875420981110144:0@lo:400:kworker.0 00000100:00100000:0.0:1788541128.146924:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981110656:0@lo:400:kworker.0 00000100:00100000:0.0:1788541128.146938:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981111168:0@lo:400:kworker.0 00000100:00100000:0.0:1788541128.146951:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707887800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875420981110272:0@lo:400:kworker.0 00000100:00100000:0.0:1788541128.146962:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708080700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875420981110784:0@lo:400:kworker.0 00000100:00100000:0.0:1788541128.146989:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875420981111296:0@lo:400:kworker.0 00000100:00100000:2.0:1788541128.147159:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981111552:0@lo:400:kworker.0 00000100:00100000:1.0:1788541128.147412:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706831f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981111680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788541128.147437:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788541128.147566:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706831f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981111680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1238us (6843us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541128.147575:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788541128.147713:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67076f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981111680:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788541128.270793:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541129.290069:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788541129.418794:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788541129.418806:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788541129.418826:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788541129.418839:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788541129.739130:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788541130.022433:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541130.023030:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541130.023065:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541130.023108:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955874560 00000100:00100000:3.0:1788541130.023119:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955874560 00000100:00100000:3.0:1788541130.023196:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 112 00000100:00100000:3.0:1788541130.023208:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708271500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:384f52e3-0481-4979-9299-157aff7472d2+7:2395:x1875420955874560:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541130.023285:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708271500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:384f52e3-0481-4979-9299-157aff7472d2+7:2395:x1875420955874560:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 79us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541130.023293:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 112 00000100:00080000:3.0:1788541130.023316:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788541130.031369:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541130.031406:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541130.032022:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955874304 00000100:00100000:2.0:1788541130.032035:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955874304 00000100:00100000:3.0:1788541130.032305:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955874816 00000100:00100000:3.0:1788541130.032310:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955874816 00000100:00100000:3.0:1788541130.032338:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 311 00000100:00100000:3.0:1788541130.032347:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708273480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+28:2395:x1875420955874304:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541130.032459:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708273480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+28:2395:x1875420955874304:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 113us (10041us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541130.032467:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 311 00000100:00100000:3.0:1788541130.032486:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 312 00000100:00100000:3.0:1788541130.032493:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708270700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2395:x1875420955874816:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541130.032519:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708270700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2395:x1875420955874816:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 26us (9453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541130.032525:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 312 00000100:00080000:2.0:1788541130.033279:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788541130.033732:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541130.034480:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955874432 00000100:00100000:2.0:1788541130.034492:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955874432 00000100:00100000:2.0:1788541130.034566:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 313 00000100:00100000:2.0:1788541130.034577:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708272a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+5:2395:x1875420955874432:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1788541130.034636:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708272a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+5:2395:x1875420955874432:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 62us (3230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541130.034643:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 313 00000100:00080000:2.0:1788541130.034667:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788541130.035005:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541130.035053:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955874176 00000100:00100000:1.0:1788541130.035059:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955874176 00000100:00100000:1.0:1788541130.035092:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 387 00000100:00100000:1.0:1788541130.035101:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e78a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:2395:x1875420955874176:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1788541130.035133:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e78a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:2395:x1875420955874176:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 34us (3787us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541130.035140:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 387 00000100:00100000:1.0:1788541130.035169:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955874688 00000100:00100000:1.0:1788541130.035173:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955874688 00000100:00100000:1.0:1788541130.035661:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 113 00000100:00100000:1.0:1788541130.035670:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708270000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:384f52e3-0481-4979-9299-157aff7472d2+7:2395:x1875420955874688:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1788541130.035705:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708270000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:384f52e3-0481-4979-9299-157aff7472d2+7:2395:x1875420955874688:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 38us (1979us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541130.035712:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 113 00000100:00100000:2.0:1788541130.035787:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955874944 00000100:00100000:2.0:1788541130.035804:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955874944 00000100:00100000:2.0:1788541130.035834:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 314 00000100:00100000:2.0:1788541130.035842:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708271880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2395:x1875420955874944:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1788541130.035885:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708271880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2395:x1875420955874944:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 44us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541130.035892:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 314 00000100:00080000:1.0:1788541130.036760:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788541130.036766:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1788541130.191090:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:2.0:1788541130.191114:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00010000:00010000:3.0:1788541130.314231:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541131.210280:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788541131.210302:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708273b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981111808:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788541131.210385:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541131.210458:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981111808 00000100:00100000:1.0:1788541131.210478:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981111808 00000100:00100000:1.0:1788541131.210572:0:10866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788541131.210582:0:10866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708273800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981111808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788541131.210613:0:10866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788541131.214035:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981111936:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788541131.214114:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541131.214173:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788541131.214180:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981112064:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788541131.214203:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541131.214589:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981111936 00000100:00100000:3.0:1788541131.214598:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981111936 00000100:00100000:3.0:1788541131.214663:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981112064 00000100:00100000:3.0:1788541131.214667:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981112064 00000100:00100000:3.0:1788541131.214686:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788541131.214695:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708311880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981111936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788541131.214724:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788541131.214775:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708311880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981111936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541131.214782:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788541131.214798:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788541131.214805:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708313b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981112064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788541131.214814:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788541131.214838:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708313b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981112064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 34us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541131.214844:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:3.0:1788541131.214896:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788541131.214926:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:3.0:1788541131.214932:0:3641:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:3.0:1788541131.214953:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a6708310e00, transno 4294967305 00000100:00100000:3.0:1788541131.214971:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981112064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788541131.214988:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981111936:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788541131.229320:0:10866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708273800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981111808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 18728us (18924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541131.229336:0:10866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000001:00080000:0.0:1788541131.229805:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:0.0:1788541131.229833:0:6496:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a6707964480 refcount 2 committed 0 result 0 batchid 4 00000100:00100000:2.0:1788541131.229838:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708273b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981111808:0@lo:41:osp-pre-1-0.0 00000020:00080000:0.0:1788541131.229840:0:6496:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a6706b2ec00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a6707964240 00000020:00080000:0.0:1788541131.229848:0:6496:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a6706b2e300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a68103aac00 00000020:00080000:0.0:1788541131.229890:0:6496:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00010000:00010000:3.0:1788541131.229978:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a8011 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541131.229990:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a8011 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541131.229997:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a8011 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541131.230003:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68354dbe00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541131.230007:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a8011 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541131.230016:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a8011 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541131.230037:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9a6809c1c200) 00010000:00010000:3.0:1788541131.230041:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541131.230045:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a8011 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541131.230053:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a8011 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788541131.230164:0:6549:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1788541131.230309:0:6549:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:3.0:1788541131.343629:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541132.234741:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708272d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981112192:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788541132.234817:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541132.234926:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981112192 00000100:00100000:2.0:1788541132.234934:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981112192 00000100:00100000:2.0:1788541132.234976:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788541132.234986:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708313800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981112192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788541132.235021:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1788541132.235068:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708313800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981112192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541132.235075:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788541132.235121:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708272d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981112192:0@lo:41:osp-pre-0-1.0 00000001:00080000:0.0:1788541132.237256:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:0.0:1788541132.237323:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00010000:00010000:0.0:1788541132.362460:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541132.553368:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541132.553906:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955875072 00000100:00100000:3.0:1788541132.553916:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955875072 00000100:00100000:3.0:1788541132.554005:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 148 00000100:00100000:3.0:1788541132.554018:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708272d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+14:11070:x1875420955875072:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788541132.554136:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708272d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+14:11070:x1875420955875072:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 Request processed in 121us (780us total) trans 0 rc 0/0 00000100:00080000:1.0:1788541132.554268:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788541132.554467:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 148 00000100:00100000:0.0:1788541132.561555:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541132.566835:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955875200 00000100:00100000:2.0:1788541132.566853:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955875200 00000100:00100000:2.0:1788541132.566976:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 149 00000100:00100000:2.0:1788541132.566990:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+5:11070:x1875420955875200:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788541132.567123:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+5:11070:x1875420955875200:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 Request processed in 137us (5576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541132.567132:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 149 00000100:00080000:1.0:1788541132.567690:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788541132.573407:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541132.573494:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955875456 00000100:00100000:3.0:1788541132.573506:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955875456 00000100:00100000:3.0:1788541132.573562:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 35 00000100:00100000:3.0:1788541132.573571:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+14:11070:x1875420955875456:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788541132.573849:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+15:11070:x1875420955875456:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 278us (453us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1788541132.573858:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 35 00000100:00100000:0.0:1788541132.860824:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541132.861081:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955875584 00000100:00100000:3.0:1788541132.861092:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955875584 00000100:00100000:3.0:1788541132.861172:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 150 00000100:00100000:3.0:1788541132.861183:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:11876:x1875420955875584:12345-192.168.202.56@tcp:101:lsof.0 00010000:00010000:3.0:1788541132.861271:0:12149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1788541132.861355:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788541132.861410:0:12149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a809d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3313bf expref: -99 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541132.861477:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a80a4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541132.861492:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a80a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541132.861599:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a80a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541132.861646:0:12149:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788541132.861650:0:12149:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788541132.861688:0:12149:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a80a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541132.861713:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a809d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3313bf expref: 7 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541132.861731:0:12149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a80a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3313bf expref: 6 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541132.861739:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6809c1c700) 00010000:00010000:3.0:1788541132.861742:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788541132.861745:0:12149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075ada00, rc 0) 00000100:00100000:3.0:1788541132.861858:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:73b94cba-5efa-45eb-b12c-fe84e695d78a+6:11876:x1875420955875584:12345-192.168.202.56@tcp:101:lsof.0 Request processed in 676us (1045us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541132.861867:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 150 00000100:00100000:0.0:1788541133.258688:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708273b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981112320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788541133.258772:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541133.258899:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981112320 00000100:00100000:0.0:1788541133.258907:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981112320 00000100:00100000:0.0:1788541133.258966:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788541133.258977:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981112320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788541133.259008:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788541133.259052:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981112320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541133.259058:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788541133.259115:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:0.0:1788541133.259122:0:3644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a670835e300, transno 4294967311 00000004:00080000:0.0:1788541133.259132:0:3644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:0.0:1788541133.259532:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708273b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981112320:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788541133.259612:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788541133.264159:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708312300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875420981112576:0@lo:400:kworker.0 00000100:00100000:3.0:1788541133.264235:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541133.264290:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875420981113088:0@lo:400:kworker.0 00000100:00100000:3.0:1788541133.264323:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541133.264361:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707884700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875420981113600:0@lo:400:kworker.0 00000100:00100000:3.0:1788541133.264385:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541133.264441:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1788541133.264449:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708312d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420981112448:0@lo:400:kworker.0 00000100:00100000:3.0:1788541133.264478:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541133.264508:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708310e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981112960:0@lo:400:kworker.0 00000100:00100000:3.0:1788541133.264534:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541133.264560:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707886300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981113472:0@lo:400:kworker.0 00000100:00100000:3.0:1788541133.264588:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541133.264608:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981113984:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788541133.264635:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541133.264680:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981113472 00000100:00100000:3.0:1788541133.264690:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981113472 00000100:00100000:3.0:1788541133.264763:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788541133.264773:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981113472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541133.264824:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981113472:12345-0@lo:400:kworker.0 Request processed in 52us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541133.264831:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788541133.264866:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981113984 00000100:00100000:3.0:1788541133.264915:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981113984 00000100:00100000:3.0:1788541133.264946:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788541133.264954:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835abec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981113984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788541133.264969:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788541133.264999:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835abec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981113984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541133.265005:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788541133.265245:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981112576 00000100:00100000:3.0:1788541133.265250:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981112576 00000100:00100000:3.0:1788541133.265277:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981113088 00000100:00100000:3.0:1788541133.265287:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981113088 00000100:00100000:3.0:1788541133.265310:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981113600 00000100:00100000:3.0:1788541133.265313:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981113600 00000100:00100000:3.0:1788541133.265337:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1788541133.265345:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708051880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875420981112576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541133.265378:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708051880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875420981112576:12345-0@lo:400:kworker.0 Request processed in 35us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541133.265385:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1788541133.265398:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1788541133.265404:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708053800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875420981113088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541133.265432:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708053800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875420981113088:12345-0@lo:400:kworker.0 Request processed in 29us (1109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541133.265437:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1788541133.265448:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1788541133.265454:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706879880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875420981113600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541133.265477:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706879880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875420981113600:12345-0@lo:400:kworker.0 Request processed in 24us (1092us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541133.265483:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1788541133.265524:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707886300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981113472:0@lo:400:kworker.0 00000100:00100000:3.0:1788541133.265542:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981113984:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788541133.265553:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708312300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875420981112576:0@lo:400:kworker.0 00000100:00100000:3.0:1788541133.265562:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875420981113088:0@lo:400:kworker.0 00000100:00100000:3.0:1788541133.265571:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707884700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875420981113600:0@lo:400:kworker.0 00000100:00100000:3.0:1788541133.265621:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708311f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981112704:0@lo:400:kworker.0 00000100:00100000:3.0:1788541133.265658:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541133.265679:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707887800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875420981113216:0@lo:400:kworker.0 00000100:00100000:3.0:1788541133.265701:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541133.265718:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707820e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875420981113728:0@lo:400:kworker.0 00000100:00100000:3.0:1788541133.265738:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541133.265760:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788541133.265768:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708311c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875420981112832:0@lo:400:kworker.0 00000100:00100000:3.0:1788541133.265788:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541133.265805:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981113344:0@lo:400:kworker.0 00000100:00100000:3.0:1788541133.265825:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541133.265844:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707821180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981113856:0@lo:400:kworker.0 00000100:00100000:3.0:1788541133.265863:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541133.265911:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981113216 00000100:00100000:3.0:1788541133.265915:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981113216 00000100:00100000:3.0:1788541133.265936:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981113728 00000100:00100000:3.0:1788541133.265938:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981113728 00000100:00100000:3.0:1788541133.265951:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981112832 00000100:00100000:3.0:1788541133.265954:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981112832 00000100:00100000:3.0:1788541133.265967:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788541133.265972:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875420981113216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541133.266007:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875420981113216:12345-0@lo:400:kworker.0 Request processed in 34us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541133.266013:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788541133.266026:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1788541133.266032:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875420981113728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541133.266060:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875420981113728:12345-0@lo:400:kworker.0 Request processed in 29us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541133.266072:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1788541133.266085:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1788541133.266090:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875420981112832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541133.266118:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875420981112832:12345-0@lo:400:kworker.0 Request processed in 28us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541133.266123:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1788541133.266152:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708311c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875420981112832:0@lo:400:kworker.0 00010000:00080000:3.0:1788541133.266164:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707887800 x1875420981113216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541133.266173:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707887800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875420981113216:0@lo:400:kworker.0 00010000:00080000:3.0:1788541133.266182:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707820e00 x1875420981113728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541133.266190:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707820e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875420981113728:0@lo:400:kworker.0 00000100:00080000:3.0:1788541133.266231:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788541133.266234:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788541133.266237:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788541133.266240:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788541133.266255:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981112960 00000100:00100000:3.0:1788541133.266259:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981112960 00000100:00100000:3.0:1788541133.266281:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981112704 00000100:00100000:3.0:1788541133.266285:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981112704 00000100:00100000:3.0:1788541133.266297:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788541133.266304:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670687b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981112960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541133.266355:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670687b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981112960:12345-0@lo:400:kworker.0 Request processed in 51us (1819us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541133.266370:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788541133.266382:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788541133.266388:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981112704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541133.266422:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981112704:12345-0@lo:400:kworker.0 Request processed in 34us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541133.266428:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788541133.266454:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708311f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981112704:0@lo:400:kworker.0 00000100:00100000:3.0:1788541133.266476:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708310e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981112960:0@lo:400:kworker.0 00000100:00100000:3.0:1788541133.266514:0:8973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981113344 00000100:00100000:3.0:1788541133.266518:0:8973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981113344 00000100:00100000:3.0:1788541133.266543:0:8973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981113856 00000100:00100000:3.0:1788541133.266546:0:8973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981113856 00000100:00100000:3.0:1788541133.266560:0:8973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788541133.266565:0:8973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981113344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541133.266598:0:8973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981113344:12345-0@lo:400:kworker.0 Request processed in 32us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541133.266603:0:8973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788541133.266613:0:8973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788541133.266619:0:8973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981113856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541133.266644:0:8973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981113856:12345-0@lo:400:kworker.0 Request processed in 26us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541133.266650:0:8973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:3.0:1788541133.266668:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788541133.266687:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981113344:0@lo:400:kworker.0 00000100:00100000:3.0:1788541133.266697:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707821180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981113856:0@lo:400:kworker.0 00000100:00100000:3.0:1788541133.266735:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981112448 00000100:00100000:3.0:1788541133.266738:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981112448 00000100:00100000:3.0:1788541133.266760:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1788541133.266765:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e788c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+24:3642:x1875420981112448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541133.266796:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e788c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+24:3642:x1875420981112448:12345-0@lo:400:kworker.0 Request processed in 31us (2317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541133.266802:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1788541133.266827:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708312d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420981112448:0@lo:400:kworker.0 00010000:00010000:3.0:1788541133.387268:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541134.410172:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541135.141836:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541135.141917:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541135.141943:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541135.142085:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955875968 00000100:00100000:3.0:1788541135.142104:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955875968 00000100:00100000:3.0:1788541135.142163:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 321 00000100:00100000:3.0:1788541135.142172:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708270e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+5:2395:x1875420955875968:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541135.142248:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708270e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+5:2395:x1875420955875968:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 77us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541135.142256:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 321 00000100:00080000:3.0:1788541135.142275:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788541135.142624:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955875712 00000100:00100000:2.0:1788541135.142629:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955875712 00000100:00100000:2.0:1788541135.142664:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 389 00000100:00100000:2.0:1788541135.142670:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e78b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:2395:x1875420955875712:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1788541135.142707:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e78b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:2395:x1875420955875712:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 38us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541135.142714:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 389 00000100:00100000:1.0:1788541135.142865:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541135.142916:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541135.142934:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541135.143069:0:8973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955876224 00000100:00100000:0.0:1788541135.143074:0:8973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955876224 00000100:00100000:0.0:1788541135.143112:0:8973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955876096 00000100:00100000:0.0:1788541135.143115:0:8973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955876096 00000100:00100000:0.0:1788541135.143132:0:8973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 117 00000100:00100000:0.0:1788541135.143138:0:8973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708270a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:384f52e3-0481-4979-9299-157aff7472d2+6:2395:x1875420955876224:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1788541135.143208:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 118 00000100:00100000:2.0:1788541135.143215:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708273b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:384f52e3-0481-4979-9299-157aff7472d2+5:2395:x1875420955876096:12345-192.168.202.56@tcp:400:kworker.0 00000100:00080000:3.0:1788541135.143421:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788541135.143426:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788541135.143439:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955876480 00000100:00100000:3.0:1788541135.143444:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955876480 00000100:00100000:3.0:1788541135.143475:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955875840 00000100:00100000:3.0:1788541135.143478:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955875840 00000100:00100000:3.0:1788541135.143498:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 322 00000100:00100000:3.0:1788541135.143506:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708272300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2395:x1875420955876480:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541135.152758:0:8973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708270a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:384f52e3-0481-4979-9299-157aff7472d2+6:2395:x1875420955876224:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 9606us (10800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541135.152775:0:8973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 117 00000100:00080000:0.0:1788541135.152820:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788541135.152826:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788541135.153336:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 323 00000100:00100000:0.0:1788541135.153350:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708271f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+15:2395:x1875420955875840:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541135.153414:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708271f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+15:2395:x1875420955875840:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 69us (10496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541135.153421:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 323 00000100:00100000:1.0:1788541135.153512:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541135.153552:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955876352 00000100:00100000:1.0:1788541135.153561:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955876352 00000100:00100000:1.0:1788541135.153609:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 324 00000100:00100000:1.0:1788541135.153617:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73b94cba-5efa-45eb-b12c-fe84e695d78a+6:2395:x1875420955876352:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1788541135.153646:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:73b94cba-5efa-45eb-b12c-fe84e695d78a+6:2395:x1875420955876352:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 31us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541135.153652:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 324 00000100:00080000:1.0:1788541135.153684:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788541135.154555:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708273b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:384f52e3-0481-4979-9299-157aff7472d2+5:2395:x1875420955876096:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 11333us (11612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541135.154567:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 118 00000100:00100000:3.0:1788541135.162811:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708272300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2395:x1875420955876480:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 19290us (19930us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541135.162843:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 322 00010000:00010000:0.0:1788541135.434263:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541136.330037:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788541136.330061:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981114112:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788541136.330249:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541136.330341:0:14072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981114112 00000100:00100000:3.0:1788541136.330349:0:14072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981114112 00000100:00100000:3.0:1788541136.330403:0:14072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788541136.330412:0:14072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981114112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788541136.330440:0:14072:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788541136.330489:0:14072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707886a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981114112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541136.330496:0:14072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:3.0:1788541136.330517:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788541136.330548:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981114112:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788541136.330660:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788541136.330670:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981114240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788541136.330697:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541136.330762:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981114240 00000100:00100000:3.0:1788541136.330766:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981114240 00000100:00100000:0.0:1788541136.332258:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981114368:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788541136.332329:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541136.332454:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788541136.332464:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981114240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788541136.332485:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788541136.332530:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981114240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (1831us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541136.332537:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788541136.332559:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981114368 00000100:00100000:3.0:1788541136.332565:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981114368 00000100:00100000:3.0:1788541136.332589:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788541136.332595:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981114368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788541136.332631:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788541136.332660:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981114368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 66us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541136.332667:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788541136.332701:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981114368:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788541136.332713:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981114240:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788541136.333086:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788541136.460909:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788541136.848186:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:0.0:1788541136.848200:0:6496:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1788541136.848268:0:6549:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1788541136.848280:0:6549:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:02000400:2.0:1788541136.985081:0:14509:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 12:58:55 (1788541135) 00000100:00100000:2.0:1788541137.354215:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788541137.354241:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981114496:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788541137.354336:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541137.354448:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981114496 00000100:00100000:1.0:1788541137.354457:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981114496 00000100:00100000:1.0:1788541137.354512:0:10866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788541137.354522:0:10866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707821c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981114496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788541137.354566:0:10866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1788541137.354622:0:10866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707821c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981114496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541137.354629:0:10866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788541137.354955:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981114496:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788541137.482398:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541138.312408:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541138.312547:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955876736 00000100:00100000:3.0:1788541138.312559:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955876736 00000100:00100000:3.0:1788541138.312635:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 151 00000100:00100000:3.0:1788541138.312646:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+14:12143:x1875420955876736:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788541138.312667:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541138.312687:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac800/0x2aac941e5f4a80ab lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3313c6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788541138.312689:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788541138.312760:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a80b2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541138.312777:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a80b2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541138.312790:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a80b2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541138.312816:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a80b9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541138.312836:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a80b9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541138.312842:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a80b9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541138.313037:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac200/0x2aac941e5f4a80c0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541138.313046:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac200/0x2aac941e5f4a80c0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541138.313053:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac200/0x2aac941e5f4a80c0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541138.313063:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1788541138.313631:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a80b2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541138.313641:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a80b2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541138.313647:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a80b2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541138.313652:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075ac600 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541138.313656:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a80b2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541138.313663:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a80b2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541138.313685:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a67078a1d00) 00010000:00010000:3.0:1788541138.313687:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541138.313692:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a80b2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541138.313698:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a80b2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541138.313711:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a80b9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541138.313716:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a80b9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541138.313720:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a80b9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541138.313725:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075ad800 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541138.313727:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a80b9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541138.313732:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a80b9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541138.313739:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a683531b700) 00010000:00010000:3.0:1788541138.313740:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541138.313743:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a80b9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541138.313748:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a80b9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541138.314633:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac800/0x2aac941e5f4a80ab lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3313c6 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541138.314654:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac200/0x2aac941e5f4a80c0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3313c6 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541138.314662:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a68350c0d00) 00010000:00010000:3.0:1788541138.314664:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541138.314667:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075ac200, rc 0) 00000100:00100000:3.0:1788541138.314747:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+16:12143:x1875420955876736:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 2102us (2347us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1788541138.314756:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 151 00000100:00100000:2.0:1788541138.321215:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541138.321658:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541138.321912:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955876992 00000100:00100000:3.0:1788541138.321922:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955876992 00000100:00100000:3.0:1788541138.321977:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 152 00000100:00100000:3.0:1788541138.321999:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707820e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+16:12143:x1875420955876992:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788541138.322120:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707820e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+16:12143:x1875420955876992:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 Request processed in 124us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541138.322130:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 152 00000100:00100000:2.0:1788541138.333564:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541138.336798:0:9520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955876864 00000100:00100000:1.0:1788541138.336815:0:9520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955876864 00000100:00100000:1.0:1788541138.336917:0:9520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 10 00000100:00100000:1.0:1788541138.336927:0:9520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707821180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:384f52e3-0481-4979-9299-157aff7472d2+16:2395:x1875420955876864:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788541138.336944:0:9520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541138.336969:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac200/0x2aac941e5f4a80c0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3313c6 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541138.336989:0:9520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a68350c0d00) 00010000:00010000:1.0:1788541138.336994:0:9520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788541138.337066:0:9520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707821180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:384f52e3-0481-4979-9299-157aff7472d2+15:2395:x1875420955876864:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 140us (15860us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541138.337074:0:9520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 10 00000100:00100000:3.0:1788541138.337574:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955877120 00000100:00100000:3.0:1788541138.337581:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955877120 00000100:00100000:3.0:1788541138.337676:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 153 00000100:00100000:3.0:1788541138.337684:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707822d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+5:12143:x1875420955877120:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788541138.337767:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707822d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+5:12143:x1875420955877120:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 Request processed in 83us (4212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541138.337789:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 153 00000100:00080000:2.0:1788541138.341417:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788541138.378104:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707bb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875420981114880:0@lo:400:kworker.0 00000100:00100000:3.0:1788541138.378183:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541138.378217:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981114880 00000100:00100000:2.0:1788541138.378227:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981114880 00000100:00100000:3.0:1788541138.378266:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707bb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875420981115392:0@lo:400:kworker.0 00000100:00100000:2.0:1788541138.378298:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1788541138.378305:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541138.378318:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875420981114880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541138.378335:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875420981115904:0@lo:400:kworker.0 00000100:00100000:2.0:1788541138.378379:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875420981114880:12345-0@lo:400:kworker.0 Request processed in 63us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541138.378383:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541138.378392:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1788541138.378411:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981115392 00000100:00100000:2.0:1788541138.378415:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981115392 00000100:00100000:3.0:1788541138.378426:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707bb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875420981114880:0@lo:400:kworker.0 00000100:00100000:3.0:1788541138.378448:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1788541138.378452:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981115904 00000100:00100000:3.0:1788541138.378455:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707823480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:425687b6-1d99-41d2-88d8-2fb230997596:3644:1875420981114752:0@lo:400:kworker.0 00000100:00100000:2.0:1788541138.378458:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981115904 00000100:00100000:2.0:1788541138.378482:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1788541138.378488:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707819c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875420981115392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541138.378504:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541138.378531:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707819c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875420981115392:12345-0@lo:400:kworker.0 Request processed in 41us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541138.378536:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707bb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981115264:0@lo:400:kworker.0 00000100:00100000:2.0:1788541138.378542:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1788541138.378557:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1788541138.378564:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670781aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875420981115904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541138.378571:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541138.378594:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981115776:0@lo:400:kworker.0 00000100:00100000:2.0:1788541138.378602:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670781aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875420981115904:12345-0@lo:400:kworker.0 Request processed in 38us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541138.378609:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1788541138.378620:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788541138.378644:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788541138.378655:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6835650380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981116288:0@lo:400:kworker.0 00000100:00100000:2.0:1788541138.378676:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981114752 00000100:00100000:3.0:1788541138.378681:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541138.378682:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981114752 00000100:00100000:3.0:1788541138.378710:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707bb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875420981115392:0@lo:400:kworker.0 00000100:00100000:2.0:1788541138.378716:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1788541138.378723:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875420981115904:0@lo:400:kworker.0 00000100:00100000:2.0:1788541138.378728:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e78b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+24:3644:x1875420981114752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541138.378762:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981115264 00000100:00100000:3.0:1788541138.378767:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981115264 00000100:00100000:2.0:1788541138.378772:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e78b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+24:3644:x1875420981114752:12345-0@lo:400:kworker.0 Request processed in 47us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541138.378780:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1788541138.378800:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788541138.378808:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707818700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981115264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541138.378851:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707818700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981115264:12345-0@lo:400:kworker.0 Request processed in 44us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541138.378858:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788541138.378900:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981115776 00000100:00100000:3.0:1788541138.378903:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981115776 00000100:00100000:3.0:1788541138.378931:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981116288 00000100:00100000:3.0:1788541138.378935:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981116288 00000100:00100000:3.0:1788541138.378952:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788541138.378958:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981115776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541138.378988:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981115776:12345-0@lo:400:kworker.0 Request processed in 29us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541138.378994:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788541138.379004:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788541138.379010:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981116288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541138.379035:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981116288:12345-0@lo:400:kworker.0 Request processed in 26us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541138.379041:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:3.0:1788541138.379062:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788541138.379065:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788541138.379080:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707823480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:425687b6-1d99-41d2-88d8-2fb230997596:3644:1875420981114752:0@lo:400:kworker.0 00000100:00100000:3.0:1788541138.379089:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707bb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981115264:0@lo:400:kworker.0 00000100:00100000:3.0:1788541138.379097:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981115776:0@lo:400:kworker.0 00000100:00100000:3.0:1788541138.379105:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6835650380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981116288:0@lo:400:kworker.0 00000100:00100000:3.0:1788541138.379168:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707bb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981115008:0@lo:400:kworker.0 00000100:00100000:3.0:1788541138.379206:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541138.379239:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875420981115520:0@lo:400:kworker.0 00000100:00100000:3.0:1788541138.379263:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541138.379274:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981115008 00000100:00100000:1.0:1788541138.379290:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981115008 00000100:00100000:3.0:1788541138.379293:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6835652a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875420981116032:0@lo:400:kworker.0 00000100:00100000:3.0:1788541138.379322:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541138.379338:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788541138.379346:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1788541138.379347:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707823480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981115008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541138.379355:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707887800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981114624:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788541138.379385:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541138.379407:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707bb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875420981115136:0@lo:400:kworker.0 00000100:00100000:1.0:1788541138.379413:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707823480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981115008:12345-0@lo:400:kworker.0 Request processed in 67us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541138.379421:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788541138.379431:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541138.379449:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981115648:0@lo:400:kworker.0 00000100:00100000:3.0:1788541138.379471:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541138.379489:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6835651f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981116160:0@lo:400:kworker.0 00000100:00100000:1.0:1788541138.379495:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788541138.379506:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981116416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788541138.379513:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541138.379538:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707bb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981115008:0@lo:400:kworker.0 00000100:00100000:1.0:1788541138.379545:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541138.379563:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981114624 00000100:00100000:3.0:1788541138.379568:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981114624 00000100:00100000:1.0:1788541138.379581:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981116416 00000100:00100000:1.0:1788541138.379586:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981116416 00000100:00100000:3.0:1788541138.379605:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788541138.379613:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788541138.379616:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981114624:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788541138.379626:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981116416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788541138.379640:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00002000:00000024:1.0:1788541138.379641:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788541138.379686:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981114624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541138.379694:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981116416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541138.379696:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788541138.379706:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788541138.379718:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981115648 00000100:00100000:3.0:1788541138.379723:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981115648 00000100:00100000:1.0:1788541138.379745:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981116416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788541138.379756:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981116160 00000100:00100000:3.0:1788541138.379761:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981116160 00000100:00100000:3.0:1788541138.379782:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788541138.379788:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981115648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541138.379793:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981115520 00000100:00100000:3.0:1788541138.379819:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981115648:12345-0@lo:400:kworker.0 Request processed in 32us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541138.379826:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788541138.379837:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788541138.379843:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707baf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981116160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541138.379865:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707baf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981116160:12345-0@lo:400:kworker.0 Request processed in 23us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541138.379894:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788541138.379926:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707887800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981114624:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788541138.379935:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981115648:0@lo:400:kworker.0 00000100:00100000:3.0:1788541138.379942:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6835651f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981116160:0@lo:400:kworker.0 00000100:00100000:3.0:1788541138.379970:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981116032 00000100:00100000:3.0:1788541138.379974:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981116032 00000100:00100000:3.0:1788541138.379996:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981115136 00000100:00100000:3.0:1788541138.379999:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981115136 00000100:00100000:3.0:1788541138.380016:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1788541138.380022:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875420981116032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541138.380052:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875420981116032:12345-0@lo:400:kworker.0 Request processed in 31us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541138.380059:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1788541138.380070:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1788541138.380076:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875420981115136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541138.380110:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875420981115136:12345-0@lo:400:kworker.0 Request processed in 34us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541138.380116:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1788541138.380144:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707bb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875420981115136:0@lo:400:kworker.0 00010000:00080000:3.0:1788541138.380158:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6835652a00 x1875420981116032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541138.380163:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981115520 00000100:00100000:3.0:1788541138.380173:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6835652a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875420981116032:0@lo:400:kworker.0 00000100:00100000:3.0:1788541138.380203:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1788541138.380211:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875420981115520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541138.380245:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875420981115520:12345-0@lo:400:kworker.0 Request processed in 35us (983us total) trans 0 rc 0/0 00010000:00080000:2.0:1788541138.380345:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707a73b80 x1875420981115520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541138.380356:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875420981115520:0@lo:400:kworker.0 00000100:00080000:0.0:1788541138.381919:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788541138.381942:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788541138.381945:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788541138.384842:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00010000:00010000:0.0:1788541138.506022:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788541138.635026:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788541138.635036:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788541138.635552:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788541138.635563:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788541138.954601:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788541139.542363:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788541139.658059:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788541139.658069:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788541139.658478:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1788541139.658487:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788541139.978493:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788541140.131282:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541140.131663:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955877248 00000100:00100000:3.0:1788541140.131675:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955877248 00000100:00100000:3.0:1788541140.131745:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 154 00000100:00100000:3.0:1788541140.131756:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835653b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+15:12185:x1875420955877248:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1788541140.131778:0:12149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541140.131800:0:12149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a80ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3313cd expref: -99 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.135559:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac800/0x2aac941e5f4a80d5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.135580:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac800/0x2aac941e5f4a80d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.135602:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac800/0x2aac941e5f4a80d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.135617:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a80dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.135624:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a80dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.135631:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a80dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.135673:0:12149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac800/0x2aac941e5f4a80d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.135680:0:12149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac800/0x2aac941e5f4a80d5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.135687:0:12149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac800/0x2aac941e5f4a80d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.135693:0:12149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075ac800 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541140.135698:0:12149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac800/0x2aac941e5f4a80d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.135705:0:12149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac800/0x2aac941e5f4a80d5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.135717:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6809c1c700) 00010000:00010000:3.0:1788541140.135720:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541140.135725:0:12149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac800/0x2aac941e5f4a80d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.135738:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac800/0x2aac941e5f4a80d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.135749:0:12149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a80dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.135756:0:12149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a80dc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.135761:0:12149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a80dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.135766:0:12149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075ac600 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541140.135769:0:12149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a80dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.135775:0:12149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a80dc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.135783:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9a683531b700) 00010000:00010000:3.0:1788541140.135785:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541140.135790:0:12149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a80dc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.135795:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a80dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.135843:0:12149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a80ce lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3313cd expref: 16 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.135864:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6809c1c700) 00010000:00010000:3.0:1788541140.135867:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541140.135888:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a80ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3313cd expref: 16 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.135898:0:12149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075ad800, rc 0) 00000100:00100000:3.0:1788541140.135979:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835653b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+15:12185:x1875420955877248:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 4223us (4714us total) trans 0 rc 301/301 00000100:00100000:3.0:1788541140.135988:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 154 00000100:00080000:0.0:1788541140.142083:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788541140.147757:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541140.148066:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955877504 00000100:00100000:2.0:1788541140.148077:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955877504 00000100:00100000:2.0:1788541140.148237:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 155 00000100:00100000:2.0:1788541140.148248:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+15:12185:x1875420955877504:12345-192.168.202.56@tcp:36:lfs.0 00010000:00010000:2.0:1788541140.148313:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541140.148340:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dac00/0x2aac941e5f4a7a22 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3311f1 expref: 15 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541140.148357:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6809c1c700) 00010000:00010000:2.0:1788541140.148363:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788541140.148431:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a80e3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541140.148446:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a80a4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3313bf expref: 5 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541140.148472:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a80e3 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541140.148504:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a80a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3313bf expref: 5 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541140.148517:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a80a4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3313bf expref: 5 pid: 12149 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541140.148532:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6835650700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6518:1875420981116544:192.168.202.56@tcp:104: 00000100:00100000:2.0:1788541140.148628:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6804f97300 going to sleep for 11 seconds 00000100:00100000:0.0:1788541140.151803:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541140.151911:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955877632 00000100:00100000:1.0:1788541140.151921:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955877632 00010000:00010000:1.0:1788541140.151968:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a80a4 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3313bf expref: 6 pid: 12149 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541140.152008:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 79 00000100:00100000:1.0:1788541140.152017:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68076e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:73b94cba-5efa-45eb-b12c-fe84e695d78a+6:2397:x1875420955877632:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788541140.152031:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541140.152037:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a80a4 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3313bf expref: 6 pid: 12149 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541140.152065:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a80a4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3313bf expref: 6 pid: 12149 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541140.152086:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6809c1c700) 00010000:00010000:1.0:1788541140.152102:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a80e3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541140.152113:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a80e3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541140.152120:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a80e3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541140.152138:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788541140.152188:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68076e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:73b94cba-5efa-45eb-b12c-fe84e695d78a+6:2397:x1875420955877632:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 172us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541140.152195:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 79 00000100:00080000:0.0:1788541140.152827:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788541140.153221:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a80a4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3313bf expref: 5 pid: 12149 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541140.153239:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6835650700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6518:1875420981116544:192.168.202.56@tcp:104: 00010000:00010000:2.0:1788541140.153262:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a80e3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541140.153282:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a80e3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541140.153288:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a80e3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541140.153364:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a80ea lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541140.153377:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a80ea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541140.153397:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a80ea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541140.154219:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a80f1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541140.154232:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a80f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541140.154241:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a80f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788541140.154258:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b37df835 reply state 00000000d97198e2 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a80f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541140.154281:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a80f1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541140.154288:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68350c0a00) 00010000:00010000:2.0:1788541140.154291:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788541140.154294:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788541140.154363:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788541140.154373:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a80e3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541140.154380:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a80e3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541140.154386:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a80e3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541140.154392:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551b200 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:2.0:1788541140.154403:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a80e3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541140.154411:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a80e3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541140.154422:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6809c1c700) 00010000:00010000:2.0:1788541140.154425:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541140.154429:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a80e3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541140.154435:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a80e3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788541140.154455:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b37df835 reply state 00000000d97198e2 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a80ea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541140.154463:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a80ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541140.154469:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9a68350c0700) 00010000:00010000:2.0:1788541140.154471:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788541140.154473:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788541140.154624:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+16:12185:x1875420955877504:12345-192.168.202.56@tcp:36:lfs.0 Request processed in 6376us (6875us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1788541140.154634:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 155 00000100:00100000:0.0:1788541140.216624:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541140.216915:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955877760 00000100:00100000:3.0:1788541140.216928:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955877760 00000100:00100000:2.0:1788541140.217038:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 156 00000100:00100000:2.0:1788541140.217049:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+16:12193:x1875420955877760:12345-192.168.202.56@tcp:101:lctl.0 00010000:00010000:2.0:1788541140.217074:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541140.217097:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a80f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3313d4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541140.217178:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a80ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541140.217193:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a80ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541140.217204:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a80ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541140.217243:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788541140.217247:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788541140.217280:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a80ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541140.217821:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a80f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3313d4 expref: 18 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541140.217844:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a80ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3313d4 expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541140.217853:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68350c0500) 00010000:00010000:2.0:1788541140.217856:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788541140.217860:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a683551b800, rc 0) 00000100:00100000:2.0:1788541140.218028:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+17:12193:x1875420955877760:12345-192.168.202.56@tcp:101:lctl.0 Request processed in 979us (1415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541140.218036:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 156 00000100:00100000:2.0:1788541140.258193:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541140.258339:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955877888 00000100:00100000:3.0:1788541140.258349:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955877888 00000100:00100000:3.0:1788541140.258414:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 157 00000100:00100000:3.0:1788541140.258425:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835650700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+17:12199:x1875420955877888:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:3.0:1788541140.258447:0:9339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541140.258469:0:9339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a8106 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3313db expref: -99 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.258536:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a810d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.258552:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a810d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.258564:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a810d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.258594:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a8114 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.258602:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a8114 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.258610:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a8114 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.258693:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac800/0x2aac941e5f4a811b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.258702:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac800/0x2aac941e5f4a811b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.258989:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac800/0x2aac941e5f4a811b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541140.259030:0:9339:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788541140.259034:0:9339:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788541140.259056:0:9339:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac800/0x2aac941e5f4a811b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.259070:0:9339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a810d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.259076:0:9339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a810d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.259083:0:9339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a810d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541140.259185:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541140.259224:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541140.259275:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541140.259300:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541140.259337:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541140.259361:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955878016 00000100:00100000:0.0:1788541140.259366:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955878016 00000100:00100000:0.0:1788541140.259398:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 391 00000100:00100000:0.0:1788541140.259405:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e789450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:2394:x1875420955878016:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541140.259463:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e789450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:2394:x1875420955878016:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 58us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541140.259482:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 391 00000100:00100000:0.0:1788541140.259515:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955878400 00000100:00100000:0.0:1788541140.259519:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955878400 00000100:00100000:0.0:1788541140.259551:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955878272 00000100:00100000:0.0:1788541140.259554:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955878272 00000100:00100000:0.0:1788541140.259575:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 123 00000100:00100000:0.0:1788541140.259582:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:384f52e3-0481-4979-9299-157aff7472d2+6:2394:x1875420955878400:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541140.259610:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:384f52e3-0481-4979-9299-157aff7472d2+6:2394:x1875420955878400:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 29us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541140.259617:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 123 00000100:00100000:0.0:1788541140.259629:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 124 00000100:00100000:0.0:1788541140.259635:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67076f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:384f52e3-0481-4979-9299-157aff7472d2+5:2394:x1875420955878272:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541140.259660:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67076f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:384f52e3-0481-4979-9299-157aff7472d2+5:2394:x1875420955878272:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 26us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541140.259665:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 124 00000100:00080000:0.0:1788541140.259680:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788541140.259683:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788541140.259696:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955878144 00000100:00100000:0.0:1788541140.259700:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955878144 00000100:00100000:0.0:1788541140.259745:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955878528 00000100:00100000:0.0:1788541140.259749:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955878528 00000100:00100000:0.0:1788541140.259769:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 331 00000100:00100000:0.0:1788541140.259776:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+5:2394:x1875420955878144:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541140.259803:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+5:2394:x1875420955878144:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 27us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541140.259808:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 331 00000100:00100000:0.0:1788541140.259828:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 332 00000100:00100000:0.0:1788541140.259834:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67076f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2394:x1875420955878528:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541140.259859:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67076f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2394:x1875420955878528:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 25us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541140.259865:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 332 00000100:00080000:0.0:1788541140.259905:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788541140.261256:0:9339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075ad800 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541140.261273:0:9339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a810d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.261284:0:9339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a810d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.261629:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68350c0500) 00010000:00010000:3.0:1788541140.261633:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541140.261639:0:9339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a810d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.261646:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a810d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.261666:0:9339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a8114 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.261672:0:9339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a8114 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.261679:0:9339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a8114 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.261684:0:9339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075ac600 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541140.261687:0:9339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a8114 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.261694:0:9339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a8114 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.261715:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9a68350c0700) 00010000:00010000:3.0:1788541140.261718:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541140.261722:0:9339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a8114 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.261728:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a8114 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.261781:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a8106 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3313db expref: 19 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.261796:0:9339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac800/0x2aac941e5f4a811b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3313db expref: 18 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.261803:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68350c0a00) 00010000:00010000:3.0:1788541140.261806:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788541140.261931:0:9339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075ac800, rc 0) 00000100:00100000:3.0:1788541140.261997:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835650700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+18:12199:x1875420955877888:12345-192.168.202.56@tcp:101:bash.0 Request processed in 3573us (3813us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541140.262007:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 157 00000100:00100000:0.0:1788541140.267623:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541140.267726:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955878784 00000100:00100000:3.0:1788541140.267738:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955878784 00000100:00100000:3.0:1788541140.267803:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 158 00000100:00100000:3.0:1788541140.267953:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708082a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+18:12199:x1875420955878784:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:3.0:1788541140.267976:0:12149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541140.267998:0:12149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a8122 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3313e2 expref: -99 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.268280:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a8129 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.268297:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a8129 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.268309:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a8129 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.268327:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a8130 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.268334:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a8130 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.268340:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a8130 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788541140.268711:0:12149:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:3.0:1788541140.268954:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075acc00/0x2aac941e5f4a8137 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.268964:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075acc00/0x2aac941e5f4a8137 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.268971:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075acc00/0x2aac941e5f4a8137 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.269004:0:12149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a8129 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.269026:0:12149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a8129 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.269033:0:12149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a8129 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.269038:0:12149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075ac600 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541140.269043:0:12149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a8129 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.269052:0:12149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a8129 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.269065:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68350c0a00) 00010000:00010000:3.0:1788541140.269068:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541140.269074:0:12149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a8129 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.269081:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a8129 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788541140.269164:0:12149:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000002a3dffb reply state 00000000dba77dae transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a8130 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.269177:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a8130 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.269183:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a683531b700) 00010000:00010000:3.0:1788541140.269185:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788541140.269188:0:12149:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788541140.269221:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a8122 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3313e2 expref: 21 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.269242:0:12149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075acc00/0x2aac941e5f4a8137 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3313e2 expref: 20 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.269249:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a683531bf00) 00010000:00010000:3.0:1788541140.269251:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788541140.269253:0:12149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075acc00, rc 0) 00000100:00100000:3.0:1788541140.269407:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708082a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+21:12199:x1875420955878784:12345-192.168.202.56@tcp:101:bash.0 Request processed in 1594us (1795us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1788541140.269416:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 158 00000100:00100000:0.0:1788541140.272551:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541140.272625:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955878912 00000100:00100000:3.0:1788541140.272636:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955878912 00000100:00100000:3.0:1788541140.272697:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 55 00000100:00100000:3.0:1788541140.272707:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708080700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:384f52e3-0481-4979-9299-157aff7472d2+5:2397:x1875420955878912:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:3.0:1788541140.272728:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541140.272750:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a8077ee/0x2aac941e5f4a8145 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3313e9 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788541140.272775:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788541140.272794:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1788541140.272798:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541140.272808:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a8077ee/0x2aac941e5f4a8145 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3313e9 expref: 6 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.272826:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005a8077ee/0x2aac941e5f4a8145 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3313e9 expref: 6 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.272858:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075adc00, rc 0) 00000100:00100000:3.0:1788541140.272931:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708080700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:384f52e3-0481-4979-9299-157aff7472d2+6:2397:x1875420955878912:12345-192.168.202.56@tcp:101:bash.0 Request processed in 226us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541140.272937:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 55 00000100:00100000:0.0:1788541140.274969:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541140.275033:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955879040 00000100:00100000:1.0:1788541140.275040:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955879040 00000100:00100000:1.0:1788541140.275082:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 56 00000100:00100000:1.0:1788541140.275089:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707728e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:384f52e3-0481-4979-9299-157aff7472d2+6:12199:x1875420955879040:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:1.0:1788541140.275103:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541140.275118:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067ec5533/0x2aac941e5f4a814c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3313f0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541140.275139:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005a8077ee/0x2aac941e5f4a8145 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3313e9 expref: 7 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541140.275160:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541140.275163:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541140.275167:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067ec5533/0x2aac941e5f4a814c lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3313f0 expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541140.275193:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005a8077ee/0x2aac941e5f4a8145 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3313e9 expref: 7 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541140.275202:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005a8077ee/0x2aac941e5f4a8145 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3313e9 expref: 7 pid: 8430 timeout: 521 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541140.275213:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8431:1875420981116672:192.168.202.56@tcp:104: 00000100:00100000:1.0:1788541140.275314:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6809f7d900 going to sleep for 11 seconds 00000100:00100000:1.0:1788541140.277077:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541140.277135:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955879168 00000100:00100000:2.0:1788541140.277152:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955879168 00000100:00100000:3.0:1788541140.277158:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8431:1875420981116672:192.168.202.56@tcp:104: 00010000:00010000:3.0:1788541140.277186:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067ec5533/0x2aac941e5f4a814c lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xa16473202a3313f0 expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541140.277186:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005a8077ee/0x2aac941e5f4a8145 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3313e9 expref: 8 pid: 8430 timeout: 521 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.277206:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68354db800, rc 0) 00000100:00100000:3.0:1788541140.277274:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707728e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:384f52e3-0481-4979-9299-157aff7472d2+8:12199:x1875420955879040:12345-192.168.202.56@tcp:101:bash.0 Request processed in 2175us (2304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541140.277280:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 80 00000100:00100000:3.0:1788541140.277281:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 56 00000100:00100000:2.0:1788541140.277289:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:384f52e3-0481-4979-9299-157aff7472d2+8:2396:x1875420955879168:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541140.277309:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541140.277331:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005a8077ee/0x2aac941e5f4a8145 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3313e9 expref: 7 pid: 8430 timeout: 521 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541140.277344:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005a8077ee/0x2aac941e5f4a8145 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3313e9 expref: 7 pid: 8430 timeout: 521 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541140.277366:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a8077ee/0x2aac941e5f4a8145 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3313e9 expref: 7 pid: 8430 timeout: 521 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541140.277381:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541140.277390:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541140.277399:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067ec5533/0x2aac941e5f4a814c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xa16473202a3313f0 expref: 6 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541140.277410:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067ec5533/0x2aac941e5f4a814c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xa16473202a3313f0 expref: 6 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541140.277440:0:6502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000067ec5533/0x2aac941e5f4a814c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xa16473202a3313f0 expref: 6 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541140.277465:0:6502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6835652a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6502:1875420981116800:192.168.202.56@tcp:105: 00000100:00100000:2.0:1788541140.277538:0:6502:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68355193c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788541140.280090:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541140.280143:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955879424 00000100:00100000:1.0:1788541140.280152:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955879424 00000100:00100000:1.0:1788541140.280213:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 36 00000100:00100000:1.0:1788541140.280223:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707729880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+21:12199:x1875420955879424:12345-192.168.202.56@tcp:35:bash.0 00000100:00100000:1.0:1788541140.280661:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707729880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+22:12199:x1875420955879424:12345-192.168.202.56@tcp:35:bash.0 Request processed in 439us (581us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1788541140.280669:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 36 00000100:00100000:2.0:1788541140.280672:0:6502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6835652a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6502:1875420981116800:192.168.202.56@tcp:105: 00010000:00010000:2.0:1788541140.280692:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541140.280715:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:384f52e3-0481-4979-9299-157aff7472d2+6:2396:x1875420955879168:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 3426us (3642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541140.280723:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 80 00000100:00100000:1.0:1788541140.344516:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541140.344646:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955879680 00000100:00100000:0.0:1788541140.344656:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955879680 00000100:00100000:0.0:1788541140.344723:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 159 00000100:00100000:0.0:1788541140.344734:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+22:12209:x1875420955879680:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1788541140.344761:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541140.344783:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a8153 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3313f7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541140.344942:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788541140.345042:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a8153 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3313f7 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.345054:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68350c0500) 00010000:00010000:0.0:1788541140.345056:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788541140.345061:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a8153 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3313f7 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.345091:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75fe00, rc 0) 00000100:00100000:0.0:1788541140.345148:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+23:12209:x1875420955879680:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 417us (641us total) trans 4294967421 rc 301/301 00000100:00100000:0.0:1788541140.345154:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 159 00000100:00100000:0.0:1788541140.354337:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541140.354798:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955879936 00000100:00100000:3.0:1788541140.354810:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955879936 00000100:00100000:3.0:1788541140.354915:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 37 00000100:00100000:3.0:1788541140.354927:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707728000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+23:12209:x1875420955879936:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:3.0:1788541140.355179:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707728000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+24:12209:x1875420955879936:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 253us (853us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1788541140.355188:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 37 00000100:00100000:1.0:1788541140.429711:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541140.429804:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955880064 00000100:00100000:3.0:1788541140.429821:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955880064 00000100:00100000:3.0:1788541140.429900:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 160 00000100:00100000:3.0:1788541140.429910:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+24:12215:x1875420955880064:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1788541140.429949:0:9339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541140.429972:0:9339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a8161 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3313fe expref: -99 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.430035:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a8168 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.430050:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a8168 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.430060:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a8168 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541140.430109:0:9339:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788541140.430113:0:9339:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788541140.430132:0:9339:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a8168 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.430159:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a8161 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3313fe expref: 26 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.430177:0:9339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a8168 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3313fe expref: 25 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.430186:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68350c0a00) 00010000:00010000:3.0:1788541140.430189:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788541140.430192:0:9339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075ac600, rc 0) 00000100:00100000:3.0:1788541140.430258:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+25:12215:x1875420955880064:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 349us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541140.430273:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 160 00000100:00100000:0.0:1788541140.434164:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541140.434244:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955880320 00000100:00100000:3.0:1788541140.434254:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955880320 00000100:00100000:3.0:1788541140.434927:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 161 00000100:00100000:3.0:1788541140.434941:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f0ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+25:12215:x1875420955880320:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1788541140.434964:0:12149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541140.434985:0:12149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a816f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331405 expref: -99 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.435099:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad200/0x2aac941e5f4a8176 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.435116:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad200/0x2aac941e5f4a8176 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.435128:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad200/0x2aac941e5f4a8176 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541140.435139:0:12149:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788541140.435246:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a816f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331405 expref: 28 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.435276:0:12149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad200/0x2aac941e5f4a8176 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331405 expref: 27 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.435286:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a683531bf00) 00010000:00010000:3.0:1788541140.435289:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788541140.435292:0:12149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075ad200, rc 0) 00000100:00100000:3.0:1788541140.435706:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f0ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+27:12215:x1875420955880320:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 767us (1551us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1788541140.435733:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 161 00000100:00100000:2.0:1788541140.446391:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541140.446635:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955880576 00000100:00100000:0.0:1788541140.446645:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955880576 00000100:00100000:0.0:1788541140.446707:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 162 00000100:00100000:0.0:1788541140.446718:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835652a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+27:12215:x1875420955880576:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1788541140.446742:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541140.446763:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a8184 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a33140c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.446864:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a818b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.446908:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a818b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.446919:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a818b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541140.446931:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788541140.447023:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a8184 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33140c expref: 30 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.447057:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a818b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33140c expref: 29 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.447065:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a683531bf00) 00010000:00010000:0.0:1788541140.447068:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788541140.447071:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75ee00, rc 0) 00000100:00100000:0.0:1788541140.447144:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835652a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+29:12215:x1875420955880576:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 428us (763us total) trans 4294967424 rc 0/0 00000100:00100000:0.0:1788541140.447151:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 162 00000100:00100000:0.0:1788541140.447654:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541140.447697:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955880704 00000100:00100000:3.0:1788541140.447702:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955880704 00000100:00100000:3.0:1788541140.447741:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 11 00000100:00100000:3.0:1788541140.447749:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f0fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:384f52e3-0481-4979-9299-157aff7472d2+29:2397:x1875420955880704:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541140.447759:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541140.447775:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad200/0x2aac941e5f4a8176 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331405 expref: 29 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.447788:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a683531bf00) 00010000:00010000:3.0:1788541140.447792:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541140.447833:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f0fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:384f52e3-0481-4979-9299-157aff7472d2+28:2397:x1875420955880704:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 84us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541140.447840:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 11 00000100:00100000:0.0:1788541140.456440:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541140.456624:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955880832 00000100:00100000:3.0:1788541140.456634:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955880832 00000100:00100000:3.0:1788541140.456691:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 57 00000100:00100000:3.0:1788541140.456700:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835589180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:384f52e3-0481-4979-9299-157aff7472d2+6:2396:x1875420955880832:12345-192.168.202.56@tcp:1:lfs.0 00010000:00010000:3.0:1788541140.456742:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000720f7b13/0x2aac941e5f4a8199 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.456760:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067ec5533/0x2aac941e5f4a814c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xa16473202a3313f0 expref: 6 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.456768:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541140.456772:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788541140.456792:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000720f7b13/0x2aac941e5f4a8199 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.456836:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000067ec5533/0x2aac941e5f4a814c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xa16473202a3313f0 expref: 6 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.456851:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000067ec5533/0x2aac941e5f4a814c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a3313f0 expref: 6 pid: 8431 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541140.456866:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1875420981116928:192.168.202.56@tcp:104: 00000100:00100000:3.0:1788541140.456993:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683f241540 going to sleep for 11 seconds 00000100:00100000:1.0:1788541140.460422:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541140.461258:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1875420981116928:192.168.202.56@tcp:104: 00010000:00010000:3.0:1788541140.461299:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000720f7b13/0x2aac941e5f4a8199 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541140.468038:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955880960 00000100:00100000:2.0:1788541140.468056:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955880960 00002000:00100000:2.0:1788541140.468193:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9a670835d500 x1875420955880960/t0(0) o4->384f52e3-0481-4979-9299-157aff7472d2@192.168.202.56@tcp:511/0 lens 504/0 e 0 to 0 dl 1788541151 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788541140.468205:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a670835d500 with x1875420955880960 ext(0->12) 00010000:00010000:2.0:1788541140.468216:0:8437:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000067ec5533/0x2aac941e5f4a814c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a3313f0 expref: 7 pid: 8431 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541140.468235:0:8437:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000067ec5533/0x2aac941e5f4a814c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a3313f0 expref: 7 pid: 8431 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788541140.468243:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a670835d500 00000100:00100000:2.0:1788541140.468320:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 2 00000100:00100000:2.0:1788541140.468331:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:384f52e3-0481-4979-9299-157aff7472d2+7:2396:x1875420955880960:12345-192.168.202.56@tcp:4:lfs.0 00000100:00100000:2.0:1788541140.471074:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:384f52e3-0481-4979-9299-157aff7472d2+9:2396:x1875420955880960:12345-192.168.202.56@tcp:4:lfs.0 Request processed in 2733us (10649us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788541140.471285:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 2 00002000:00100000:2.0:1788541140.471298:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9a670835d500 x1875420955880960/t4294967306(0) o4->384f52e3-0481-4979-9299-157aff7472d2@192.168.202.56@tcp:511/0 lens 504/448 e 0 to 0 dl 1788541151 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788541140.471309:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a670835d500 with x1875420955880960 ext(0->12) 00010000:00010000:2.0:1788541140.471321:0:8437:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000067ec5533/0x2aac941e5f4a814c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a3313f0 expref: 9 pid: 8431 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541140.471352:0:8437:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000067ec5533/0x2aac941e5f4a814c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a3313f0 expref: 9 pid: 8431 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788541140.471361:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a670835d500 00000100:00100000:2.0:1788541140.476955:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541140.477057:0:9520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955881088 00000100:00100000:1.0:1788541140.477067:0:9520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955881088 00010000:00010000:1.0:1788541140.477169:0:9520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000067ec5533/0x2aac941e5f4a814c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a3313f0 expref: 9 pid: 8431 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541140.477244:0:9520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 81 00000100:00100000:1.0:1788541140.477254:0:9520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835651f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:384f52e3-0481-4979-9299-157aff7472d2+9:2397:x1875420955881088:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788541140.477281:0:9520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788541140.477299:0:9520:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788541140.477310:0:9520:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788541140 00002000:00010000:1.0:1788541140.477312:0:9520:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788541140 00002000:00010000:1.0:1788541140.477315:0:9520:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1788541140 00002000:00010000:1.0:1788541140.477317:0:9520:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788541140.477324:0:9520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000067ec5533/0x2aac941e5f4a814c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a3313f0 expref: 9 pid: 8431 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541140.477445:0:9520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000067ec5533/0x2aac941e5f4a814c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a3313f0 expref: 9 pid: 8431 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541140.477481:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067ec5533/0x2aac941e5f4a814c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a3313f0 expref: 9 pid: 8431 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541140.477500:0:9520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788541140.477505:0:9520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788541140.477511:0:9520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000720f7b13/0x2aac941e5f4a8199 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541140.477540:0:9520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000720f7b13/0x2aac941e5f4a8199 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541140.477619:0:9520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788541140.477678:0:9520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835651f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:384f52e3-0481-4979-9299-157aff7472d2+8:2397:x1875420955881088:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 424us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541140.477685:0:9520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 81 00010000:00010000:3.0:1788541140.479330:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000720f7b13/0x2aac941e5f4a8199 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.479452:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000720f7b13/0x2aac941e5f4a8199 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.479539:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000720f7b13/0x2aac941e5f4a8199 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.479550:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000720f7b13/0x2aac941e5f4a8199 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.479577:0:8430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000720f7b13/0x2aac941e5f4a8199 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.479584:0:8430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075ad200 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:3.0:1788541140.479588:0:8430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000720f7b13/0x2aac941e5f4a8199 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.479598:0:8430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000720f7b13/0x2aac941e5f4a8199 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.479659:0:8430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000720f7b13/0x2aac941e5f4a8199 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.479669:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000720f7b13/0x2aac941e5f4a8199 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541140.479767:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835589180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:384f52e3-0481-4979-9299-157aff7472d2+7:2396:x1875420955880832:12345-192.168.202.56@tcp:1:lfs.0 Request processed in 23064us (23332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541140.479775:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 57 00000100:00100000:2.0:1788541140.483556:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541140.483755:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955881344 00000100:00100000:3.0:1788541140.483765:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955881344 00000100:00100000:3.0:1788541140.483851:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 38 00000100:00100000:3.0:1788541140.483861:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6811402450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+28:12215:x1875420955881344:12345-192.168.202.56@tcp:35:lfs.0 00000004:00010000:3.0:1788541140.483962:0:6520:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a818b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33140c expref: 28 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788541140.484128:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:3.0:1788541140.484153:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1788541140.484668:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:3.0:1788541140.484705:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a81a0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.484720:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075acc00/0x2aac941e5f4a8137 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3313e2 expref: 32 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.484730:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a81a0 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.484762:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075acc00/0x2aac941e5f4a8137 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3313e2 expref: 32 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.484775:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075acc00/0x2aac941e5f4a8137 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3313e2 expref: 32 pid: 12149 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541140.484789:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a73b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6520:1875420981117056:192.168.202.56@tcp:104: 00000100:00100000:3.0:1788541140.484945:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683f241180 going to sleep for 11 seconds 00000100:00100000:3.0:1788541140.486926:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a73b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6520:1875420981117056:192.168.202.56@tcp:104: 00010000:00010000:3.0:1788541140.486953:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a81a0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541140.490556:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541140.490627:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955881472 00000100:00100000:0.0:1788541140.490637:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955881472 00010000:00010000:0.0:1788541140.490677:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075acc00/0x2aac941e5f4a8137 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3313e2 expref: 33 pid: 12149 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541140.490721:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 82 00000100:00100000:0.0:1788541140.490732:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835650380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:384f52e3-0481-4979-9299-157aff7472d2+33:2397:x1875420955881472:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788541140.490746:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541140.490752:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075acc00/0x2aac941e5f4a8137 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3313e2 expref: 33 pid: 12149 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.490765:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075acc00/0x2aac941e5f4a8137 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3313e2 expref: 33 pid: 12149 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.490787:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075acc00/0x2aac941e5f4a8137 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3313e2 expref: 33 pid: 12149 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.490819:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a683531bf00) 00010000:00010000:0.0:1788541140.490824:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a81a0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.490834:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a81a0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.490842:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a81a0 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.490890:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541140.490943:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835650380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:384f52e3-0481-4979-9299-157aff7472d2+32:2397:x1875420955881472:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 213us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541140.490951:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 82 00010000:00010000:2.0:1788541140.491166:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a81a0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541140.491175:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a81a0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788541140.491297:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:2.0:1788541140.492685:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:2.0:1788541140.492785:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6520:1875420981117184:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788541140.492844:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541140.492892:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6835519240 going to sleep for 11 seconds 00000100:00100000:1.0:1788541140.493127:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981117184 00000100:00100000:1.0:1788541140.493133:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981117184 00000100:00100000:1.0:1788541140.493190:0:10866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788541140.493198:0:10866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6520:x1875420981117184:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788541140.493286:0:10866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6520:x1875420981117184:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 88us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541140.493294:0:10866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788541140.493344:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6520:1875420981117184:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788541140.493691:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:3.0:1788541140.493742:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a73b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6520:1875420981117312:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788541140.493790:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541140.493821:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a680529ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1788541140.493914:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981117312 00000100:00100000:1.0:1788541140.493919:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981117312 00000100:00100000:1.0:1788541140.493946:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788541140.493952:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6520:x1875420981117312:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788541140.494055:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6520:x1875420981117312:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 102us (264us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788541140.494062:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788541140.494095:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a73b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6520:1875420981117312:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788541140.494127:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:1.0:1788541140.494160:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a81a0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541140.494181:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a81a0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541140.494189:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a81a0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541140.494195:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075ad000 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541140.494200:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a81a0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541140.494208:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a81a0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541140.494222:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a683531bf00) 00010000:00010000:1.0:1788541140.494225:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788541140.494229:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a81a0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541140.494234:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a81a0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788541140.494401:0:6520:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788541140.494577:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:1.0:1788541140.494589:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 421412717836ns, next at 422412715588ns, rc = 0 00000001:00080000:1.0:1788541140.494596:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:1.0:1788541140.494675:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a683531bf00) 00010000:00010000:1.0:1788541140.494678:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788541140.494685:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a818b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33140c expref: 36 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541140.494790:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6811402450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+35:12215:x1875420955881344:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 10930us (11244us total) trans 4294967433 rc 0/0 00000100:00100000:1.0:1788541140.494799:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 38 00000020:00080000:1.0:1788541140.494802:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:0.0:1788541140.495011:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788541140.499191:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541140.499273:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955881600 00000100:00100000:0.0:1788541140.499284:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955881600 00000100:00100000:0.0:1788541140.499402:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 163 00000100:00100000:0.0:1788541140.499414:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+35:12215:x1875420955881600:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1788541140.499439:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541140.499792:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a81a7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331413 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.499853:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a81a7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331413 expref: 36 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.499896:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a81a7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331413 expref: 36 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.499929:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68350b2300) 00010000:00010000:0.0:1788541140.499931:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788541140.499934:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75e600, rc 0) 00000100:00100000:0.0:1788541140.499979:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+36:12215:x1875420955881600:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 569us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541140.499984:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 163 00000100:00100000:0.0:1788541140.504744:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541140.504793:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955881856 00000100:00100000:2.0:1788541140.504898:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955881856 00000100:00100000:2.0:1788541140.504957:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 39 00000100:00100000:2.0:1788541140.504968:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683558bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+36:12215:x1875420955881856:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:2.0:1788541140.505219:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683558bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+37:12215:x1875420955881856:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 251us (480us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1788541140.505227:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 39 00010000:00010000:3.0:1788541140.554415:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541140.598109:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541140.598176:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955882112 00000100:00100000:0.0:1788541140.598188:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955882112 00000100:00100000:0.0:1788541140.598305:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 164 00000100:00100000:0.0:1788541140.598317:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+37:12225:x1875420955882112:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1788541140.598342:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541140.598363:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a81ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a33141a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541140.598472:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788541140.598571:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a81ae lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33141a expref: 39 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.598585:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68350c0500) 00010000:00010000:0.0:1788541140.598587:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788541140.598592:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a81ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33141a expref: 39 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.598604:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75fe00, rc 0) 00000100:00100000:0.0:1788541140.598686:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+38:12225:x1875420955882112:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 371us (587us total) trans 4294967435 rc 301/301 00000100:00100000:0.0:1788541140.598707:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 164 00000100:00100000:3.0:1788541140.602044:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541140.602363:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955882240 00000100:00100000:0.0:1788541140.602375:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955882240 00000100:00100000:0.0:1788541140.602583:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 165 00000100:00100000:0.0:1788541140.602594:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707887800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+38:12225:x1875420955882240:12345-192.168.202.56@tcp:34:lfs.0 00010000:00010000:0.0:1788541140.602681:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a81bc lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.602698:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a81bc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.602708:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a81bc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.602718:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a81c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.602724:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a81c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.602729:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a81c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.602798:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a81ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.603175:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a81ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.603184:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a81ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788541140.603248:0:9339:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a81ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.603272:0:9339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a81bc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.603280:0:9339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a81bc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.603286:0:9339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a81bc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.603291:0:9339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75fc00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541140.603295:0:9339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a81bc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.603311:0:9339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a81bc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.603324:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68350c0a00) 00010000:00010000:0.0:1788541140.603326:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541140.603331:0:9339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a81bc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.603338:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a81bc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.603351:0:9339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a81c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.603357:0:9339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a81c3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.603368:0:9339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a81c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.603373:0:9339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75ee00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541140.603376:0:9339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a81c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.603383:0:9339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a81c3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.603391:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a683531b700) 00010000:00010000:0.0:1788541140.603394:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541140.603397:0:9339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a81c3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.603403:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a81c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.603413:0:9339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a81ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.603419:0:9339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a81ca lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.603424:0:9339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a81ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.603429:0:9339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75f200 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541140.603432:0:9339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a81ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.603559:0:9339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a81ca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.603568:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68350b2300) 00010000:00010000:0.0:1788541140.603571:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541140.603573:0:9339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a81ca lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.603579:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a81ca lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541140.603706:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707887800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+38:12225:x1875420955882240:12345-192.168.202.56@tcp:34:lfs.0 Request processed in 1112us (1669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541140.603715:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 165 00000100:00100000:1.0:1788541140.613076:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541140.613964:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955882496 00000100:00100000:3.0:1788541140.613976:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955882496 00000100:00100000:3.0:1788541140.614102:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 40 00000100:00100000:3.0:1788541140.614114:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707729880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+38:12225:x1875420955882496:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:3.0:1788541140.614403:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707729880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+39:12225:x1875420955882496:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 290us (1336us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1788541140.614411:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 40 00000100:00100000:1.0:1788541140.667980:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541140.668067:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955882752 00000100:00100000:0.0:1788541140.668076:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955882752 00000100:00100000:0.0:1788541140.668138:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 166 00000100:00100000:0.0:1788541140.668147:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707728000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+39:12228:x1875420955882752:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1788541140.668171:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541140.668190:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a81d1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331421 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.668256:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a81d8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.668281:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a81d8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.668291:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a81d8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.668324:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a81df lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.668331:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a81df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.668337:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a81df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.668464:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a81e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.668473:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a81e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.668480:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a81e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541140.668489:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788541140.668567:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a81d8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.668576:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a81d8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.668581:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a81d8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.668587:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75ee00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541140.668592:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a81d8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.668609:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a81d8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.668621:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68350c0a00) 00010000:00010000:0.0:1788541140.668624:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541140.668630:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a81d8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.668636:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a81d8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.668649:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a81df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.668654:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a81df lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.668660:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a81df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.668665:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75fc00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541140.668668:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a81df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.668674:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a81df lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.668681:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a683531b700) 00010000:00010000:0.0:1788541140.668683:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541140.668686:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a81df lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.668702:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a81df lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.668742:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a81d1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331421 expref: 42 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.668754:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a81e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331421 expref: 41 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.668761:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68350b2300) 00010000:00010000:0.0:1788541140.668764:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788541140.668766:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75ec00, rc 0) 00000100:00100000:0.0:1788541140.668831:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707728000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+41:12228:x1875420955882752:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 684us (859us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1788541140.668838:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 166 00000100:00100000:0.0:1788541140.674734:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541140.674814:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955882880 00000100:00100000:2.0:1788541140.674824:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955882880 00000100:00100000:2.0:1788541140.674894:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 167 00000100:00100000:2.0:1788541140.674903:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683558b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+41:12228:x1875420955882880:12345-192.168.202.56@tcp:54:lfs.0 00010000:00010000:2.0:1788541140.674980:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a81f4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541140.674996:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a81f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541140.675006:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a81f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541140.675038:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a81f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541140.675044:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a81f4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541140.675050:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a81f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541140.675056:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551aa00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:2.0:1788541140.675060:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a81f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541140.675080:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a81f4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541140.675101:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68350b2300) 00010000:00010000:2.0:1788541140.675104:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788541140.675108:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a81f4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541140.675115:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a81f4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541140.675193:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683558b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+41:12228:x1875420955882880:12345-192.168.202.56@tcp:54:lfs.0 Request processed in 291us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541140.675200:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 167 00000100:00100000:1.0:1788541140.679282:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541140.679688:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955883136 00000100:00100000:2.0:1788541140.679699:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955883136 00000100:00100000:2.0:1788541140.679795:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 41 00000100:00100000:2.0:1788541140.679805:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708271c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+41:12228:x1875420955883136:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:2.0:1788541140.680212:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708271c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+42:12228:x1875420955883136:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 406us (947us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1788541140.680219:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 41 00000100:00100000:1.0:1788541140.992863:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541140.993122:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955883392 00000100:00100000:0.0:1788541140.993131:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955883392 00000100:00100000:0.0:1788541140.993207:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 168 00000100:00100000:0.0:1788541140.993218:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708271180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+42:12259:x1875420955883392:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:0.0:1788541140.993245:0:9339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541140.993282:0:9339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a81fb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331428 expref: -99 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.993395:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a8202 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.993421:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a8202 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.993430:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a8202 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541140.993449:0:9339:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788541140.993536:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a81fb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331428 expref: 45 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.993549:0:9339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a8202 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331428 expref: 44 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541140.993555:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68350b2300) 00010000:00010000:0.0:1788541140.993557:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788541140.993560:0:9339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75ee00, rc 0) 00000100:00100000:0.0:1788541140.993612:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708271180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+44:12259:x1875420955883392:12345-192.168.202.56@tcp:101:cat.0 Request processed in 397us (816us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1788541140.993617:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 168 00000100:00100000:3.0:1788541140.996437:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541140.996679:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541140.996716:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955883520 00000100:00100000:3.0:1788541140.996723:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955883520 00000100:00100000:3.0:1788541140.996777:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 12 00000100:00100000:3.0:1788541140.996785:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:384f52e3-0481-4979-9299-157aff7472d2+44:2396:x1875420955883520:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541140.996798:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541140.996820:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a8202 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331428 expref: 44 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541140.996838:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68350b2300) 00010000:00010000:3.0:1788541140.996843:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541140.996930:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:384f52e3-0481-4979-9299-157aff7472d2+43:2396:x1875420955883520:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 145us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541140.996938:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 12 00000100:00100000:3.0:1788541140.997190:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955883776 00000100:00100000:3.0:1788541140.997195:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955883776 00000100:00100000:3.0:1788541140.997221:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 42 00000100:00100000:3.0:1788541140.997227:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+43:12259:x1875420955883776:12345-192.168.202.56@tcp:35:cat.0 00000100:00100000:3.0:1788541140.997715:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+44:12259:x1875420955883776:12345-192.168.202.56@tcp:35:cat.0 Request processed in 485us (1033us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1788541140.997722:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 42 00000100:00100000:3.0:1788541141.078198:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541141.078317:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955884032 00000100:00100000:2.0:1788541141.078336:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955884032 00000100:00100000:2.0:1788541141.078408:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 169 00000100:00100000:2.0:1788541141.078419:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+44:12265:x1875420955884032:12345-192.168.202.56@tcp:101:dd.0 00010000:00010000:2.0:1788541141.078445:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541141.078448:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788541141.078488:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a8168 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3313fe expref: 44 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541141.078507:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68350c0a00) 00010000:00010000:2.0:1788541141.078512:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788541141.078527:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a8210 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a33142f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541141.078631:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a8217 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541141.078645:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a81e6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331421 expref: 44 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541141.078652:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a8217 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541141.078685:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a81e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331421 expref: 44 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541141.078698:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a81e6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331421 expref: 44 pid: 6517 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541141.078711:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6518:1875420981117440:192.168.202.56@tcp:104: 00000100:00100000:2.0:1788541141.078812:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6835519f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788541141.085334:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541141.085560:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955884160 00000100:00100000:3.0:1788541141.085570:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955884160 00010000:00010000:3.0:1788541141.085615:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a81e6 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331421 expref: 45 pid: 6517 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541141.085664:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 83 00000100:00100000:3.0:1788541141.085674:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670691aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:384f52e3-0481-4979-9299-157aff7472d2+45:2396:x1875420955884160:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541141.085689:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541141.085696:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a81e6 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331421 expref: 45 pid: 6517 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541141.085711:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a81e6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331421 expref: 45 pid: 6517 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541141.085740:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68350b2300) 00010000:00010000:3.0:1788541141.085746:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a8217 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541141.085755:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a8217 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541141.085778:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a8217 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541141.085796:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541141.086023:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670691aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:384f52e3-0481-4979-9299-157aff7472d2+45:2396:x1875420955884160:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 348us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541141.086031:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 83 00010000:00010000:0.0:1788541141.086497:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a81e6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331421 expref: 44 pid: 6517 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541141.086516:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6518:1875420981117440:192.168.202.56@tcp:104: 00010000:00010000:0.0:1788541141.086538:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a8217 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.086548:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a8217 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.086561:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a8217 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541141.086579:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788541141.086706:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a8210 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33142f expref: 45 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.086719:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a8217 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33142f expref: 44 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.086726:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68350b2300) 00010000:00010000:0.0:1788541141.086729:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788541141.086731:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a683551b200, rc 0) 00000100:00100000:0.0:1788541141.086762:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+44:12265:x1875420955884032:12345-192.168.202.56@tcp:101:dd.0 Request processed in 8345us (8575us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1788541141.086769:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 169 00000100:00100000:1.0:1788541141.091689:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541141.091741:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955884288 00000100:00100000:3.0:1788541141.091750:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955884288 00000100:00100000:3.0:1788541141.091811:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 170 00000100:00100000:3.0:1788541141.091821:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68052e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+44:12265:x1875420955884288:12345-192.168.202.56@tcp:101:dd.0 00010000:00010000:3.0:1788541141.091845:0:12149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541141.091863:0:12149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a8225 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331436 expref: -99 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541141.091981:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad200/0x2aac941e5f4a822c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541141.091997:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad200/0x2aac941e5f4a822c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541141.092010:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad200/0x2aac941e5f4a822c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541141.092133:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a8225 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331436 expref: 46 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541141.092150:0:12149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad200/0x2aac941e5f4a822c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331436 expref: 45 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541141.092165:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68350b2300) 00010000:00010000:3.0:1788541141.092168:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788541141.092172:0:12149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075ad200, rc 0) 00000100:00100000:3.0:1788541141.093077:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68052e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+45:12265:x1875420955884288:12345-192.168.202.56@tcp:101:dd.0 Request processed in 1252us (1388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541141.093087:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 170 00000100:00100000:2.0:1788541141.103209:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541141.103393:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955884544 00000100:00100000:0.0:1788541141.103405:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955884544 00000100:00100000:0.0:1788541141.103559:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 171 00000100:00100000:0.0:1788541141.103568:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670691a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+45:12265:x1875420955884544:12345-192.168.202.56@tcp:36:dd.0 00010000:00010000:0.0:1788541141.103782:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a8233 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.103861:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a8233 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.103982:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a8233 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788541141.104037:0:9339:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:0.0:1788541141.104054:0:9339:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008aee1581 reply state 0000000024f40298 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a8233 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.104063:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a8233 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.104069:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68350b2300) 00010000:00010000:0.0:1788541141.104071:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788541141.104074:0:9339:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788541141.104165:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670691a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+48:12265:x1875420955884544:12345-192.168.202.56@tcp:36:dd.0 Request processed in 597us (966us total) trans 4294967443 rc 0/0 00000100:00100000:0.0:1788541141.104173:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 171 00000020:00080000:0.0:1788541141.104177:0:9339:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788541141.339946:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541141.340225:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955884672 00000100:00100000:0.0:1788541141.340237:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955884672 00000100:00100000:0.0:1788541141.340341:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 172 00000100:00100000:0.0:1788541141.340352:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670691b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+48:12279:x1875420955884672:12345-192.168.202.56@tcp:101:stat.0 00010000:00010000:0.0:1788541141.340379:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541141.340401:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a823a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a33143d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.340498:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a8241 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.340514:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a8241 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.340525:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a8241 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.340544:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a8248 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.340551:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a8248 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.340559:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a8248 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.340626:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a824f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.340637:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a8217 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33142f expref: 49 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.340644:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a824f lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.340678:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a8217 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33142f expref: 49 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.340691:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a8217 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33142f expref: 49 pid: 6518 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541141.340703:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6835588700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6518:1875420981117568:192.168.202.56@tcp:104: 00000100:00100000:0.0:1788541141.340808:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707570300 going to sleep for 11 seconds 00000100:00100000:0.0:1788541141.344150:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6835588700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6518:1875420981117568:192.168.202.56@tcp:104: 00010000:00010000:0.0:1788541141.344182:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a824f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541141.345073:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541141.345238:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955884928 00000100:00100000:3.0:1788541141.345247:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955884928 00000100:00100000:3.0:1788541141.345324:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 43 00000100:00100000:3.0:1788541141.345334:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670691ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+50:6166:x1875420955884928:12345-192.168.202.56@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788541141.345619:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670691ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+51:6166:x1875420955884928:12345-192.168.202.56@tcp:35:ldlm_bl.0 Request processed in 285us (548us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1788541141.345627:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 43 00000100:00100000:1.0:1788541141.350711:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541141.350808:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955885056 00000100:00100000:3.0:1788541141.350818:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955885056 00010000:00010000:3.0:1788541141.350859:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a8217 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33142f expref: 51 pid: 6518 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541141.350957:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 84 00000100:00100000:3.0:1788541141.350968:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68076eb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:384f52e3-0481-4979-9299-157aff7472d2+51:2396:x1875420955885056:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541141.350988:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541141.350995:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a8217 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33142f expref: 51 pid: 6518 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541141.351009:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a8217 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33142f expref: 51 pid: 6518 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541141.351049:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a8217 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33142f expref: 51 pid: 6518 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541141.351066:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68350b2300) 00010000:00010000:3.0:1788541141.351072:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a824f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541141.351094:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a824f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541141.351104:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a824f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541141.351128:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541141.351184:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68076eb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:384f52e3-0481-4979-9299-157aff7472d2+50:2396:x1875420955885056:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 217us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541141.351191:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 84 00010000:00010000:0.0:1788541141.351922:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a824f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.351934:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a824f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541141.351988:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788541141.351993:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788541141.352018:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a824f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.352033:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a824f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.352044:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a8241 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.352051:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a8241 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.352058:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a8241 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.352064:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75ee00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541141.352068:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a8241 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.352076:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a8241 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.352099:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68350c0a00) 00010000:00010000:0.0:1788541141.352113:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541141.352118:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a8241 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.352124:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a8241 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.352137:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a8248 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.352143:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a8248 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.352149:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a8248 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.352154:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75f200 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541141.352157:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a8248 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.352163:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a8248 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.352170:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a683531b700) 00010000:00010000:0.0:1788541141.352172:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541141.352175:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a8248 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.352180:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a8248 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.352211:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a823a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33143d expref: 50 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.352235:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a824f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33143d expref: 49 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.352243:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68350b2300) 00010000:00010000:0.0:1788541141.352245:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788541141.352248:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75fe00, rc 0) 00000100:00100000:0.0:1788541141.352321:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670691b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+49:12279:x1875420955884672:12345-192.168.202.56@tcp:101:stat.0 Request processed in 11971us (12387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541141.352329:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 172 00000100:00100000:1.0:1788541141.407962:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541141.408041:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955885312 00000100:00100000:3.0:1788541141.408050:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955885312 00000100:00100000:3.0:1788541141.408091:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 173 00000100:00100000:3.0:1788541141.408098:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68052e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+49:12285:x1875420955885312:12345-192.168.202.56@tcp:36:truncate.0 00010000:00010000:3.0:1788541141.408153:0:12149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541141.408175:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a824f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33143d expref: 49 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541141.408190:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68350b2300) 00010000:00010000:3.0:1788541141.408193:0:12149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788541141.408391:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a8256 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541141.408406:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a8256 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541141.408415:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a8256 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788541141.408458:0:12149:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:3.0:1788541141.408480:0:12149:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d1f44b87 reply state 0000000040dc4883 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a8256 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541141.408492:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a8256 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541141.408497:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68350b2300) 00010000:00010000:3.0:1788541141.408500:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788541141.408503:0:12149:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788541141.408587:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68052e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+51:12285:x1875420955885312:12345-192.168.202.56@tcp:36:truncate.0 Request processed in 487us (634us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1788541141.408595:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 173 00000020:00080000:3.0:1788541141.408600:0:12149:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788541141.450349:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788541141.450373:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68052e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981117696:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788541141.450443:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541141.450518:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981117696 00000100:00100000:1.0:1788541141.450525:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981117696 00000100:00100000:1.0:1788541141.450570:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788541141.450579:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707821180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981117696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788541141.450613:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788541141.450659:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707821180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981117696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541141.450667:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788541141.450710:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68052e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981117696:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788541141.450947:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6835588700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981117952:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788541141.450980:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541141.451054:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981117952 00000100:00100000:0.0:1788541141.451059:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981117952 00000100:00100000:0.0:1788541141.451106:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788541141.451113:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875420981117952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788541141.451127:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788541141.451166:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875420981117952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541141.451173:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788541141.451203:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6835588700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981117952:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788541141.451361:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670691aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981117824:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788541141.451401:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541141.451677:0:14072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981117824 00000100:00100000:0.0:1788541141.451682:0:14072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981117824 00000100:00100000:0.0:1788541141.451730:0:14072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788541141.451737:0:14072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68052e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981117824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788541141.451748:0:14072:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788541141.451785:0:14072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68052e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981117824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541141.451799:0:14072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:2.0:1788541141.451852:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788541141.451909:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670691aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981117824:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788541141.532767:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541141.532911:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955885440 00000100:00100000:0.0:1788541141.532921:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955885440 00000100:00100000:0.0:1788541141.532988:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 174 00000100:00100000:0.0:1788541141.532998:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+51:12299:x1875420955885440:12345-192.168.202.56@tcp:101:stat.0 00010000:00010000:0.0:1788541141.533027:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541141.533050:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a825d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331444 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.533131:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a8264 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.533146:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a8264 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.533158:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a8264 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.533171:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a826b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.533177:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a826b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.533183:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a826b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.533272:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a8272 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.533281:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a8272 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.533304:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a8272 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541141.533345:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1788541141.533349:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788541141.533369:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a8272 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.533382:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a8272 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.533390:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a8264 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.533396:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a8264 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.533403:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a8264 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.533408:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842173800 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541141.533412:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a8264 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.533419:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a8264 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.533430:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68350c0a00) 00010000:00010000:0.0:1788541141.533433:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541141.533438:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a8264 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.533455:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a8264 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.533472:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a826b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.533477:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a826b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.533483:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a826b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.533489:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842172000 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541141.533492:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a826b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.533498:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a826b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.533506:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a683531b700) 00010000:00010000:0.0:1788541141.533508:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541141.533511:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a826b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.533517:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a826b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.533545:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a825d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331444 expref: 53 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.533559:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a8272 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331444 expref: 52 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.533572:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68350b2300) 00010000:00010000:0.0:1788541141.533574:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788541141.533576:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75fe00, rc 0) 00000100:00100000:0.0:1788541141.533676:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+52:12299:x1875420955885440:12345-192.168.202.56@tcp:101:stat.0 Request processed in 678us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541141.533683:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 174 00010000:00010000:0.0:1788541141.580374:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541141.617706:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541141.617814:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955885696 00000100:00100000:0.0:1788541141.617827:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955885696 00000100:00100000:0.0:1788541141.617925:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 175 00000100:00100000:0.0:1788541141.617938:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+52:12309:x1875420955885696:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1788541141.617973:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541141.617997:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a8279 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a33144b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541141.618101:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788541141.618195:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a8279 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33144b expref: 54 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.618210:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68350c0500) 00010000:00010000:0.0:1788541141.618214:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788541141.618219:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a8279 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33144b expref: 54 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.618233:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75fc00, rc 0) 00000100:00100000:0.0:1788541141.618304:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+53:12309:x1875420955885696:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 369us (616us total) trans 4294967447 rc 301/301 00000100:00100000:0.0:1788541141.618325:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 175 00000100:00100000:3.0:1788541141.622212:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541141.624236:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955885952 00000100:00100000:0.0:1788541141.624248:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955885952 00000100:00100000:0.0:1788541141.624364:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 44 00000100:00100000:0.0:1788541141.624375:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6811402850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+53:12309:x1875420955885952:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:0.0:1788541141.624622:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6811402850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+54:12309:x1875420955885952:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 249us (2420us total) trans 4294967448 rc 0/0 00000100:00100000:0.0:1788541141.624630:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 44 00000100:00100000:2.0:1788541141.679206:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541141.679486:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955886208 00000100:00100000:0.0:1788541141.679498:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955886208 00000100:00100000:0.0:1788541141.679563:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 176 00000100:00100000:0.0:1788541141.679573:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670687ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+54:12315:x1875420955886208:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:0.0:1788541141.679597:0:9339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541141.679620:0:9339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a8287 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331452 expref: -99 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.679730:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a828e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.679746:0:9339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a8272 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331444 expref: 55 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.679755:0:9339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a828e lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.679788:0:9339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a8272 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331444 expref: 55 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.679830:0:9339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a8272 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331444 expref: 55 pid: 6519 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541141.679844:0:9339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683558bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9339:1875420981118080:192.168.202.56@tcp:104: 00000100:00100000:0.0:1788541141.679982:0:9339:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707570300 going to sleep for 11 seconds 00000100:00100000:3.0:1788541141.682820:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541141.682955:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955886336 00000100:00100000:1.0:1788541141.682965:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955886336 00010000:00010000:1.0:1788541141.683006:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a8272 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331444 expref: 56 pid: 6519 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541141.683047:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 85 00000100:00100000:1.0:1788541141.683057:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:384f52e3-0481-4979-9299-157aff7472d2+56:2396:x1875420955886336:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788541141.683070:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541141.683076:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a8272 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331444 expref: 56 pid: 6519 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541141.683193:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a8272 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331444 expref: 56 pid: 6519 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541141.683215:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68350b2300) 00010000:00010000:1.0:1788541141.683220:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a828e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541141.683230:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a828e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541141.683238:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a828e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541141.683267:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788541141.683422:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:384f52e3-0481-4979-9299-157aff7472d2+56:2396:x1875420955886336:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 365us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541141.683443:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 85 00010000:00010000:0.0:1788541141.683542:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a8272 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331444 expref: 55 pid: 6519 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541141.683559:0:9339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683558bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9339:1875420981118080:192.168.202.56@tcp:104: 00010000:00010000:0.0:1788541141.683578:0:9339:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a828e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.683587:0:9339:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a828e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.683593:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a828e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541141.683612:0:9339:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1788541141.683736:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a8287 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331452 expref: 56 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.683751:0:9339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a828e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331452 expref: 55 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.683759:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68350b2300) 00010000:00010000:0.0:1788541141.683768:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788541141.683771:0:9339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75f200, rc 0) 00000100:00100000:0.0:1788541141.683811:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670687ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+55:12315:x1875420955886208:12345-192.168.202.56@tcp:101:bash.0 Request processed in 4227us (4602us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1788541141.683818:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 176 00000100:00100000:1.0:1788541141.687634:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541141.687724:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955886592 00000100:00100000:0.0:1788541141.687735:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955886592 00000100:00100000:0.0:1788541141.687914:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 177 00000100:00100000:0.0:1788541141.687926:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670691ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+55:12315:x1875420955886592:12345-192.168.202.56@tcp:36:bash.0 00010000:00010000:0.0:1788541141.688246:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a829c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.688276:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a829c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.688288:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a829c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788541141.688424:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:0.0:1788541141.688449:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000369e9b55 reply state 000000007a2ad214 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a829c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.688462:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a829c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.688469:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68350b2300) 00010000:00010000:0.0:1788541141.688473:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788541141.688477:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788541141.688633:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670691ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+58:12315:x1875420955886592:12345-192.168.202.56@tcp:36:bash.0 Request processed in 708us (1006us total) trans 4294967451 rc 0/0 00000100:00100000:0.0:1788541141.688658:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 177 00000020:00080000:0.0:1788541141.688664:0:6517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788541141.694865:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541141.694921:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955886720 00000100:00100000:0.0:1788541141.694931:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955886720 00000100:00100000:0.0:1788541141.694993:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 178 00000100:00100000:0.0:1788541141.695003:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+58:12315:x1875420955886720:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:0.0:1788541141.695028:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541141.695049:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a82a3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331459 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.695139:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a82aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.695151:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a828e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331452 expref: 59 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.695157:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a82aa lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.695183:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a828e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331452 expref: 59 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.695192:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a828e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331452 expref: 59 pid: 9339 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541141.695202:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683558bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6518:1875420981118208:192.168.202.56@tcp:104: 00000100:00100000:0.0:1788541141.695282:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707570300 going to sleep for 11 seconds 00000100:00100000:2.0:1788541141.697631:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541141.697713:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955886848 00000100:00100000:3.0:1788541141.697723:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955886848 00010000:00010000:3.0:1788541141.697766:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a828e lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331452 expref: 60 pid: 9339 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541141.697814:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 86 00000100:00100000:3.0:1788541141.697823:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707add500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:384f52e3-0481-4979-9299-157aff7472d2+60:2397:x1875420955886848:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541141.697855:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541141.697862:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a828e lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331452 expref: 60 pid: 9339 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541141.697925:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a828e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331452 expref: 60 pid: 9339 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541141.697947:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68350b2300) 00010000:00010000:3.0:1788541141.697952:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a82aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541141.697963:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a82aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541141.697971:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a82aa lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541141.697994:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541141.698047:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707add500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:384f52e3-0481-4979-9299-157aff7472d2+60:2397:x1875420955886848:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 224us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541141.698055:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 86 00010000:00010000:0.0:1788541141.698763:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a828e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331452 expref: 59 pid: 9339 timeout: 522 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541141.698783:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683558bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6518:1875420981118208:192.168.202.56@tcp:104: 00010000:00010000:0.0:1788541141.698923:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a82aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.698934:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a82aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.698940:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a82aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541141.698996:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788541141.699000:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788541141.699022:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a82aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.699056:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a82a3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331459 expref: 59 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.699071:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a82aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331459 expref: 58 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.699186:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68350b2300) 00010000:00010000:0.0:1788541141.699189:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788541141.699192:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6842172000, rc 0) 00000100:00100000:0.0:1788541141.699297:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+58:12315:x1875420955886720:12345-192.168.202.56@tcp:101:bash.0 Request processed in 4295us (4504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541141.699317:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 178 00000100:00100000:2.0:1788541141.703667:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541141.703749:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955887104 00000100:00100000:3.0:1788541141.703760:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955887104 00000100:00100000:3.0:1788541141.703819:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 45 00000100:00100000:3.0:1788541141.703830:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707addf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+58:12315:x1875420955887104:12345-192.168.202.56@tcp:35:bash.0 00000100:00100000:3.0:1788541141.704158:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707addf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+59:12315:x1875420955887104:12345-192.168.202.56@tcp:35:bash.0 Request processed in 329us (500us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1788541141.704167:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 45 00000100:00100000:3.0:1788541141.799160:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541141.799288:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955887360 00000100:00100000:0.0:1788541141.799308:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955887360 00000100:00100000:0.0:1788541141.799371:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 179 00000100:00100000:0.0:1788541141.799381:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+59:12325:x1875420955887360:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1788541141.799407:0:9339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541141.799430:0:9339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a82b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331460 expref: -99 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541141.799532:0:9339:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788541141.799625:0:9339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a82b1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331460 expref: 61 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.799635:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68350c0500) 00010000:00010000:0.0:1788541141.799637:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788541141.799641:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a82b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331460 expref: 61 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.799652:0:9339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6842173200, rc 0) 00000100:00100000:0.0:1788541141.799705:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+60:12325:x1875420955887360:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 327us (554us total) trans 4294967453 rc 301/301 00000100:00100000:0.0:1788541141.799710:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 179 00000100:00100000:2.0:1788541141.802604:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541141.802667:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955887488 00000100:00100000:0.0:1788541141.802676:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955887488 00000100:00100000:0.0:1788541141.802731:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 180 00000100:00100000:0.0:1788541141.802741:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707adf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+60:12325:x1875420955887488:12345-192.168.202.56@tcp:34:lfs.0 00010000:00010000:0.0:1788541141.802819:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a82bf lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.802855:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a82bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.802867:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a82bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.802903:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a82c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.802920:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a82c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.802928:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a82c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.803003:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a82cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.803010:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a82cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.803014:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a82cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788541141.803054:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a82cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.803064:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a82bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.803068:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a82bf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.803081:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a82bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.803086:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842173800 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541141.803089:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a82bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.803094:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a82bf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.803102:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68350c0a00) 00010000:00010000:0.0:1788541141.803105:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541141.803108:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a82bf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.803112:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a82bf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.803121:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a82c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.803125:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a82c6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.803128:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a82c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.803131:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75f200 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541141.803133:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a82c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.803142:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a82c6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.803147:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a683531b700) 00010000:00010000:0.0:1788541141.803148:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541141.803150:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a82c6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.803153:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a82c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.803159:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a82cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.803162:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a82cd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.803165:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a82cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.803167:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75fc00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541141.803169:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a82cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.803172:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a82cd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.803176:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68350b2300) 00010000:00010000:0.0:1788541141.803178:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541141.803179:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a82cd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.803188:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a82cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541141.803258:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707adf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+60:12325:x1875420955887488:12345-192.168.202.56@tcp:34:lfs.0 Request processed in 511us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541141.803266:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 180 00000100:00100000:2.0:1788541141.805102:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541141.805249:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955887744 00000100:00100000:3.0:1788541141.805273:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955887744 00000100:00100000:3.0:1788541141.805335:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 46 00000100:00100000:3.0:1788541141.805346:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707adc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+60:12325:x1875420955887744:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:3.0:1788541141.805532:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707adc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+61:12325:x1875420955887744:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 188us (440us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1788541141.805537:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 46 00000100:00100000:3.0:1788541141.828852:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541141.829530:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955888000 00000100:00100000:0.0:1788541141.829542:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955888000 00000100:00100000:0.0:1788541141.829630:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 181 00000100:00100000:0.0:1788541141.829643:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+61:12328:x1875420955888000:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1788541141.829668:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541141.829690:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a82d4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331467 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.829761:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a82db lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.829779:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a82db lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.829792:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a82db lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.829816:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a82e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.829824:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a82e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.829851:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a82e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.830013:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a82e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.830023:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a82e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.830031:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a82e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541141.830041:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788541141.830127:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a82db lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.830135:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a82db lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.830141:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a82db lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.830146:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75f200 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541141.830150:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a82db lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.830158:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a82db lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.830169:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68350c0a00) 00010000:00010000:0.0:1788541141.830172:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541141.830183:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a82db lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.830190:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a82db lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.830205:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a82e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.830211:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a82e2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.830217:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a82e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.830222:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75fe00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541141.830225:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a82e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.830232:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a82e2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.830239:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a683531b700) 00010000:00010000:0.0:1788541141.830241:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541141.830244:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a82e2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.830260:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a82e2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.830452:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a82d4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331467 expref: 64 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.830484:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a82e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331467 expref: 63 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.830492:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68350b2300) 00010000:00010000:0.0:1788541141.830494:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788541141.830497:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6842173800, rc 0) 00000100:00100000:0.0:1788541141.830574:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+63:12328:x1875420955888000:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 934us (1731us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1788541141.830582:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 181 00000100:00100000:2.0:1788541141.836985:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541141.837031:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541141.837184:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955888128 00000100:00100000:3.0:1788541141.837195:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955888128 00000100:00100000:3.0:1788541141.837273:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 182 00000100:00100000:3.0:1788541141.837283:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+63:12328:x1875420955888128:12345-192.168.202.56@tcp:54:lfs.0 00010000:00010000:3.0:1788541141.837373:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a82f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541141.837393:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a82f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541141.837406:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a82f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541141.837442:0:12149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a82f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541141.837449:0:12149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a82f7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541141.837457:0:12149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a82f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541141.837479:0:12149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075ace00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541141.837484:0:12149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a82f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541141.837492:0:12149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a82f7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541141.837505:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68350b2300) 00010000:00010000:3.0:1788541141.837508:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788541141.837513:0:12149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a82f7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541141.837519:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a82f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541141.837615:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+63:12328:x1875420955888128:12345-192.168.202.56@tcp:54:lfs.0 Request processed in 333us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541141.837623:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 182 00000100:00100000:0.0:1788541141.838697:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955888256 00000100:00100000:0.0:1788541141.838707:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955888256 00000100:00100000:0.0:1788541141.838768:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 13 00000100:00100000:0.0:1788541141.838777:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:384f52e3-0481-4979-9299-157aff7472d2+63:2397:x1875420955888256:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788541141.838791:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541141.838810:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a82e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331467 expref: 63 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541141.838825:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68350b2300) 00010000:00010000:0.0:1788541141.838830:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541141.838900:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:384f52e3-0481-4979-9299-157aff7472d2+62:2397:x1875420955888256:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 124us (1868us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541141.838916:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 13 00000100:00100000:2.0:1788541141.842638:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541141.842721:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955888512 00000100:00100000:0.0:1788541141.842732:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955888512 00000100:00100000:0.0:1788541141.842790:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 47 00000100:00100000:0.0:1788541141.842811:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+62:12328:x1875420955888512:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:0.0:1788541141.843330:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+63:12328:x1875420955888512:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 518us (700us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1788541141.843338:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 47 00000100:00100000:3.0:1788541142.013151:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541142.013312:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955888768 00000100:00100000:2.0:1788541142.013323:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955888768 00000100:00100000:2.0:1788541142.013412:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 183 00000100:00100000:2.0:1788541142.013423:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+63:12346:x1875420955888768:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:2.0:1788541142.013447:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541142.013468:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a82fe lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a33146e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541142.013582:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a8305 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541142.013599:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a8305 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541142.013611:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a8305 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541142.013636:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788541142.014000:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a82fe lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33146e expref: 66 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541142.014022:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a8305 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33146e expref: 65 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541142.014032:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68350b2300) 00010000:00010000:2.0:1788541142.014034:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788541142.014038:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a683551b400, rc 0) 00000100:00100000:2.0:1788541142.014109:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+65:12346:x1875420955888768:12345-192.168.202.56@tcp:101:cat.0 Request processed in 687us (968us total) trans 4294967457 rc 0/0 00000100:00100000:2.0:1788541142.014117:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 183 00000100:00080000:0.0:1788541142.014267:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788541142.042218:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541142.042456:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955888896 00000100:00100000:3.0:1788541142.042466:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955888896 00000100:00100000:3.0:1788541142.042590:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 184 00000100:00100000:3.0:1788541142.042601:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6811424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+65:12347:x1875420955888896:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1788541142.042627:0:9339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541142.042649:0:9339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a8313 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331475 expref: -99 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.042722:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac400/0x2aac941e5f4a831a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.042750:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac400/0x2aac941e5f4a831a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.042762:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac400/0x2aac941e5f4a831a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541142.042803:0:9339:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788541142.042807:0:9339:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788541142.042825:0:9339:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac400/0x2aac941e5f4a831a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.042850:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a8313 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331475 expref: 67 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.042922:0:9339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac400/0x2aac941e5f4a831a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331475 expref: 66 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.042932:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68350c0a00) 00010000:00010000:3.0:1788541142.042936:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788541142.042939:0:9339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075ac400, rc 0) 00000100:00100000:3.0:1788541142.043000:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6811424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+66:12347:x1875420955888896:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 401us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541142.043007:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 184 00000100:00100000:3.0:1788541142.051562:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541142.051668:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955889280 00000100:00100000:2.0:1788541142.051677:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955889280 00000100:00100000:2.0:1788541142.051803:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 48 00000100:00100000:2.0:1788541142.051814:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+66:12347:x1875420955889280:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:2.0:1788541142.052559:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+67:12347:x1875420955889280:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 743us (1002us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1788541142.052570:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 48 00000100:00100000:2.0:1788541142.055731:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541142.055902:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955889408 00000100:00100000:3.0:1788541142.055913:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955889408 00000100:00100000:3.0:1788541142.055979:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 14 00000100:00100000:3.0:1788541142.055990:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:384f52e3-0481-4979-9299-157aff7472d2+67:12347:x1875420955889408:12345-192.168.202.56@tcp:103:lfs.0 00010000:00010000:3.0:1788541142.056019:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788541142.056043:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a82aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331459 expref: 67 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.056067:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a8305 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33146e expref: 66 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.056093:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a81a7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331413 expref: 65 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.056104:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68350b2300) 00010000:00010000:3.0:1788541142.056109:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541142.056168:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:384f52e3-0481-4979-9299-157aff7472d2+64:12347:x1875420955889408:12345-192.168.202.56@tcp:103:lfs.0 Request processed in 180us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541142.056175:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 14 00000100:00100000:3.0:1788541142.059443:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541142.059615:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955889536 00000100:00100000:1.0:1788541142.059625:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955889536 00000100:00100000:1.0:1788541142.059688:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 185 00000100:00100000:1.0:1788541142.059699:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683f0fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+64:12347:x1875420955889536:12345-192.168.202.56@tcp:58:lfs.0 00010000:00010000:1.0:1788541142.059845:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354daa00/0x2aac941e5f4a8321 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.059863:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354daa00/0x2aac941e5f4a8321 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.060058:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354daa00/0x2aac941e5f4a8321 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788541142.060172:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1788541142.060268:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683f0fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+64:12347:x1875420955889536:12345-192.168.202.56@tcp:58:lfs.0 Request processed in 570us (1196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541142.060277:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 185 00000100:00100000:2.0:1788541142.092369:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541142.092562:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955889664 00000100:00100000:1.0:1788541142.092574:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955889664 00000100:00100000:1.0:1788541142.092643:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 186 00000100:00100000:1.0:1788541142.092656:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+64:12349:x1875420955889664:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1788541142.092680:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541142.092705:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da800/0x2aac941e5f4a8328 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a33147c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.092776:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a832f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.092821:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a832f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.092837:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a832f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.092851:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a8336 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.092859:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a8336 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.092866:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a8336 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.092976:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dac00/0x2aac941e5f4a833d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.092987:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dac00/0x2aac941e5f4a833d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.092995:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dac00/0x2aac941e5f4a833d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788541142.093034:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788541142.093039:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788541142.093057:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dac00/0x2aac941e5f4a833d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.093083:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dac00/0x2aac941e5f4a833d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.093104:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a832f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.093111:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a832f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.093119:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a832f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.093126:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68354db800 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541142.093130:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a832f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.093139:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a832f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.093151:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68350c0a00) 00010000:00010000:1.0:1788541142.093154:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541142.093159:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a832f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.093165:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a832f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.093180:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a8336 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.093187:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a8336 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.093193:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a8336 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.093205:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68354dba00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541142.093209:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a8336 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.093216:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a8336 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.093225:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a683531b700) 00010000:00010000:1.0:1788541142.093227:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541142.093230:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a8336 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.093237:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a8336 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.093276:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da800/0x2aac941e5f4a8328 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33147c expref: 66 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.093293:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dac00/0x2aac941e5f4a833d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33147c expref: 65 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.093301:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68350b2300) 00010000:00010000:1.0:1788541142.093304:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788541142.093307:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68354dac00, rc 0) 00000100:00100000:1.0:1788541142.093694:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+65:12349:x1875420955889664:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 1038us (1332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541142.093702:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 186 00000100:00100000:3.0:1788541142.477200:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788541142.477229:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670691aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981118336:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788541142.477314:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541142.477533:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981118336 00000100:00100000:1.0:1788541142.477553:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981118336 00000100:00100000:1.0:1788541142.477610:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788541142.477622:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835651f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981118336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788541142.477660:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788541142.477962:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835651f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981118336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 341us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541142.477970:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788541142.486530:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670691aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981118336:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788541142.608266:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788541142.730095:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788541142.730105:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788541142.730132:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788541142.730141:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788541142.730289:0:13798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683558bb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1875420981118464:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788541142.730395:0:13798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6835493840 going to sleep for 11 seconds 00000100:00100000:0.0:1788541142.733153:0:13798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683558bb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1875420981118464:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788541142.734354:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541142.734490:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955889792 00000100:00100000:0.0:1788541142.734498:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955889792 00000100:00100000:0.0:1788541142.734554:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 187 00000100:00100000:0.0:1788541142.734564:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835650380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+65:12361:x1875420955889792:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788541142.734595:0:9339:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788541142.734744:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835650380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+65:12361:x1875420955889792:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 180us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541142.734752:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 187 00000100:00100000:3.0:1788541142.744168:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541142.744590:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955889920 00000100:00100000:2.0:1788541142.744603:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955889920 00000100:00100000:2.0:1788541142.744672:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 188 00000100:00100000:2.0:1788541142.744695:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+65:12361:x1875420955889920:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788541142.744795:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a8344 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541142.744813:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a8344 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541142.744827:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a8344 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541142.744863:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a834b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541142.744900:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a834b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541142.744907:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a834b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541142.744937:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a8352 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541142.744945:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a8352 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541142.744951:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a8352 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541142.744996:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788541142.745001:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788541142.745014:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a8352 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541142.745037:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a8344 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541142.745044:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a8344 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541142.745051:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a8344 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541142.745056:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551aa00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:2.0:1788541142.745060:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a8344 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541142.745262:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a8344 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541142.745276:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a68350c0d00) 00010000:00010000:2.0:1788541142.745279:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541142.745284:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a8344 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541142.745302:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a8344 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541142.745313:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a834b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541142.745319:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a834b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541142.745325:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a834b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541142.745451:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551b400 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:2.0:1788541142.745455:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a834b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541142.745462:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a834b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541142.745471:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff9a68350c0b00) 00010000:00010000:2.0:1788541142.745474:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541142.745477:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a834b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541142.745483:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a834b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541142.745498:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a8352 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541142.745506:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a8352 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541142.745512:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a8352 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541142.745518:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551b200 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:2.0:1788541142.745520:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a8352 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541142.745527:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a8352 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541142.745546:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68350b2300) 00010000:00010000:2.0:1788541142.745548:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541142.745552:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a8352 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541142.745557:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a8352 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541142.745647:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+65:12361:x1875420955889920:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 Request processed in 953us (1487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541142.745656:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 188 00000100:00100000:3.0:1788541142.754611:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541142.757114:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955890176 00000100:00100000:1.0:1788541142.757129:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955890176 00000100:00100000:1.0:1788541142.757200:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 189 00000100:00100000:1.0:1788541142.757211:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+65:12361:x1875420955890176:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788541142.757235:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541142.757486:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a8359 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331483 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.757597:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a8360 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.757616:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a8360 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.757630:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a8360 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788541142.757643:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788541142.757798:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a8360 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.757807:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a8360 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.757824:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a8360 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.757830:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68354dbe00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541142.757835:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a8360 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.757843:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a8360 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.757855:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68350b2300) 00010000:00010000:1.0:1788541142.757859:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788541142.757863:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a8360 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.757900:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a8360 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.757944:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a8359 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331483 expref: 67 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.757956:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a68350c0d00) 00010000:00010000:1.0:1788541142.757959:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788541142.757963:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a8359 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331483 expref: 67 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.757972:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68354db800, rc 0) 00000100:00100000:1.0:1788541142.758045:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+66:12361:x1875420955890176:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 836us (3442us total) trans 4294967459 rc 301/301 00000100:00100000:1.0:1788541142.758061:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 189 00000100:00100000:3.0:1788541142.761329:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541142.761443:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955890304 00000100:00100000:1.0:1788541142.761454:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955890304 00000100:00100000:1.0:1788541142.761519:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 190 00000100:00100000:1.0:1788541142.761529:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+66:12361:x1875420955890304:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788541142.761567:0:6517:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788541142.761685:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+66:12361:x1875420955890304:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 157us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541142.761692:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 190 00000100:00100000:0.0:1788541142.765364:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541142.765451:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955890560 00000100:00100000:2.0:1788541142.765461:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955890560 00000100:00100000:2.0:1788541142.765523:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 191 00000100:00100000:2.0:1788541142.765533:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683558bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+66:12361:x1875420955890560:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788541142.765554:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541142.765557:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788541142.765587:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac400/0x2aac941e5f4a831a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331475 expref: 66 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541142.765604:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68350c0a00) 00010000:00010000:2.0:1788541142.765610:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788541142.765625:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a836e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a33148a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788541142.766058:0:6519:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:2.0:1788541142.766167:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a8375 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541142.766182:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a8375 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541142.766190:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a8375 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541142.766229:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a836e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33148a expref: 68 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541142.766240:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a8375 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33148a expref: 67 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541142.766258:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a68350c0b00) 00010000:00010000:2.0:1788541142.766261:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788541142.766264:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a683551b400, rc 0) 00000100:00100000:2.0:1788541142.766338:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683558bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+67:12361:x1875420955890560:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 806us (983us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1788541142.766345:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 191 00000100:00100000:3.0:1788541142.770295:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541142.770389:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955890816 00000100:00100000:0.0:1788541142.770400:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955890816 00000100:00100000:0.0:1788541142.770469:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 192 00000100:00100000:0.0:1788541142.770480:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+67:12361:x1875420955890816:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788541142.770545:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541142.770571:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a8375 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33148a expref: 67 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541142.770586:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a68350c0b00) 00010000:00010000:0.0:1788541142.770596:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788541142.770618:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a8383 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541142.770632:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a8383 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541142.770639:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a8383 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541142.770680:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a838a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x9550faa4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541142.770685:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a838a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x9550faa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541142.770689:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a838a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x9550faa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541142.770797:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a8383 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541142.770802:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a8383 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541142.770806:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a8383 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541142.770815:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842173200 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541142.770818:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a8383 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541142.770823:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a8383 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541142.770829:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68350c0a00) 00010000:00010000:0.0:1788541142.770831:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541142.770833:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a8383 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541142.770837:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a8383 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541142.770844:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a838a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x9550faa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541142.770847:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a838a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x9550faa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541142.770851:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a838a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x9550faa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541142.770854:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842173800 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541142.770856:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a838a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x9550faa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541142.770859:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a838a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x9550faa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541142.770996:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x9550faa4 (ffff9a68350b2000) 00010000:00010000:0.0:1788541142.770999:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541142.771001:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a838a lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x9550faa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541142.771006:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a838a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x9550faa4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541142.771109:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+66:12361:x1875420955890816:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 630us (820us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788541142.771116:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 192 00000100:00100000:2.0:1788541142.782626:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541142.782688:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955890944 00000100:00100000:1.0:1788541142.782696:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955890944 00000100:00100000:1.0:1788541142.782764:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 193 00000100:00100000:1.0:1788541142.782773:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+66:12361:x1875420955890944:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788541142.782795:0:12149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541142.782821:0:12149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a8391 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331491 expref: -99 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.782859:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a8398 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.782890:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a8398 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.782900:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a8398 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.782989:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a8391 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331491 expref: 68 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.783008:0:12149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a8398 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331491 expref: 67 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.783014:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a6809c1c700) 00010000:00010000:1.0:1788541142.783016:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788541142.783019:0:12149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68354dbe00, rc 0) 00000100:00100000:1.0:1788541142.783063:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+67:12361:x1875420955890944:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 292us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541142.783069:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 193 00000100:00100000:2.0:1788541142.787124:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541142.787477:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955891200 00000100:00100000:3.0:1788541142.787486:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955891200 00000100:00100000:3.0:1788541142.787535:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 194 00000100:00100000:3.0:1788541142.787542:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+67:12361:x1875420955891200:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788541142.787617:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a839f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.787632:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a839f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.787641:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a839f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788541142.787797:0:9339:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:3.0:1788541142.787808:0:9339:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 423705936951ns, next at 424705934316ns, rc = 0 00000004:00010000:3.0:1788541142.787857:0:9339:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003be306d8 reply state 000000003459cec3 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a839f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.787867:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a839f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.787893:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a6809c1c700) 00010000:00010000:3.0:1788541142.787896:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788541142.787898:0:9339:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788541142.787978:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+69:12361:x1875420955891200:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 436us (866us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1788541142.787983:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 194 00000100:00100000:1.0:1788541142.790747:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541142.791843:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955891328 00000100:00100000:0.0:1788541142.791858:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955891328 00000100:00100000:0.0:1788541142.791941:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 195 00000100:00100000:0.0:1788541142.791949:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670691aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+69:12361:x1875420955891328:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788541142.791969:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541142.791986:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a83a6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331498 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541142.792037:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a83a6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331498 expref: 70 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541142.792048:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a83a6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331498 expref: 70 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541142.792061:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a6809c1c700) 00010000:00010000:0.0:1788541142.792063:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788541142.792075:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6842173800, rc 0) 00000100:00100000:0.0:1788541142.792798:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670691aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+70:12361:x1875420955891328:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 845us (2066us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541142.792807:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 195 00000100:00100000:0.0:1788541142.802448:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541142.802527:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955891456 00000100:00100000:1.0:1788541142.802537:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955891456 00000100:00100000:1.0:1788541142.802711:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 58 00000100:00100000:1.0:1788541142.802722:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835588700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:384f52e3-0481-4979-9299-157aff7472d2+6:2396:x1875420955891456:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788541142.803010:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835588700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:384f52e3-0481-4979-9299-157aff7472d2+7:2396:x1875420955891456:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 Request processed in 289us (571us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788541142.803020:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 58 00000100:00080000:0.0:1788541142.803314:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788541142.809393:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541142.814501:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955891712 00000100:00100000:3.0:1788541142.814518:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955891712 00000100:00100000:3.0:1788541142.814597:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 49 00000100:00100000:3.0:1788541142.814610:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+70:12361:x1875420955891712:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788541142.814890:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+71:12361:x1875420955891712:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 264us (5482us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1788541142.814900:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 49 00000040:00080000:1.0:1788541142.825853:0:14656:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788541142.825866:0:14656:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788541142.825930:0:14656:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788541142.825937:0:14656:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788541142.831513:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541142.839016:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955891968 00000100:00100000:3.0:1788541142.839032:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955891968 00000100:00100000:1.0:1788541142.840496:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 196 00000100:00100000:1.0:1788541142.840508:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67079b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+71:12361:x1875420955891968:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788541142.840626:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67079b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+71:12361:x1875420955891968:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 119us (9121us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541142.840646:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 196 00000100:00100000:0.0:1788541142.846142:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541142.847384:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955892096 00000100:00100000:3.0:1788541142.847398:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955892096 00000100:00100000:3.0:1788541142.847464:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 197 00000100:00100000:3.0:1788541142.847476:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683558b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+71:12361:x1875420955892096:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788541142.847497:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541142.847523:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac400/0x2aac941e5f4a83ad lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a33149f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.847592:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a83b4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.847608:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a83b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.847621:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a83b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541142.847671:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788541142.847693:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a83b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.847720:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac400/0x2aac941e5f4a83ad lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33149f expref: 73 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.847778:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a83b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33149f expref: 72 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.847789:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a6809c1c700) 00010000:00010000:3.0:1788541142.847792:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788541142.847796:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075ac600, rc 0) 00000100:00100000:3.0:1788541142.847902:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683558b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+72:12361:x1875420955892096:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 428us (1769us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541142.847910:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 197 00000100:00100000:1.0:1788541142.857376:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541142.857658:0:8973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955892224 00000100:00100000:0.0:1788541142.857669:0:8973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955892224 00000100:00100000:0.0:1788541142.857764:0:8973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 59 00000100:00100000:0.0:1788541142.857775:0:8973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706833b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:384f52e3-0481-4979-9299-157aff7472d2+7:2395:x1875420955892224:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788541142.857794:0:8973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541142.857817:0:8973:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017c545e0/0x2aac941e5f4a83bb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3314a6 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788541142.857846:0:8973:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9af8d6, blocks: 0x0 00010000:00010000:0.0:1788541142.857895:0:8973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=423s v=(0 0) 00010000:00010000:0.0:1788541142.857903:0:8973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541142.857913:0:8973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017c545e0/0x2aac941e5f4a83bb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3314a6 expref: 8 pid: 8973 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541142.857932:0:8973:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000017c545e0/0x2aac941e5f4a83bb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3314a6 expref: 8 pid: 8973 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541142.857945:0:8973:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6842173200, rc 0) 00000100:00100000:0.0:1788541142.858006:0:8973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706833b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:384f52e3-0481-4979-9299-157aff7472d2+8:2395:x1875420955892224:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 233us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541142.858024:0:8973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 59 00000100:00100000:2.0:1788541142.874560:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541142.877009:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955892480 00000100:00100000:3.0:1788541142.877023:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955892480 00000100:00100000:3.0:1788541142.877097:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 198 00000100:00100000:3.0:1788541142.877109:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+72:12361:x1875420955892480:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788541142.877233:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+72:12361:x1875420955892480:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 114us (2668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541142.877249:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 198 00000100:00100000:1.0:1788541142.887735:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541142.895493:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955892608 00000100:00100000:3.0:1788541142.895510:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955892608 00000100:00100000:3.0:1788541142.895579:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 60 00000100:00100000:3.0:1788541142.895590:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706831f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:384f52e3-0481-4979-9299-157aff7472d2+8:12361:x1875420955892608:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788541142.895609:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541142.895629:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf469810/0x2aac941e5f4a83c2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3314ad expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.895663:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000017c545e0/0x2aac941e5f4a83bb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3314a6 expref: 9 pid: 8973 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.895687:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541142.895691:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541142.895697:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf469810/0x2aac941e5f4a83c2 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3314ad expref: 9 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.895737:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000017c545e0/0x2aac941e5f4a83bb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3314a6 expref: 9 pid: 8973 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.895752:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000017c545e0/0x2aac941e5f4a83bb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3314a6 expref: 9 pid: 8973 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541142.895767:0:8431:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8431:1875420981118592:192.168.202.56@tcp:104: 00000100:00100000:3.0:1788541142.895859:0:8431:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683572bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788541142.906235:0:8431:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8431:1875420981118592:192.168.202.56@tcp:104: 00010000:00010000:1.0:1788541142.906286:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bf469810/0x2aac941e5f4a83c2 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xa16473202a3314ad expref: 9 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.906309:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075ac400, rc 0) 00000100:00100000:1.0:1788541142.906416:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706831f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:384f52e3-0481-4979-9299-157aff7472d2+9:12361:x1875420955892608:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 10826us (18687us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541142.906426:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 60 00000100:00100000:0.0:1788541142.921447:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541142.921532:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955892736 00000100:00100000:3.0:1788541142.921543:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955892736 00010000:00010000:3.0:1788541142.921587:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000017c545e0/0x2aac941e5f4a83bb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3314a6 expref: 9 pid: 8973 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541142.921630:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 87 00000100:00100000:3.0:1788541142.921640:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835588000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:384f52e3-0481-4979-9299-157aff7472d2+9:2396:x1875420955892736:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541142.921655:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541142.921677:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000017c545e0/0x2aac941e5f4a83bb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3314a6 expref: 9 pid: 8973 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.921708:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000017c545e0/0x2aac941e5f4a83bb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3314a6 expref: 9 pid: 8973 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.921731:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017c545e0/0x2aac941e5f4a83bb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3314a6 expref: 9 pid: 8973 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.921746:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541142.921750:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541142.921758:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf469810/0x2aac941e5f4a83c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xa16473202a3314ad expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.921767:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf469810/0x2aac941e5f4a83c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xa16473202a3314ad expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.921941:0:6503:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bf469810/0x2aac941e5f4a83c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xa16473202a3314ad expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541142.921957:0:6503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6503:1875420981118720:192.168.202.56@tcp:105: 00000100:00100000:3.0:1788541142.922036:0:6503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683572b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788541142.924436:0:6503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6503:1875420981118720:192.168.202.56@tcp:105: 00010000:00010000:3.0:1788541142.924461:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541142.924513:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835588000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:384f52e3-0481-4979-9299-157aff7472d2+8:2396:x1875420955892736:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 2873us (3075us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541142.924525:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 87 00000100:00100000:1.0:1788541142.930854:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541142.931520:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955892864 00000100:00100000:3.0:1788541142.931550:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955892864 00002000:00100000:3.0:1788541142.931595:0:8436:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9a6708311180 x1875420955892864/t0(0) o4->384f52e3-0481-4979-9299-157aff7472d2@192.168.202.56@tcp:513/0 lens 504/0 e 0 to 0 dl 1788541153 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788541142.931603:0:8436:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6708311180 with x1875420955892864 ext(0->8) 00002000:00010000:3.0:1788541142.931608:0:8436:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a6708311180 00000100:00100000:3.0:1788541142.931633:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 4 00000100:00100000:3.0:1788541142.931640:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708311180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:384f52e3-0481-4979-9299-157aff7472d2+8:2397:x1875420955892864:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788541142.932440:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708311180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:384f52e3-0481-4979-9299-157aff7472d2+10:2397:x1875420955892864:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 Request processed in 794us (1589us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788541142.932451:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 4 00002000:00100000:3.0:1788541142.932459:0:8436:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9a6708311180 x1875420955892864/t4294967315(0) o4->384f52e3-0481-4979-9299-157aff7472d2@192.168.202.56@tcp:513/0 lens 504/448 e 0 to 0 dl 1788541153 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788541142.932467:0:8436:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6708311180 with x1875420955892864 ext(0->8) 00002000:00010000:3.0:1788541142.932470:0:8436:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a6708311180 00000100:00100000:2.0:1788541142.938961:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541142.939145:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955892992 00000100:00100000:3.0:1788541142.939154:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955892992 00000100:00100000:3.0:1788541142.939213:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 199 00000100:00100000:3.0:1788541142.939222:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+72:12361:x1875420955892992:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788541142.940761:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:0.0:1788541142.940774:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:0.0:1788541142.940830:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:0.0:1788541142.940843:0:6496:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a683f241e40 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1788541142.940848:0:6496:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a6810149f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a683f241180 00000020:00080000:0.0:1788541142.940851:0:6496:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a6810149600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a6707b8e000 00010000:00010000:3.0:1788541142.940985:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a80ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.940998:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a80ea lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.941006:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a80ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.941023:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551a000 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541142.941028:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a80ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.941037:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a80ea lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.941055:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9a68350c0700) 00010000:00010000:3.0:1788541142.941058:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541142.941074:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a80ea lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.941082:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a80ea lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.941106:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a80f1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.941112:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a80f1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.941116:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a80f1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.941119:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551b600 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541142.941121:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a80f1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.941124:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a80f1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.941139:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68350c0a00) 00010000:00010000:3.0:1788541142.941141:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541142.941145:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a80f1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.941151:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a80f1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.941166:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a8130 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.941172:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a8130 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.941178:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a8130 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.941184:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075ad800 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541142.941187:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a8130 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.941192:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a8130 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.941200:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a683531b700) 00010000:00010000:3.0:1788541142.941201:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541142.941203:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a8130 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.941207:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a8130 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.941229:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a8233 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.941235:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a8233 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.941250:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a8233 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.941255:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75ec00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541142.941259:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a8233 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.941266:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a8233 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.941275:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68350b2300) 00010000:00010000:3.0:1788541142.941278:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541142.941281:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a8233 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.941287:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a8233 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.941297:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a8256 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.941304:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a8256 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.941310:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a8256 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.941321:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075aca00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541142.941324:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a8256 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.941331:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a8256 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.941340:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68350b2300) 00010000:00010000:3.0:1788541142.941342:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541142.941345:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a8256 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.941350:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a8256 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.941362:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a829c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.941369:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a829c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.941375:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a829c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.941381:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75ee00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541142.941384:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a829c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.941388:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a829c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.941401:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68350b2300) 00010000:00010000:3.0:1788541142.941402:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541142.941404:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a829c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.941408:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a829c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.941415:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a839f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.941419:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a839f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.941422:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a839f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.941426:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075ace00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541142.941427:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a839f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.941431:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a839f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.941434:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a6809c1c700) 00010000:00010000:3.0:1788541142.941436:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788541142.941437:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a839f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.941440:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a839f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788541142.941535:0:6549:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1788541142.941587:0:6549:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1788541142.941607:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981118848:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788541142.941674:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541142.941725:0:8973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981118848 00000100:00100000:3.0:1788541142.941732:0:8973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981118848 00000100:00100000:3.0:1788541142.941781:0:8973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788541142.941790:0:8973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3641:x1875420981118848:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788541142.941814:0:8973:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00010000:3.0:1788541142.941843:0:8973:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9af8d4, atime: 0x6a9af8d4, ctime: 0x6a9af8d4, blocks: 0x8 00010000:00010000:3.0:1788541142.941850:0:8973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050c62217/0x2aac941e5f4a83c9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.941865:0:8973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=423s v=(0 0) 00010000:00010000:3.0:1788541142.941902:0:8973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541142.941909:0:8973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050c62217/0x2aac941e5f4a83c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.941923:0:8973:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050c62217/0x2aac941e5f4a83c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.941931:0:8973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050c62217/0x2aac941e5f4a83c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.941938:0:8973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050c62217/0x2aac941e5f4a83c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.941964:0:8973:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788541142.942079:0:8973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3641:x1875420981118848:12345-0@lo:6:osp-syn-0-0.0 Request processed in 290us (403us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788541142.942085:0:8973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1788541142.942106:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788541142.942118:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788541142.942123:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050c62217/0x2aac941e5f4a83c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.942129:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075ad000 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:3.0:1788541142.942132:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050c62217/0x2aac941e5f4a83c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.942138:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050c62217/0x2aac941e5f4a83c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.942151:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050c62217/0x2aac941e5f4a83c9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.942157:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050c62217/0x2aac941e5f4a83c9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541142.942170:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541142.942172:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541142.942174:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788541142.942203:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a68355b6680/2, rc 0, transno 4294967308 00000100:00100000:3.0:1788541142.942213:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981118848:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788541142.942321:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+20:12361:x1875420955892992:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 Request processed in 3098us (3370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541142.942330:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 199 00000100:00100000:1.0:1788541142.942797:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708312d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981118976:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788541142.942831:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541142.942861:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981118976 00000100:00100000:1.0:1788541142.942865:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981118976 00000100:00100000:1.0:1788541142.942907:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788541142.942912:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708310e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981118976:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788541142.942988:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788541142.942990:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788541142 00002000:00010000:1.0:1788541142.942992:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788541142.942993:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788541142 -> 1788541142 00002000:00010000:1.0:1788541142.942995:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788541142.943017:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708310e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3642:x1875420981118976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 105us (187us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788541142.943030:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000004:00080000:1.0:1788541142.943055:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a6708312d80/2, rc 0, transno 4294967316 00000100:00100000:1.0:1788541142.943059:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708312d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981118976:0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1788541142.943119:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788541142.949706:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541142.951264:0:8973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955893120 00000100:00100000:3.0:1788541142.951277:0:8973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955893120 00000100:00100000:3.0:1788541142.951345:0:8973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 63 00000100:00100000:3.0:1788541142.951356:0:8973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:384f52e3-0481-4979-9299-157aff7472d2+10:2397:x1875420955893120:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788541142.952681:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:3.0:1788541142.952693:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:1.0:1788541142.953044:0:8973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:384f52e3-0481-4979-9299-157aff7472d2+7:2397:x1875420955893120:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 Request processed in 1685us (3341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541142.953054:0:8973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 63 00000100:00100000:1.0:1788541142.979856:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541142.979935:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955893376 00000100:00100000:1.0:1788541142.979947:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955893376 00000100:00100000:1.0:1788541142.980017:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 200 00000100:00100000:1.0:1788541142.980028:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708311f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+20:12361:x1875420955893376:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788541142.981086:0:12149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541142.981118:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac600/0x2aac941e5f4a83b4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33149f expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.981136:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a6809c1c700) 00010000:00010000:1.0:1788541142.981142:0:12149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788541142.981171:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a83d0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.981186:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a83d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.981196:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a83d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788541142.981333:0:12149:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002107eb02 reply state 0000000040f6e2c2 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a83d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.981355:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a83d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541142.981362:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a6809c1c700) 00010000:00010000:1.0:1788541142.981365:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788541142.981368:0:12149:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788541142.981474:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708311f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+21:12361:x1875420955893376:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 1446us (1631us total) trans 4294967463 rc 0/0 00000100:00100000:1.0:1788541142.981482:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 200 00000100:00100000:0.0:1788541142.986952:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541142.987033:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955893504 00000100:00100000:1.0:1788541142.987044:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955893504 00000100:00100000:1.0:1788541142.987168:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 64 00000100:00100000:1.0:1788541142.987179:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707729880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:384f52e3-0481-4979-9299-157aff7472d2+7:2396:x1875420955893504:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788541142.987348:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788541142.987352:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788541142 -> 1788541141 00002000:00010000:1.0:1788541142.987355:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788541140 00002000:00010000:1.0:1788541142.987357:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788541142 -> 1788541141 00002000:00010000:1.0:1788541142.987359:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788541142.987420:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707729880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:384f52e3-0481-4979-9299-157aff7472d2+8:2396:x1875420955893504:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 Request processed in 242us (477us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1788541142.987428:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 64 00000100:00100000:2.0:1788541142.991298:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541142.991859:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955893760 00000100:00100000:0.0:1788541142.991924:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955893760 00000100:00100000:0.0:1788541142.991971:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 201 00000100:00100000:0.0:1788541142.991978:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+21:12361:x1875420955893760:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788541142.992036:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a83d7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541142.992049:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a8398 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331491 expref: 21 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541142.992056:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a83d7 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541142.992863:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a8398 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331491 expref: 21 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541142.992896:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a8398 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331491 expref: 21 pid: 12149 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541142.992919:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708271c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1875420981119104:192.168.202.56@tcp:104: 00000100:00100000:0.0:1788541142.992997:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6835493e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788541142.996832:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541142.996922:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708271c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1875420981119104:192.168.202.56@tcp:104: 00010000:00010000:0.0:1788541142.996959:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a83d7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541143.001457:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955893888 00000100:00100000:2.0:1788541143.001489:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955893888 00010000:00010000:2.0:1788541143.001537:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a8398 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331491 expref: 22 pid: 12149 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541143.001628:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 88 00000100:00100000:2.0:1788541143.001639:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708311c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:384f52e3-0481-4979-9299-157aff7472d2+22:2396:x1875420955893888:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541143.001656:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541143.001664:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a8398 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331491 expref: 22 pid: 12149 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541143.001678:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a8398 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331491 expref: 22 pid: 12149 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541143.001701:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a8398 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331491 expref: 22 pid: 12149 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541143.001721:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a6809c1c700) 00010000:00010000:2.0:1788541143.001727:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a83d7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541143.001736:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a83d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541143.001744:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a83d7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541143.001777:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788541143.001905:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a83d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541143.001914:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a83d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541143.001958:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a83d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541143.001966:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a83d7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541143.001973:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a83d7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541143.001979:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842173200 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541143.001984:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a83d7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541143.001992:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a83d7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541143.002002:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a6809c1c700) 00010000:00010000:0.0:1788541143.002013:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788541143.002018:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a83d7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541143.002025:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a83d7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541143.002127:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+21:12361:x1875420955893760:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 Request processed in 10146us (10837us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788541143.002136:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 201 00000100:00100000:2.0:1788541143.002295:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708311c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:384f52e3-0481-4979-9299-157aff7472d2+20:2396:x1875420955893888:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 657us (5477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541143.002311:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 88 00000100:00100000:0.0:1788541143.015107:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541143.015207:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955894016 00000100:00100000:3.0:1788541143.015217:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955894016 00000100:00100000:3.0:1788541143.015288:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 65 00000100:00100000:3.0:1788541143.015299:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708271c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:384f52e3-0481-4979-9299-157aff7472d2+8:2395:x1875420955894016:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788541143.015344:0:8430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000050c62217/0x2aac941e5f4a83de lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541143.015365:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf469810/0x2aac941e5f4a83c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xa16473202a3314ad expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541143.015374:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541143.015378:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788541143.015384:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050c62217/0x2aac941e5f4a83de lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541143.015415:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bf469810/0x2aac941e5f4a83c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xa16473202a3314ad expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541143.015441:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bf469810/0x2aac941e5f4a83c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a3314ad expref: 8 pid: 8431 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541143.015456:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b7c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1875420981119232:192.168.202.56@tcp:104: 00000100:00100000:3.0:1788541143.015538:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683572b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788541143.019518:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541143.019585:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955894144 00000100:00100000:1.0:1788541143.019597:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955894144 00010000:00010000:1.0:1788541143.019636:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bf469810/0x2aac941e5f4a83c2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a3314ad expref: 9 pid: 8431 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541143.019709:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 89 00000100:00100000:1.0:1788541143.019720:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68076eb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:384f52e3-0481-4979-9299-157aff7472d2+9:2397:x1875420955894144:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788541143.019735:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541143.019758:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bf469810/0x2aac941e5f4a83c2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a3314ad expref: 9 pid: 8431 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541143.019773:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bf469810/0x2aac941e5f4a83c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a3314ad expref: 9 pid: 8431 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541143.019808:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788541143.019813:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788541143.019820:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000050c62217/0x2aac941e5f4a83de lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541143.019830:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050c62217/0x2aac941e5f4a83de lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541143.019853:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788541143.020237:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68076eb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:384f52e3-0481-4979-9299-157aff7472d2+9:2397:x1875420955894144:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 518us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541143.020255:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 89 00010000:00010000:3.0:1788541143.021348:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf469810/0x2aac941e5f4a83c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a3314ad expref: 8 pid: 8431 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541143.021366:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b7c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1875420981119232:192.168.202.56@tcp:104: 00010000:00010000:3.0:1788541143.021389:0:8430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000050c62217/0x2aac941e5f4a83de lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541143.021401:0:8430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000050c62217/0x2aac941e5f4a83de lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541143.021409:0:8430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050c62217/0x2aac941e5f4a83de lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541143.021437:0:8430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000050c62217/0x2aac941e5f4a83de lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541143.021445:0:8430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050c62217/0x2aac941e5f4a83de lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541143.021472:0:8430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050c62217/0x2aac941e5f4a83de lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541143.021480:0:8430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075ad000 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:3.0:1788541143.021485:0:8430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050c62217/0x2aac941e5f4a83de lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541143.021495:0:8430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050c62217/0x2aac941e5f4a83de lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541143.021512:0:8430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050c62217/0x2aac941e5f4a83de lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541143.021519:0:8430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050c62217/0x2aac941e5f4a83de lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541143.021639:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708271c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:384f52e3-0481-4979-9299-157aff7472d2+7:2395:x1875420955894016:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 6341us (6537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541143.021648:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 65 00000100:00100000:0.0:1788541143.030541:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541143.030672:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955894400 00000100:00100000:2.0:1788541143.030684:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955894400 00000100:00100000:2.0:1788541143.031020:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 202 00000100:00100000:2.0:1788541143.031033:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+20:12361:x1875420955894400:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788541143.031146:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a83e5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541143.031166:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad200/0x2aac941e5f4a822c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331436 expref: 20 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541143.031176:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a83e5 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541143.031215:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad200/0x2aac941e5f4a822c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331436 expref: 20 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541143.031384:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad200/0x2aac941e5f4a822c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331436 expref: 20 pid: 12149 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541143.031401:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67082fad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6517:1875420981119360:192.168.202.56@tcp:104: 00000100:00100000:2.0:1788541143.031509:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6835519180 going to sleep for 11 seconds 00000100:00100000:2.0:1788541143.034623:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67082fad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6517:1875420981119360:192.168.202.56@tcp:104: 00010000:00010000:2.0:1788541143.034654:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a83e5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541143.036217:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541143.036568:0:9520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955894528 00000100:00100000:1.0:1788541143.036581:0:9520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955894528 00010000:00010000:1.0:1788541143.036626:0:9520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad200/0x2aac941e5f4a822c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331436 expref: 21 pid: 12149 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541143.036794:0:9520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 90 00000100:00100000:1.0:1788541143.036806:0:9520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:384f52e3-0481-4979-9299-157aff7472d2+21:2396:x1875420955894528:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788541143.036823:0:9520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541143.036830:0:9520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad200/0x2aac941e5f4a822c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331436 expref: 21 pid: 12149 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541143.036843:0:9520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad200/0x2aac941e5f4a822c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331436 expref: 21 pid: 12149 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541143.036893:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad200/0x2aac941e5f4a822c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331436 expref: 21 pid: 12149 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541143.036912:0:9520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68350b2300) 00010000:00010000:1.0:1788541143.036917:0:9520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a83e5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541143.036927:0:9520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a83e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541143.036935:0:9520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a83e5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541143.036967:0:9520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788541143.037034:0:9520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:384f52e3-0481-4979-9299-157aff7472d2+20:2396:x1875420955894528:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 229us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541143.037042:0:9520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 90 00010000:00010000:3.0:1788541143.037160:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a83e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541143.037169:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a83e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541143.037367:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a83ec lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541143.037386:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a83a6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331498 expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541143.037394:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a83ec lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541143.037424:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a83a6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331498 expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541143.037437:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a83a6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331498 expref: 20 pid: 6518 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541143.037449:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b7c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6517:1875420981119488:192.168.202.56@tcp:104: 00000100:00100000:3.0:1788541143.037508:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683572ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788541143.040055:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b7c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6517:1875420981119488:192.168.202.56@tcp:104: 00010000:00010000:0.0:1788541143.040104:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a83ec lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541143.041125:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541143.041336:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955894656 00000100:00100000:3.0:1788541143.041345:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955894656 00010000:00010000:3.0:1788541143.041383:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a83a6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331498 expref: 21 pid: 6518 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541143.041429:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 91 00000100:00100000:3.0:1788541143.041439:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:384f52e3-0481-4979-9299-157aff7472d2+21:2397:x1875420955894656:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541143.041454:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541143.041462:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a83a6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331498 expref: 21 pid: 6518 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541143.041473:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a83a6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331498 expref: 21 pid: 6518 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541143.041499:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a83a6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331498 expref: 21 pid: 6518 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541143.041514:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a6809c1c700) 00010000:00010000:3.0:1788541143.041520:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a83ec lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541143.041529:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a83ec lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541143.041537:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a83ec lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541143.041557:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541143.041609:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:384f52e3-0481-4979-9299-157aff7472d2+20:2397:x1875420955894656:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 171us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541143.041616:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 91 00010000:00010000:0.0:1788541143.041887:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a83ec lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541143.041896:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a83ec lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788541143.042016:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:0.0:1788541143.042320:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:0.0:1788541143.042359:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:0.0:1788541143.042438:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6517:1875420981119616:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788541143.042487:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541143.042518:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6835493cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788541143.042614:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981119616 00000100:00100000:3.0:1788541143.042620:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981119616 00000100:00100000:3.0:1788541143.042659:0:10866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788541143.042667:0:10866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6517:x1875420981119616:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788541143.042937:0:10866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6517:x1875420981119616:12345-0@lo:1000:mdt00_000.0 Request processed in 270us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541143.042943:0:10866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788541143.043232:0:6517:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:0.0:1788541143.043247:0:6517:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a6708312d80, transno 4294967316 00000100:00100000:0.0:1788541143.043307:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6517:1875420981119616:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1788541143.043426:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:0.0:1788541143.043473:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6517:1875420981119744:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788541143.043522:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541143.043552:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68354936c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788541143.043670:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981119744 00000100:00100000:3.0:1788541143.043675:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981119744 00000100:00100000:3.0:1788541143.043806:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788541143.043815:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6517:x1875420981119744:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788541143.043967:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6517:x1875420981119744:12345-0@lo:1000:mdt00_000.0 Request processed in 153us (444us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1788541143.043975:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788541143.044046:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6517:1875420981119744:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788541143.044105:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a83ec lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541143.044113:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a83ec lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541143.044121:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a83ec lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541143.044127:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075ad000 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541143.044132:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a83ec lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541143.044140:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a83ec lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541143.044155:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a6809c1c700) 00010000:00010000:1.0:1788541143.044158:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788541143.044162:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a83ec lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541143.044168:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad000/0x2aac941e5f4a83ec lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541143.044188:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354daa00/0x2aac941e5f4a8321 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541143.044194:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354daa00/0x2aac941e5f4a8321 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541143.044199:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354daa00/0x2aac941e5f4a8321 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541143.044216:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68354daa00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541143.044219:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354daa00/0x2aac941e5f4a8321 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541143.044224:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354daa00/0x2aac941e5f4a8321 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541143.044233:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68350b2300) 00010000:00010000:1.0:1788541143.044235:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788541143.044238:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354daa00/0x2aac941e5f4a8321 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541143.044254:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354daa00/0x2aac941e5f4a8321 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541143.044280:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a83f3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541143.044293:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dac00/0x2aac941e5f4a833d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33147c expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541143.044302:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a83f3 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541143.044328:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dac00/0x2aac941e5f4a833d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33147c expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541143.044342:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dac00/0x2aac941e5f4a833d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33147c expref: 23 pid: 6518 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541143.044365:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708311c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6517:1875420981119872:192.168.202.56@tcp:104: 00000100:00100000:1.0:1788541143.044425:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67079a7780 going to sleep for 11 seconds 00000100:00100000:2.0:1788541143.048555:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541143.048634:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955894784 00000100:00100000:3.0:1788541143.048644:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955894784 00010000:00010000:3.0:1788541143.048681:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dac00/0x2aac941e5f4a833d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33147c expref: 24 pid: 6518 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541143.048728:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 92 00000100:00100000:3.0:1788541143.048738:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:384f52e3-0481-4979-9299-157aff7472d2+24:2396:x1875420955894784:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541143.048752:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541143.048759:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dac00/0x2aac941e5f4a833d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33147c expref: 24 pid: 6518 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541143.048771:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dac00/0x2aac941e5f4a833d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33147c expref: 24 pid: 6518 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541143.048804:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68350b2300) 00010000:00010000:3.0:1788541143.048809:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a83f3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541143.048819:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a83f3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541143.048827:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a83f3 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541143.048846:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541143.048941:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:384f52e3-0481-4979-9299-157aff7472d2+24:2396:x1875420955894784:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 204us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541143.048949:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 92 00010000:00010000:1.0:1788541143.050495:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dac00/0x2aac941e5f4a833d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33147c expref: 23 pid: 6518 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541143.050517:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708311c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6517:1875420981119872:192.168.202.56@tcp:104: 00010000:00010000:1.0:1788541143.050543:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a83f3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541143.051957:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a83f3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541143.051976:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a83f3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541143.051996:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a83f3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541143.052004:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a83f3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541143.052012:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a83f3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541143.052017:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68354dbe00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541143.052021:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a83f3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541143.052029:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a83f3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541143.052233:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68350b2300) 00010000:00010000:1.0:1788541143.052237:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541143.052250:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a83f3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541143.052258:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a83f3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541143.052275:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a83e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541143.052281:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a83e5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541143.052287:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a83e5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541143.052292:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551b600 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541143.052295:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a83e5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541143.052358:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a83e5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541143.052368:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a68350b2300) 00010000:00010000:1.0:1788541143.052371:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788541143.052373:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a83e5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541143.052380:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a83e5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541143.052966:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+22:12361:x1875420955894400:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 21929us (22427us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1788541143.052977:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 202 00000020:00080000:1.0:1788541143.052982:0:6517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788541143.053233:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788541143.053248:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788541143.056200:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1788541143.056219:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788541143.059193:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541143.059288:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955895040 00000100:00100000:3.0:1788541143.059309:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955895040 00000100:00100000:3.0:1788541143.059369:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 50 00000100:00100000:3.0:1788541143.059378:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6811400c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+22:12361:x1875420955895040:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788541143.059642:0:6521:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788541143.059675:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:3.0:1788541143.059722:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac400/0x2aac941e5f4a83fa lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541143.059739:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac400/0x2aac941e5f4a83fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541143.059750:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac400/0x2aac941e5f4a83fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541143.059759:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac400/0x2aac941e5f4a83fa lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541143.059766:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac400/0x2aac941e5f4a83fa lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541143.059772:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac400/0x2aac941e5f4a83fa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541143.059795:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788541143.059914:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6811400c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+24:12361:x1875420955895040:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 536us (732us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1788541143.059922:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 50 00000020:00080000:3.0:1788541143.059941:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788541143.060536:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541143.060545:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac400/0x2aac941e5f4a83fa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541143.060554:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075ac400 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:2.0:1788541143.060559:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac400/0x2aac941e5f4a83fa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541143.060568:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac400/0x2aac941e5f4a83fa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541143.060585:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a6809c1c700) 00010000:00010000:2.0:1788541143.060588:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788541143.060594:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac400/0x2aac941e5f4a83fa lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541143.060601:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac400/0x2aac941e5f4a83fa lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541143.060616:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541143.060618:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541143.060620:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541143.498224:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981120000:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788541143.498308:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541143.498433:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981120000 00000100:00100000:2.0:1788541143.498440:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981120000 00000100:00100000:2.0:1788541143.498497:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788541143.498504:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981120000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788541143.498522:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3691974656 00000100:00100000:2.0:1788541143.498555:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981120000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541143.498574:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:1.0:1788541143.498706:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788541143.502663:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67082f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981120128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788541143.502746:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541143.502833:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981120128 00000100:00100000:2.0:1788541143.502844:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981120128 00000100:00100000:2.0:1788541143.502916:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788541143.502923:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708311c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875420981120128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788541143.502944:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3691974656 00000100:00100000:2.0:1788541143.502978:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708311c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1875420981120128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541143.502983:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788541143.503529:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875420981120384:0@lo:400:kworker.0 00000100:00100000:3.0:1788541143.503557:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541143.503610:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420981120256:0@lo:400:kworker.0 00000100:00100000:2.0:1788541143.503635:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541143.504026:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981120000:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788541143.504071:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981120512:0@lo:400:kworker.0 00000100:00100000:0.0:1788541143.504103:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541143.507658:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67082f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981120128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788541143.508607:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875420981120640:0@lo:400:kworker.0 00000100:00100000:1.0:1788541143.508681:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541143.508750:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981121152:0@lo:400:kworker.0 00000100:00100000:1.0:1788541143.508779:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541143.508833:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981121152 00000100:00100000:1.0:1788541143.508841:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981121152 00000100:00100000:1.0:1788541143.508929:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788541143.508939:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708310a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981121152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541143.508989:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708310a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981121152:12345-0@lo:400:kworker.0 Request processed in 52us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541143.508997:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:1.0:1788541143.509019:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788541143.509355:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981121152:0@lo:400:kworker.0 00000100:00100000:1.0:1788541143.509397:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981120512 00000100:00100000:1.0:1788541143.509402:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981120512 00000100:00100000:1.0:1788541143.509431:0:10866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788541143.509439:0:10866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a681fef3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981120512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541143.509507:0:10866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a681fef3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981120512:12345-0@lo:400:kworker.0 Request processed in 69us (5402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541143.509514:0:10866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788541143.509857:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981120384 00000100:00100000:1.0:1788541143.509861:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981120384 00000100:00100000:1.0:1788541143.512564:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981120640 00000100:00100000:1.0:1788541143.512581:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981120640 00000100:00100000:1.0:1788541143.512669:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1788541143.512683:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875420981120384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541143.514005:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875420981120384:12345-0@lo:400:kworker.0 Request processed in 1322us (10441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541143.514015:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1788541143.514644:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875420981120384:0@lo:400:kworker.0 00000100:00100000:1.0:1788541143.514699:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1788541143.514711:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708312300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875420981120640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541143.514770:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708312300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875420981120640:12345-0@lo:400:kworker.0 Request processed in 64us (6089us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541143.514843:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981120768:0@lo:400:kworker.0 00000100:00100000:2.0:1788541143.514963:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541143.514996:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981120768 00000100:00100000:2.0:1788541143.515001:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981120768 00000100:00100000:2.0:1788541143.515038:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788541143.515055:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981120768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541143.517113:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981120768:12345-0@lo:400:kworker.0 Request processed in 2064us (2146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541143.517126:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788541143.517205:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981120768:0@lo:400:kworker.0 00000100:00100000:2.0:1788541143.517218:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981121280:0@lo:400:kworker.0 00000100:00100000:2.0:1788541143.517266:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541143.517357:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67079b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875420981120896:0@lo:400:kworker.0 00000100:00100000:2.0:1788541143.517407:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541143.517431:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708837800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875420981121408:0@lo:400:kworker.0 00000100:00100000:2.0:1788541143.517465:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541143.517507:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981120896 00000100:00100000:2.0:1788541143.517514:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981120896 00000100:00100000:0.0:1788541143.518092:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981120512:0@lo:400:kworker.0 00000100:00100000:0.0:1788541143.518109:0:8973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981121280 00000100:00100000:0.0:1788541143.518113:0:8973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981121280 00000100:00100000:0.0:1788541143.518151:0:8973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788541143.518161:0:8973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3641:x1875420981121280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541143.518212:0:8973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3641:x1875420981121280:12345-0@lo:400:kworker.0 Request processed in 52us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541143.518220:0:8973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788541143.518249:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981121408 00000100:00100000:0.0:1788541143.518253:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981121408 00000100:00100000:3.0:1788541143.522634:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981120256 00000100:00100000:3.0:1788541143.522657:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981120256 00000100:00100000:3.0:1788541143.522800:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1788541143.522812:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a682e789c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+24:3641:x1875420981120256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541143.523010:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a682e789c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+24:3641:x1875420981120256:12345-0@lo:400:kworker.0 Request processed in 200us (19372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541143.523020:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00080000:3.0:1788541143.523435:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788541143.523857:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875420981120640:0@lo:400:kworker.0 00000100:00100000:3.0:1788541143.529721:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420981120256:0@lo:400:kworker.0 00000100:00100000:3.0:1788541143.529749:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981121280:0@lo:400:kworker.0 00000100:00100000:3.0:1788541143.529816:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875420981121024:0@lo:400:kworker.0 00000100:00100000:3.0:1788541143.529919:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541143.529965:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981121024 00000100:00100000:3.0:1788541143.529972:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981121024 00000100:00100000:3.0:1788541143.530030:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1788541143.530038:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875420981121024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541143.530275:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875420981121024:12345-0@lo:400:kworker.0 Request processed in 237us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541143.530283:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00080000:3.0:1788541143.530306:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788541143.530347:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6708834000 x1875420981121024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541143.530359:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875420981121024:0@lo:400:kworker.0 00000100:00100000:3.0:1788541143.530366:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875420981121536:0@lo:400:kworker.0 00000100:00100000:3.0:1788541143.530390:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541143.530409:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981121536 00000100:00100000:3.0:1788541143.530413:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981121536 00000100:00100000:3.0:1788541143.530443:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1788541143.530792:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875420981121536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541143.530828:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875420981121536:12345-0@lo:400:kworker.0 Request processed in 41us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541143.530836:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00080000:3.0:1788541143.530853:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788541143.531560:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6708836d80 x1875420981121536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541143.531574:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875420981121536:0@lo:400:kworker.0 00000100:00100000:1.0:1788541143.532199:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1788541143.536189:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1788541143.536213:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875420981120896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541143.536407:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875420981120896:12345-0@lo:400:kworker.0 Request processed in 206us (18998us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541143.536416:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1788541143.541751:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1788541143.541778:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875420981121408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541143.541905:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875420981121408:12345-0@lo:400:kworker.0 Request processed in 142us (24438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541143.541912:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1788541143.546969:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67079b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875420981120896:0@lo:400:kworker.0 00000100:00100000:1.0:1788541143.546996:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708837800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875420981121408:0@lo:400:kworker.0 00010000:00010000:3.0:1788541143.637637:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541144.659787:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788541144.703579:0:14707:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788541144.703589:0:14707:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788541144.703622:0:14707:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788541144.703629:0:14707:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788541144.843905:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541144.843977:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955895296 00000100:00100000:1.0:1788541144.843988:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955895296 00000100:00100000:1.0:1788541144.844069:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 203 00000100:00100000:1.0:1788541144.844079:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+24:12379:x1875420955895296:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1788541144.844104:0:9339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541144.844125:0:9339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a8401 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3314b4 expref: -99 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541144.844286:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dac00/0x2aac941e5f4a8408 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541144.844302:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dac00/0x2aac941e5f4a8408 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541144.844314:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dac00/0x2aac941e5f4a8408 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788541144.844326:0:9339:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788541144.844444:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a8401 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3314b4 expref: 27 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541144.844466:0:9339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dac00/0x2aac941e5f4a8408 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3314b4 expref: 26 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541144.844477:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68350c0a00) 00010000:00010000:1.0:1788541144.844480:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788541144.844485:0:9339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68354dac00, rc 0) 00000100:00100000:1.0:1788541144.844560:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+26:12379:x1875420955895296:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 482us (690us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1788541144.844568:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 203 00000100:00080000:3.0:1788541144.844678:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788541144.851077:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541144.851243:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955895424 00000100:00100000:3.0:1788541144.851257:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955895424 00000100:00100000:3.0:1788541144.851355:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 204 00000100:00100000:3.0:1788541144.851367:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+26:12379:x1875420955895424:12345-192.168.202.56@tcp:34:lfs.0 00010000:00010000:3.0:1788541144.851450:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a8416 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.851469:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a8416 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.851494:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a8416 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.851511:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a841d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.851519:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a841d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.851526:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a841d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.851614:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a8424 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.851622:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a8424 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.851629:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a8424 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788541144.851673:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a8424 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.851685:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a8416 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.851691:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a8416 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.851699:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a8416 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.851714:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075aca00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541144.851719:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a8416 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.851727:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a8416 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.851740:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68350c0a00) 00010000:00010000:3.0:1788541144.851743:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541144.851747:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a8416 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.851754:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a8416 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.851768:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a841d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.851773:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a841d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.851779:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a841d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.851784:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075ace00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541144.851787:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a841d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.851793:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a841d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.851812:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a683531b400) 00010000:00010000:3.0:1788541144.851814:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541144.851818:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a841d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.851823:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a841d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.851838:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a8424 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.851844:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a8424 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.851850:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a8424 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.851854:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075ad800 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541144.851857:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a8424 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.851863:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a8424 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.851913:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a683531b700) 00010000:00010000:3.0:1788541144.851916:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541144.851920:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a8424 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.851926:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a8424 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541144.852016:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+26:12379:x1875420955895424:12345-192.168.202.56@tcp:34:lfs.0 Request processed in 651us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541144.852024:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 204 00000100:00100000:2.0:1788541144.893321:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541144.893500:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955895680 00000100:00100000:3.0:1788541144.893513:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955895680 00000100:00100000:3.0:1788541144.893595:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 205 00000100:00100000:3.0:1788541144.893608:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+26:12382:x1875420955895680:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1788541144.893632:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541144.893653:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a842b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3314bb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.893730:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a8432 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.893747:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a8432 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.893759:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a8432 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.893775:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a8439 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.893783:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a8439 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.893790:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a8439 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.893959:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075acc00/0x2aac941e5f4a8440 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.893968:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075acc00/0x2aac941e5f4a8440 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.893975:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075acc00/0x2aac941e5f4a8440 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541144.893985:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788541144.894075:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a8432 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.894083:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a8432 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.894089:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a8432 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.894095:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075ace00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541144.894099:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a8432 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.894108:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a8432 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.894120:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68350c0a00) 00010000:00010000:3.0:1788541144.894123:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541144.894128:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a8432 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.894278:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a8432 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.894293:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a8439 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.894299:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a8439 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.894305:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a8439 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.894311:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075aca00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541144.894314:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a8439 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.894322:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a8439 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.894330:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a683531b700) 00010000:00010000:3.0:1788541144.894333:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541144.894336:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a8439 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.894341:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a8439 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.894383:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a842b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3314bb expref: 29 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.894396:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075acc00/0x2aac941e5f4a8440 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3314bb expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541144.894409:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a683531b400) 00010000:00010000:3.0:1788541144.894411:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788541144.894413:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075acc00, rc 0) 00000100:00100000:3.0:1788541144.894538:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+28:12382:x1875420955895680:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 931us (1226us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1788541144.894546:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 205 00000100:00100000:2.0:1788541144.904114:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541144.904346:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955895808 00000100:00100000:0.0:1788541144.904360:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955895808 00000100:00100000:0.0:1788541144.904443:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 206 00000100:00100000:0.0:1788541144.904455:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+28:12382:x1875420955895808:12345-192.168.202.56@tcp:54:lfs.0 00010000:00010000:0.0:1788541144.904528:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a844e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541144.904548:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a844e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541144.904561:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a844e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541144.904601:0:12149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a844e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541144.904610:0:12149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a844e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541144.904617:0:12149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a844e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541144.904623:0:12149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842172000 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541144.904629:0:12149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a844e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541144.904655:0:12149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a844e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541144.904666:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a683531b400) 00010000:00010000:0.0:1788541144.904669:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788541144.904674:0:12149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a844e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541144.904696:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a844e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541144.904797:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+28:12382:x1875420955895808:12345-192.168.202.56@tcp:54:lfs.0 Request processed in 344us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541144.904806:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 206 00000100:00100000:2.0:1788541144.911016:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541144.911309:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955896064 00000100:00100000:3.0:1788541144.911321:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955896064 00000100:00100000:3.0:1788541144.911389:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 51 00000100:00100000:3.0:1788541144.911400:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+28:12382:x1875420955896064:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:3.0:1788541144.911645:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+29:12382:x1875420955896064:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 246us (641us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1788541144.911654:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 51 00000100:00100000:3.0:1788541144.939505:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541144.939847:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955896320 00000100:00100000:0.0:1788541144.939860:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955896320 00000100:00100000:0.0:1788541144.939968:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 207 00000100:00100000:0.0:1788541144.939980:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+29:11906:x1875420955896320:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:0.0:1788541144.940008:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541144.940029:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a8455 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3314c2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541144.940322:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a845c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541144.940339:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075acc00/0x2aac941e5f4a8440 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3314bb expref: 30 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541144.940367:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a845c lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541144.940399:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075acc00/0x2aac941e5f4a8440 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3314bb expref: 30 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541144.940412:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075acc00/0x2aac941e5f4a8440 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3314bb expref: 30 pid: 6517 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541144.940426:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6518:1875420981121664:192.168.202.56@tcp:104: 00000100:00100000:0.0:1788541144.940521:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068fd840 going to sleep for 11 seconds 00000100:00100000:2.0:1788541144.946587:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541144.946662:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955896448 00000100:00100000:1.0:1788541144.946672:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955896448 00010000:00010000:1.0:1788541144.946724:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075acc00/0x2aac941e5f4a8440 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3314bb expref: 31 pid: 6517 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541144.946864:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6518:1875420981121664:192.168.202.56@tcp:104: 00010000:00010000:0.0:1788541144.946922:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a845c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541144.947067:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 93 00000100:00100000:1.0:1788541144.947093:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:384f52e3-0481-4979-9299-157aff7472d2+31:2396:x1875420955896448:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788541144.947108:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541144.947117:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075acc00/0x2aac941e5f4a8440 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3314bb expref: 31 pid: 6517 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541144.947128:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075acc00/0x2aac941e5f4a8440 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3314bb expref: 31 pid: 6517 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541144.947150:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075acc00/0x2aac941e5f4a8440 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3314bb expref: 31 pid: 6517 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541144.947165:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a683531b400) 00010000:00010000:1.0:1788541144.947170:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a845c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541144.947180:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a845c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541144.947187:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a845c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541144.947216:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788541144.947275:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:384f52e3-0481-4979-9299-157aff7472d2+30:2396:x1875420955896448:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 183us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541144.947283:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 93 00010000:00010000:0.0:1788541144.947349:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a845c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541144.947356:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a845c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541144.947375:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788541144.947502:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a8455 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3314c2 expref: 31 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541144.947520:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a845c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3314c2 expref: 30 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541144.947540:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a683531b400) 00010000:00010000:0.0:1788541144.947543:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788541144.947546:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6842173200, rc 0) 00000100:00100000:0.0:1788541144.947572:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+30:11906:x1875420955896320:12345-192.168.202.56@tcp:101:bash.0 Request processed in 7595us (8078us total) trans 4294967474 rc 0/0 00000100:00100000:0.0:1788541144.947579:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 207 00000100:00100000:2.0:1788541144.951017:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541144.951167:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955896576 00000100:00100000:1.0:1788541144.951177:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955896576 00000100:00100000:1.0:1788541144.951269:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 208 00000100:00100000:1.0:1788541144.951280:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+30:11906:x1875420955896576:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:1.0:1788541144.951316:0:9339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541144.951337:0:9339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a846a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3314c9 expref: -99 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541144.951371:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354daa00/0x2aac941e5f4a8471 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541144.951386:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354daa00/0x2aac941e5f4a8471 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541144.951397:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354daa00/0x2aac941e5f4a8471 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541144.951499:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a846a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3314c9 expref: 32 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541144.951518:0:9339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354daa00/0x2aac941e5f4a8471 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3314c9 expref: 31 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541144.951527:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a683531b400) 00010000:00010000:1.0:1788541144.951530:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788541144.951533:0:9339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68354daa00, rc 0) 00000100:00100000:1.0:1788541144.951637:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+31:11906:x1875420955896576:12345-192.168.202.56@tcp:101:bash.0 Request processed in 359us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541144.951654:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 208 00000100:00100000:2.0:1788541144.955129:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541144.955220:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955896832 00000100:00100000:1.0:1788541144.955238:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955896832 00000100:00100000:1.0:1788541144.955335:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 209 00000100:00100000:1.0:1788541144.955345:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+31:11906:x1875420955896832:12345-192.168.202.56@tcp:36:bash.0 00010000:00010000:1.0:1788541144.955590:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a8478 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541144.955607:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a8478 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541144.955618:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a8478 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788541144.955760:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:1.0:1788541144.955849:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000824f01b9 reply state 00000000e3dc415c transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a8478 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541144.955863:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a8478 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541144.955985:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a683531b400) 00010000:00010000:1.0:1788541144.955988:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788541144.955992:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788541144.956036:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:1.0:1788541144.956256:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+35:11906:x1875420955896832:12345-192.168.202.56@tcp:36:bash.0 Request processed in 911us (1136us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1788541144.956263:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 209 00000020:00080000:1.0:1788541144.956268:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788541144.958497:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541144.958585:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955896960 00000100:00100000:0.0:1788541144.958594:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955896960 00000100:00100000:0.0:1788541144.958748:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 210 00000100:00100000:0.0:1788541144.958760:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+35:11906:x1875420955896960:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:0.0:1788541144.958793:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541144.958813:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a847f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3314d0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541144.958922:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a847f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3314d0 expref: 36 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541144.958939:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a847f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3314d0 expref: 36 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541144.958959:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a683531b400) 00010000:00010000:0.0:1788541144.958962:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788541144.958966:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6842173800, rc 0) 00000100:00100000:0.0:1788541144.959019:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+36:11906:x1875420955896960:12345-192.168.202.56@tcp:101:bash.0 Request processed in 262us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541144.959055:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 210 00000100:00100000:3.0:1788541144.961438:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541144.961520:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955897088 00000100:00100000:1.0:1788541144.961530:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955897088 00000100:00100000:1.0:1788541144.961604:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 66 00000100:00100000:1.0:1788541144.961614:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708834000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:384f52e3-0481-4979-9299-157aff7472d2+7:11906:x1875420955897088:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:1.0:1788541144.961631:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541144.961664:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056f0c80e/0x2aac941e5f4a8486 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3314d7 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788541144.961703:0:8432:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9af8d5, atime: 0x6a9af8d4, ctime: 0x6a9af8d5, blocks: 0x8 00010000:00010000:1.0:1788541144.961724:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=425s v=(0 0) 00010000:00010000:1.0:1788541144.961729:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541144.961737:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056f0c80e/0x2aac941e5f4a8486 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3314d7 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541144.961754:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000056f0c80e/0x2aac941e5f4a8486 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3314d7 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541144.961765:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68354da800, rc 0) 00000100:00100000:1.0:1788541144.961832:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708834000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:384f52e3-0481-4979-9299-157aff7472d2+8:11906:x1875420955897088:12345-192.168.202.56@tcp:101:bash.0 Request processed in 219us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541144.961838:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 66 00000100:00080000:3.0:1788541144.962024:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788541144.965038:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541144.965220:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955897216 00000100:00100000:2.0:1788541144.965238:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955897216 00002000:00010000:2.0:1788541144.965279:0:8437:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:2.0:1788541144.965284:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6708837100 with x1875420955897216 ext(0->18446744073709551615) 00002000:00010000:2.0:1788541144.965296:0:8437:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a6708837100. 00000100:00100000:2.0:1788541144.965344:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 5 00000100:00100000:2.0:1788541144.965354:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708837100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:384f52e3-0481-4979-9299-157aff7472d2+8:2397:x1875420955897216:12345-192.168.202.56@tcp:10:bash.0 00002000:00010000:2.0:1788541144.965603:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788541144.965607:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788541141 -> 1788541144 00002000:00010000:2.0:1788541144.965609:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1788541140 -> 1788541140 00002000:00010000:2.0:1788541144.965611:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788541141 -> 1788541144 00002000:00010000:2.0:1788541144.965614:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1788541144.965932:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708837100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:384f52e3-0481-4979-9299-157aff7472d2+9:2397:x1875420955897216:12345-192.168.202.56@tcp:10:bash.0 Request processed in 579us (901us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1788541144.965941:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 5 00002000:00010000:2.0:1788541144.965945:0:8437:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:2.0:1788541144.965948:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6708837100 with x1875420955897216 ext(0->18446744073709551615) 00002000:00010000:2.0:1788541144.965953:0:8437:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a6708837100. 00000100:00100000:2.0:1788541145.058043:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541145.058206:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955897344 00000100:00100000:1.0:1788541145.058218:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955897344 00000100:00100000:1.0:1788541145.058321:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 211 00000100:00100000:1.0:1788541145.058333:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+36:12396:x1875420955897344:12345-192.168.202.56@tcp:34:lfs.0 00010000:00010000:1.0:1788541145.058421:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a848d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.058445:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a848d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.058458:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a848d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.058514:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956e00/0x2aac941e5f4a8494 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.058523:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956e00/0x2aac941e5f4a8494 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.058530:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956e00/0x2aac941e5f4a8494 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.058604:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957000/0x2aac941e5f4a849b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.058614:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957000/0x2aac941e5f4a849b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.058621:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957000/0x2aac941e5f4a849b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788541145.058676:0:9339:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957000/0x2aac941e5f4a849b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.058688:0:9339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a848d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.058694:0:9339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a848d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.058701:0:9339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a848d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.058707:0:9339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68354dbe00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541145.058710:0:9339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a848d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.058723:0:9339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a848d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.058736:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68350c0a00) 00010000:00010000:1.0:1788541145.058739:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541145.058744:0:9339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a848d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.058751:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbe00/0x2aac941e5f4a848d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.058776:0:9339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956e00/0x2aac941e5f4a8494 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.058783:0:9339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956e00/0x2aac941e5f4a8494 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.058790:0:9339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956e00/0x2aac941e5f4a8494 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.058795:0:9339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706956e00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541145.058798:0:9339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956e00/0x2aac941e5f4a8494 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.058805:0:9339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956e00/0x2aac941e5f4a8494 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.058812:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a6809c1c100) 00010000:00010000:1.0:1788541145.058815:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541145.058818:0:9339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956e00/0x2aac941e5f4a8494 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.058833:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956e00/0x2aac941e5f4a8494 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.058849:0:9339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957000/0x2aac941e5f4a849b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.058855:0:9339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957000/0x2aac941e5f4a849b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.058860:0:9339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957000/0x2aac941e5f4a849b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.058865:0:9339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706957000 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541145.058919:0:9339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957000/0x2aac941e5f4a849b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.058927:0:9339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957000/0x2aac941e5f4a849b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.058935:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a683531b400) 00010000:00010000:1.0:1788541145.058937:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541145.058940:0:9339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957000/0x2aac941e5f4a849b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.058945:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957000/0x2aac941e5f4a849b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541145.059025:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+36:12396:x1875420955897344:12345-192.168.202.56@tcp:34:lfs.0 Request processed in 693us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541145.059034:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 211 00000100:00100000:3.0:1788541145.105711:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541145.105785:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955897600 00000100:00100000:1.0:1788541145.105796:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955897600 00000100:00100000:1.0:1788541145.105862:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 212 00000100:00100000:1.0:1788541145.105909:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+36:12399:x1875420955897600:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1788541145.105931:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541145.105953:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957000/0x2aac941e5f4a84a2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3314de expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.106029:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956e00/0x2aac941e5f4a84a9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.106044:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956e00/0x2aac941e5f4a84a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.106058:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956e00/0x2aac941e5f4a84a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.106072:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a84b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.106080:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a84b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.106087:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a84b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.106194:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956800/0x2aac941e5f4a84b7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.106203:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956800/0x2aac941e5f4a84b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.106241:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956800/0x2aac941e5f4a84b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788541145.106252:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788541145.106352:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956e00/0x2aac941e5f4a84a9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.106360:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956e00/0x2aac941e5f4a84a9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.106365:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956e00/0x2aac941e5f4a84a9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.106372:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706956e00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541145.106376:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956e00/0x2aac941e5f4a84a9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.106384:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956e00/0x2aac941e5f4a84a9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.106396:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68350c0a00) 00010000:00010000:1.0:1788541145.106399:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541145.106404:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956e00/0x2aac941e5f4a84a9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.106410:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956e00/0x2aac941e5f4a84a9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.106424:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a84b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.106429:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a84b0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.106453:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a84b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.106458:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706957e00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541145.106460:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a84b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.106466:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a84b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.106474:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a6809c1c100) 00010000:00010000:1.0:1788541145.106476:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541145.106479:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a84b0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.106485:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a84b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.106525:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957000/0x2aac941e5f4a84a2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3314de expref: 39 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.106539:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956800/0x2aac941e5f4a84b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3314de expref: 38 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.106546:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a683531b400) 00010000:00010000:1.0:1788541145.106548:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788541145.106551:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6706956800, rc 0) 00000100:00100000:1.0:1788541145.106623:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+38:12399:x1875420955897600:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 752us (924us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1788541145.106641:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 212 00000100:00100000:2.0:1788541145.110586:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541145.112500:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955897728 00000100:00100000:0.0:1788541145.112512:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955897728 00000100:00100000:0.0:1788541145.112567:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 213 00000100:00100000:0.0:1788541145.112578:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+38:12399:x1875420955897728:12345-192.168.202.56@tcp:54:lfs.0 00010000:00010000:0.0:1788541145.112752:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a84c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.112768:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a845c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3314c2 expref: 38 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.112779:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a84c5 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.112820:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a845c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3314c2 expref: 38 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.112832:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a845c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3314c2 expref: 38 pid: 6518 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541145.112844:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6518:1875420981121792:192.168.202.56@tcp:104: 00000100:00100000:0.0:1788541145.112986:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068fd840 going to sleep for 11 seconds 00000100:00100000:3.0:1788541145.118634:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541145.118796:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955897984 00000100:00100000:2.0:1788541145.118806:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955897984 00000100:00100000:2.0:1788541145.118867:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 52 00000100:00100000:2.0:1788541145.118917:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+39:6166:x1875420955897984:12345-192.168.202.56@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788541145.119281:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+40:6166:x1875420955897984:12345-192.168.202.56@tcp:35:ldlm_bl.0 Request processed in 364us (656us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1788541145.119289:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 52 00000100:00100000:3.0:1788541145.121815:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541145.122507:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955898112 00000100:00100000:2.0:1788541145.122517:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955898112 00010000:00010000:2.0:1788541145.122560:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a845c lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3314c2 expref: 40 pid: 6518 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541145.122635:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 94 00000100:00100000:2.0:1788541145.122646:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708834a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:384f52e3-0481-4979-9299-157aff7472d2+40:2397:x1875420955898112:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541145.122661:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541145.122668:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a845c lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3314c2 expref: 40 pid: 6518 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541145.122681:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a845c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3314c2 expref: 40 pid: 6518 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541145.122704:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a683531b400) 00010000:00010000:2.0:1788541145.122709:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a84c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541145.122720:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a84c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541145.122727:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a84c5 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541145.122749:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541145.122947:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708834a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:384f52e3-0481-4979-9299-157aff7472d2+40:2397:x1875420955898112:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 303us (1143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541145.122956:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 94 00010000:00010000:0.0:1788541145.123790:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a845c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3314c2 expref: 39 pid: 6518 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541145.123810:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6518:1875420981121792:192.168.202.56@tcp:104: 00010000:00010000:0.0:1788541145.123834:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a84c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.123855:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a84c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.123862:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a84c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.123942:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a84c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.123950:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a84c5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.123956:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a84c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.123962:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842172000 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541145.123966:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a84c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.123973:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a84c5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.123985:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a683531b400) 00010000:00010000:0.0:1788541145.123988:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788541145.123992:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a84c5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.123998:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a84c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541145.124061:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+38:12399:x1875420955897728:12345-192.168.202.56@tcp:54:lfs.0 Request processed in 11485us (13487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541145.124076:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 213 00000100:00100000:2.0:1788541145.127239:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541145.127400:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955898368 00000100:00100000:3.0:1788541145.127412:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955898368 00000100:00100000:3.0:1788541145.128357:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 53 00000100:00100000:3.0:1788541145.128373:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+38:12399:x1875420955898368:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:3.0:1788541145.128609:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+39:12399:x1875420955898368:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 241us (1388us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1788541145.128634:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 53 00000100:00100000:1.0:1788541145.213741:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541145.213848:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955898624 00000100:00100000:3.0:1788541145.213860:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955898624 00000100:00100000:3.0:1788541145.213949:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 214 00000100:00100000:3.0:1788541145.213960:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708310380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+39:12410:x1875420955898624:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:3.0:1788541145.213987:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541145.214009:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a84cc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3314e5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.214096:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a84d3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.214112:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a84d3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.214123:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a84d3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.214140:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a84da lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.214146:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a84da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.214153:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a84da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.214269:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a84e1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.214297:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a84e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.214304:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a84e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541145.214316:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:3.0:1788541145.214395:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a84d3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.214403:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a84d3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.214409:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a84d3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.214414:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075ad800 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541145.214418:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a84d3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.214425:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a84d3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.214436:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68350c0a00) 00010000:00010000:3.0:1788541145.214439:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541145.214443:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a84d3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.214448:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a84d3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.214460:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a84da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.214473:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a84da lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.214479:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a84da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.214483:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075aca00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541145.214486:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a84da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.214492:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a84da lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.214499:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a683531b700) 00010000:00010000:3.0:1788541145.214501:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541145.214504:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a84da lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.214509:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a84da lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.214547:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a84cc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3314e5 expref: 42 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.214560:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a84e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3314e5 expref: 41 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.214567:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a683531b400) 00010000:00010000:3.0:1788541145.214569:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788541145.214579:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075ace00, rc 0) 00000100:00100000:3.0:1788541145.215755:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708310380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+41:12410:x1875420955898624:12345-192.168.202.56@tcp:101:cat.0 Request processed in 1789us (2016us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1788541145.215776:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 214 00000100:00100000:2.0:1788541145.221334:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541145.221500:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955898880 00000100:00100000:1.0:1788541145.221509:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955898880 00000100:00100000:1.0:1788541145.221562:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 54 00000100:00100000:1.0:1788541145.221571:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706878380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+41:12410:x1875420955898880:12345-192.168.202.56@tcp:35:cat.0 00000100:00100000:1.0:1788541145.221958:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706878380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+42:12410:x1875420955898880:12345-192.168.202.56@tcp:35:cat.0 Request processed in 386us (630us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1788541145.221966:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 54 00000100:00100000:2.0:1788541145.245584:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541145.245798:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955899136 00000100:00100000:0.0:1788541145.245809:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955899136 00000100:00100000:0.0:1788541145.245907:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 215 00000100:00100000:0.0:1788541145.245917:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706879c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+42:12411:x1875420955899136:12345-192.168.202.56@tcp:36:rm.0 00010000:00010000:0.0:1788541145.245988:0:12149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1788541145.246021:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a847f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3314d0 expref: 42 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.246058:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ace00/0x2aac941e5f4a84e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3314e5 expref: 41 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.246074:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956800/0x2aac941e5f4a84b7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3314de expref: 40 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.246086:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354daa00/0x2aac941e5f4a8471 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3314c9 expref: 39 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.246096:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a683531b400) 00010000:00010000:0.0:1788541145.246102:0:12149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788541145.246129:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a84ef lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.246144:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a84ef lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.246156:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a84ef lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.246194:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a84f6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.246202:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a84f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.246209:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a84f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.246332:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a84fd lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.246342:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a84fd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.246349:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a84fd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788541145.246576:0:12149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:0.0:1788541145.246588:0:12149:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 426164716754ns, next at 427164713432ns, rc = 0 00010000:00010000:0.0:1788541145.246638:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a8504 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.246648:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a8504 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.246656:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a8504 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.246663:0:12149:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a8504 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.246680:0:12149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a8504 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.246686:0:12149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a8504 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.246710:0:12149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788541145.246732:0:12149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a84fd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.246739:0:12149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a84fd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.246745:0:12149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a84fd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.246750:0:12149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75ee00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541145.246755:0:12149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a84fd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.246763:0:12149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a84fd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.246772:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a683531b400) 00010000:00010000:0.0:1788541145.246775:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788541145.246778:0:12149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a84fd lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.246784:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a84fd lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.246800:0:12149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a84ef lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.246811:0:12149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a84ef lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.246817:0:12149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a84ef lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.246822:0:12149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842172000 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541145.246826:0:12149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a84ef lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.246832:0:12149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a84ef lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.246840:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68350c0a00) 00010000:00010000:0.0:1788541145.246842:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541145.246845:0:12149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a84ef lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.246850:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a84ef lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788541145.246861:0:12149:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002d8cdf84 reply state 000000009706b52d transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a84f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.246895:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a84f6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.246900:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a67078a1c00) 00010000:00010000:0.0:1788541145.246902:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788541145.246905:0:12149:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788541145.247004:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706879c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+40:12411:x1875420955899136:12345-192.168.202.56@tcp:36:rm.0 Request processed in 1087us (1429us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1788541145.247019:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 215 00010000:00010000:2.0:1788541145.247632:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541145.247644:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a8504 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541145.247651:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75ec00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:2.0:1788541145.247654:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a8504 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541145.247661:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a8504 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541145.247672:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a683531b400) 00010000:00010000:2.0:1788541145.247674:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788541145.247677:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a8504 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541145.247683:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a8504 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541145.247694:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541145.247696:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541145.247698:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541145.289810:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541145.289988:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955899392 00000100:00100000:0.0:1788541145.289998:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955899392 00000100:00100000:0.0:1788541145.290069:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 216 00000100:00100000:0.0:1788541145.290081:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670687b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+40:12417:x1875420955899392:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:0.0:1788541145.290111:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541145.290133:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a850b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3314ec expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.290252:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a8512 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.290270:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a8512 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.290284:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a8512 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.290294:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a8519 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.290300:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a8519 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.290306:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a8519 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788541145.290653:0:6518:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:0.0:1788541145.290817:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a8520 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.290843:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a8520 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.290852:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a8520 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.291161:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a8512 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.291170:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a8512 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.291178:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a8512 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.291183:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75e600 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541145.291188:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a8512 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.291195:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a8512 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.291208:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68350c0a00) 00010000:00010000:0.0:1788541145.291211:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541145.291216:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a8512 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.291233:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a8512 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788541145.291249:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000007702b53 reply state 0000000024f5bbad transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a8519 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.291267:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a8519 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.291274:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a67078a1c00) 00010000:00010000:0.0:1788541145.291277:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788541145.291280:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788541145.291311:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a850b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3314ec expref: 43 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.291324:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a8520 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3314ec expref: 42 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.291331:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a67078a1b00) 00010000:00010000:0.0:1788541145.291333:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788541145.291336:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75fe00, rc 0) 00000100:00100000:0.0:1788541145.291452:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670687b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+43:12417:x1875420955899392:12345-192.168.202.56@tcp:101:bash.0 Request processed in 1373us (1651us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1788541145.291460:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 216 00000100:00100000:3.0:1788541145.296255:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541145.296342:0:8973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955899520 00000100:00100000:0.0:1788541145.296353:0:8973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955899520 00000100:00100000:0.0:1788541145.296431:0:8973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 67 00000100:00100000:0.0:1788541145.296442:0:8973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708836680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:384f52e3-0481-4979-9299-157aff7472d2+7:2397:x1875420955899520:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:0.0:1788541145.296460:0:8973:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541145.296482:0:8973:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007330cc41/0x2aac941e5f4a852e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3314f3 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788541145.296506:0:8973:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788541145.296540:0:8973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=426s v=(0 0) 00010000:00010000:0.0:1788541145.296544:0:8973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541145.296553:0:8973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007330cc41/0x2aac941e5f4a852e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3314f3 expref: 8 pid: 8973 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.296573:0:8973:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007330cc41/0x2aac941e5f4a852e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3314f3 expref: 8 pid: 8973 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.296586:0:8973:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75f200, rc 0) 00000100:00100000:0.0:1788541145.296648:0:8973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708836680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:384f52e3-0481-4979-9299-157aff7472d2+8:2397:x1875420955899520:12345-192.168.202.56@tcp:101:bash.0 Request processed in 208us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541145.296654:0:8973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 67 00000100:00080000:3.0:1788541145.296905:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788541145.306484:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541145.306582:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955899648 00000100:00100000:1.0:1788541145.306594:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955899648 00000100:00100000:1.0:1788541145.306656:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 68 00000100:00100000:1.0:1788541145.306667:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670687b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:384f52e3-0481-4979-9299-157aff7472d2+8:12417:x1875420955899648:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:1.0:1788541145.306686:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541145.306704:0:8432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001974258/0x2aac941e5f4a8535 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3314fa expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.306739:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007330cc41/0x2aac941e5f4a852e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3314f3 expref: 9 pid: 8973 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.306749:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541145.306753:0:8432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541145.306759:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001974258/0x2aac941e5f4a8535 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3314fa expref: 9 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.306805:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007330cc41/0x2aac941e5f4a852e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3314f3 expref: 9 pid: 8973 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.306835:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007330cc41/0x2aac941e5f4a852e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3314f3 expref: 9 pid: 8973 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541145.306849:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708313480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8432:1875420981121920:192.168.202.56@tcp:104: 00000100:00100000:1.0:1788541145.306983:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67079a7840 going to sleep for 11 seconds 00000100:00100000:2.0:1788541145.310697:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541145.310947:0:9520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955899776 00000100:00100000:3.0:1788541145.310957:0:9520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955899776 00010000:00010000:3.0:1788541145.310997:0:9520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007330cc41/0x2aac941e5f4a852e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3314f3 expref: 10 pid: 8973 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541145.311037:0:9520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 95 00000100:00100000:3.0:1788541145.311052:0:9520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:384f52e3-0481-4979-9299-157aff7472d2+10:2397:x1875420955899776:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541145.311073:0:9520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541145.311095:0:9520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007330cc41/0x2aac941e5f4a852e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3314f3 expref: 10 pid: 8973 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.311111:0:9520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007330cc41/0x2aac941e5f4a852e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3314f3 expref: 10 pid: 8973 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.311136:0:9520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541145.311141:0:9520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541145.311149:0:9520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000001974258/0x2aac941e5f4a8535 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3314fa expref: 10 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.311158:0:9520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001974258/0x2aac941e5f4a8535 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3314fa expref: 10 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.311216:0:9520:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000001974258/0x2aac941e5f4a8535 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3314fa expref: 10 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541145.311240:0:9520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708834380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9520:1875420981122048:192.168.202.56@tcp:105: 00000100:00100000:3.0:1788541145.311324:0:9520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683572b540 going to sleep for 11 seconds 00010000:00010000:1.0:1788541145.311835:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007330cc41/0x2aac941e5f4a852e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3314f3 expref: 10 pid: 8973 timeout: 526 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541145.311855:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708313480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8432:1875420981121920:192.168.202.56@tcp:104: 00010000:00010000:1.0:1788541145.311929:0:8432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000001974258/0x2aac941e5f4a8535 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xa16473202a3314fa expref: 9 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.311947:0:8432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6706957e00, rc 0) 00000100:00100000:1.0:1788541145.311990:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670687b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:384f52e3-0481-4979-9299-157aff7472d2+9:12417:x1875420955899648:12345-192.168.202.56@tcp:101:bash.0 Request processed in 5325us (5515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541145.311999:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 68 00000100:00100000:3.0:1788541145.313237:0:9520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708834380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9520:1875420981122048:192.168.202.56@tcp:105: 00010000:00010000:3.0:1788541145.313258:0:9520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541145.313309:0:9520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:384f52e3-0481-4979-9299-157aff7472d2+8:2397:x1875420955899776:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 2256us (2629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541145.313319:0:9520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 95 00000100:00100000:3.0:1788541145.313919:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541145.314269:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955900032 00000100:00100000:1.0:1788541145.314279:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955900032 00000100:00100000:1.0:1788541145.314347:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 55 00000100:00100000:1.0:1788541145.314360:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+43:12417:x1875420955900032:12345-192.168.202.56@tcp:35:bash.0 00000100:00100000:1.0:1788541145.314616:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+44:12417:x1875420955900032:12345-192.168.202.56@tcp:35:bash.0 Request processed in 257us (697us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1788541145.314624:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 55 00000100:00100000:0.0:1788541145.379256:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541145.379305:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541145.379355:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541145.379386:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541145.379408:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541145.379421:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541145.379440:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541145.379467:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955900416 00000100:00100000:0.0:1788541145.379477:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955900416 00000100:00100000:0.0:1788541145.379532:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955900928 00000100:00100000:0.0:1788541145.379535:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955900928 00000100:00100000:0.0:1788541145.379549:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955900288 00000100:00100000:0.0:1788541145.379552:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955900288 00000100:00100000:0.0:1788541145.379562:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955900800 00000100:00100000:0.0:1788541145.379564:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955900800 00000100:00100000:0.0:1788541145.379582:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 339 00000100:00100000:0.0:1788541145.379591:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+5:2394:x1875420955900416:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541145.379695:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+5:2394:x1875420955900416:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 103us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541145.379702:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 339 00000100:00100000:0.0:1788541145.379718:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 340 00000100:00100000:0.0:1788541145.379723:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2394:x1875420955900928:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541145.379746:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2394:x1875420955900928:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 23us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541145.379752:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 340 00000100:00100000:0.0:1788541145.379772:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 341 00000100:00100000:0.0:1788541145.379778:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+44:2394:x1875420955900288:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541145.379804:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+44:2394:x1875420955900288:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 26us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541145.379809:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 341 00000100:00100000:0.0:1788541145.379820:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 342 00000100:00100000:0.0:1788541145.379827:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2394:x1875420955900800:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541145.379847:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2394:x1875420955900800:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 21us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541145.379853:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 342 00000100:00100000:2.0:1788541145.380089:0:8973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955900672 00000100:00100000:2.0:1788541145.380094:0:8973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955900672 00000100:00100000:2.0:1788541145.380130:0:8973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955900544 00000100:00100000:2.0:1788541145.380133:0:8973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955900544 00000100:00100000:2.0:1788541145.380152:0:8973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 127 00000100:00100000:2.0:1788541145.380159:0:8973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:384f52e3-0481-4979-9299-157aff7472d2+9:2394:x1875420955900672:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1788541145.380187:0:8973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:384f52e3-0481-4979-9299-157aff7472d2+9:2394:x1875420955900672:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 28us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541145.380200:0:8973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 127 00000100:00100000:2.0:1788541145.380213:0:8973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 128 00000100:00100000:2.0:1788541145.380233:0:8973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:384f52e3-0481-4979-9299-157aff7472d2+8:2394:x1875420955900544:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1788541145.380259:0:8973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:384f52e3-0481-4979-9299-157aff7472d2+8:2394:x1875420955900544:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 40us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541145.380265:0:8973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 128 00000100:00100000:3.0:1788541145.382303:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955900160 00000100:00100000:3.0:1788541145.382321:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955900160 00000100:00100000:3.0:1788541145.382422:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 393 00000100:00100000:3.0:1788541145.382435:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:2394:x1875420955900160:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541145.382522:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:2394:x1875420955900160:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 89us (3278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541145.382529:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 393 00000100:00080000:3.0:1788541145.382574:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788541145.382582:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788541145.466010:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541145.466598:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955901056 00000100:00100000:0.0:1788541145.466609:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955901056 00000100:00100000:0.0:1788541145.466686:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 217 00000100:00100000:0.0:1788541145.466697:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+44:12433:x1875420955901056:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1788541145.466718:0:12149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541145.466759:0:12149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a853c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331501 expref: -99 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.466827:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a8543 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.466842:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a8543 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.466853:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a8543 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541145.466918:0:12149:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788541145.466922:0:12149:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788541145.466940:0:12149:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a8543 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.466963:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a853c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331501 expref: 46 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.466983:0:12149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a8543 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331501 expref: 45 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.466992:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68350c0a00) 00010000:00010000:0.0:1788541145.466995:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788541145.466999:0:12149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75e600, rc 0) 00000100:00100000:0.0:1788541145.467074:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+45:12433:x1875420955901056:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 379us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541145.467081:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 217 00000100:00100000:3.0:1788541145.473612:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541145.473775:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955901312 00000100:00100000:1.0:1788541145.473785:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955901312 00000100:00100000:1.0:1788541145.473847:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 218 00000100:00100000:1.0:1788541145.473856:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+45:12433:x1875420955901312:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1788541145.473903:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541145.473927:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957600/0x2aac941e5f4a854a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331508 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.474064:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956a00/0x2aac941e5f4a8551 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.474078:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956a00/0x2aac941e5f4a8551 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.474090:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956a00/0x2aac941e5f4a8551 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788541145.474102:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788541145.474215:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957600/0x2aac941e5f4a854a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331508 expref: 48 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.474245:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956a00/0x2aac941e5f4a8551 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331508 expref: 47 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.474253:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a67078a1b00) 00010000:00010000:1.0:1788541145.474256:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788541145.474260:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6706956a00, rc 0) 00000100:00100000:1.0:1788541145.474485:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+47:12433:x1875420955901312:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 628us (882us total) trans 4294967486 rc 0/0 00000100:00100000:1.0:1788541145.474512:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 218 00000100:00100000:1.0:1788541145.484738:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541145.484797:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541145.484902:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955901696 00000100:00100000:3.0:1788541145.484913:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955901696 00000100:00100000:3.0:1788541145.484978:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 219 00000100:00100000:3.0:1788541145.484989:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708313480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+47:12433:x1875420955901696:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1788541145.485036:0:9339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541145.485082:0:9339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a855f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a33150f expref: -99 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.485203:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a8566 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.485229:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a8566 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.485242:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a8566 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541145.485256:0:9339:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788541145.485375:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a855f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33150f expref: 50 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.485395:0:9339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a8566 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33150f expref: 49 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.485405:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a67078a1b00) 00010000:00010000:3.0:1788541145.485408:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788541145.485411:0:9339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075aca00, rc 0) 00000100:00100000:3.0:1788541145.485483:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708313480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+49:12433:x1875420955901696:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 496us (685us total) trans 4294967487 rc 0/0 00000100:00100000:3.0:1788541145.485490:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 219 00000100:00100000:2.0:1788541145.486229:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955901440 00000100:00100000:2.0:1788541145.486237:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955901440 00000100:00100000:2.0:1788541145.486286:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 15 00000100:00100000:2.0:1788541145.486295:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68076e9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:384f52e3-0481-4979-9299-157aff7472d2+49:2397:x1875420955901440:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541145.486307:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541145.486325:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956a00/0x2aac941e5f4a8551 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331508 expref: 49 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541145.486340:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a67078a1b00) 00010000:00010000:2.0:1788541145.486344:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541145.486427:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68076e9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:384f52e3-0481-4979-9299-157aff7472d2+48:2397:x1875420955901440:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 132us (1698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541145.486434:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 15 00000100:00100000:1.0:1788541145.494107:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541145.494243:0:8973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955901824 00000100:00100000:2.0:1788541145.494257:0:8973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955901824 00000100:00100000:2.0:1788541145.494343:0:8973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 69 00000100:00100000:2.0:1788541145.494355:0:8973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708311500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:384f52e3-0481-4979-9299-157aff7472d2+8:2396:x1875420955901824:12345-192.168.202.56@tcp:1:lfs.0 00010000:00010000:2.0:1788541145.494407:0:8973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003ed1e60/0x2aac941e5f4a8574 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541145.494446:0:8973:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000001974258/0x2aac941e5f4a8535 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xa16473202a3314fa expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541145.494456:0:8973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541145.494460:0:8973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788541145.494466:0:8973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003ed1e60/0x2aac941e5f4a8574 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541145.494509:0:8973:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000001974258/0x2aac941e5f4a8535 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xa16473202a3314fa expref: 8 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541145.494523:0:8973:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000001974258/0x2aac941e5f4a8535 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a3314fa expref: 8 pid: 8432 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541145.494538:0:8973:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078eed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8973:1875420981122176:192.168.202.56@tcp:104: 00000100:00100000:2.0:1788541145.494634:0:8973:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6835519cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788541145.497724:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541145.497827:0:8973:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078eed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8973:1875420981122176:192.168.202.56@tcp:104: 00010000:00010000:2.0:1788541145.497853:0:8973:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000003ed1e60/0x2aac941e5f4a8574 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541145.497975:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955901952 00000100:00100000:0.0:1788541145.497995:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955901952 00002000:00100000:0.0:1788541145.498037:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9a6708313800 x1875420955901952/t0(0) o4->384f52e3-0481-4979-9299-157aff7472d2@192.168.202.56@tcp:516/0 lens 504/0 e 0 to 0 dl 1788541156 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788541145.498058:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6708313800 with x1875420955901952 ext(0->8) 00010000:00010000:0.0:1788541145.498067:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000001974258/0x2aac941e5f4a8535 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a3314fa expref: 9 pid: 8432 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.498082:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000001974258/0x2aac941e5f4a8535 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a3314fa expref: 9 pid: 8432 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788541145.498089:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a6708313800 00000100:00100000:0.0:1788541145.498122:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 3 00000100:00100000:0.0:1788541145.498131:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708313800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:384f52e3-0481-4979-9299-157aff7472d2+9:2396:x1875420955901952:12345-192.168.202.56@tcp:4:lfs.0 00000100:00100000:2.0:1788541145.499842:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708313800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:384f52e3-0481-4979-9299-157aff7472d2+11:2396:x1875420955901952:12345-192.168.202.56@tcp:4:lfs.0 Request processed in 1702us (2118us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788541145.499855:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 3 00002000:00100000:2.0:1788541145.499866:0:8435:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9a6708313800 x1875420955901952/t4294967309(0) o4->384f52e3-0481-4979-9299-157aff7472d2@192.168.202.56@tcp:516/0 lens 504/448 e 0 to 0 dl 1788541156 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788541145.499900:0:8435:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6708313800 with x1875420955901952 ext(0->8) 00010000:00010000:2.0:1788541145.499909:0:8435:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000001974258/0x2aac941e5f4a8535 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a3314fa expref: 11 pid: 8432 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541145.499925:0:8435:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000001974258/0x2aac941e5f4a8535 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a3314fa expref: 11 pid: 8432 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788541145.499932:0:8435:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a6708313800 00000001:00080000:2.0:1788541145.500915:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:2.0:1788541145.500929:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:1.0:1788541145.504410:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541145.504516:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955902080 00000100:00100000:2.0:1788541145.504529:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955902080 00010000:00010000:2.0:1788541145.504581:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000001974258/0x2aac941e5f4a8535 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a3314fa expref: 7 pid: 8432 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541145.504631:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 96 00000100:00100000:2.0:1788541145.504641:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708312680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:384f52e3-0481-4979-9299-157aff7472d2+7:2396:x1875420955902080:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541145.504658:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788541145.504681:0:6504:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788541145.504684:0:6504:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788541145 00002000:00010000:2.0:1788541145.504686:0:6504:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788541145 00002000:00010000:2.0:1788541145.504687:0:6504:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1788541145 00002000:00010000:2.0:1788541145.504690:0:6504:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788541145.504695:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000001974258/0x2aac941e5f4a8535 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a3314fa expref: 7 pid: 8432 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541145.504732:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000001974258/0x2aac941e5f4a8535 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a3314fa expref: 7 pid: 8432 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541145.504772:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001974258/0x2aac941e5f4a8535 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a3314fa expref: 7 pid: 8432 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541145.504791:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788541145.504796:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788541145.504802:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000003ed1e60/0x2aac941e5f4a8574 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541145.504812:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003ed1e60/0x2aac941e5f4a8574 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541145.504845:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541145.504945:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708312680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:384f52e3-0481-4979-9299-157aff7472d2+6:2396:x1875420955902080:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 305us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541145.504953:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 96 00010000:00010000:0.0:1788541145.506019:0:8973:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000003ed1e60/0x2aac941e5f4a8574 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.506034:0:8973:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003ed1e60/0x2aac941e5f4a8574 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.506071:0:8973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003ed1e60/0x2aac941e5f4a8574 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.506080:0:8973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003ed1e60/0x2aac941e5f4a8574 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.506089:0:8973:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003ed1e60/0x2aac941e5f4a8574 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.506109:0:8973:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551b200 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788541145.506114:0:8973:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003ed1e60/0x2aac941e5f4a8574 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.506124:0:8973:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003ed1e60/0x2aac941e5f4a8574 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.506140:0:8973:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003ed1e60/0x2aac941e5f4a8574 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.506148:0:8973:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003ed1e60/0x2aac941e5f4a8574 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541145.506234:0:8973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708311500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:384f52e3-0481-4979-9299-157aff7472d2+5:2396:x1875420955901824:12345-192.168.202.56@tcp:1:lfs.0 Request processed in 11878us (12139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541145.506243:0:8973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 69 00000100:00100000:1.0:1788541145.509732:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541145.509823:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955902336 00000100:00100000:0.0:1788541145.509835:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955902336 00000100:00100000:0.0:1788541145.509939:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 56 00000100:00100000:0.0:1788541145.509950:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6811403050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+48:12433:x1875420955902336:12345-192.168.202.56@tcp:35:lfs.0 00000004:00010000:0.0:1788541145.510017:0:6520:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a8566 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33150f expref: 48 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788541145.510214:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:0.0:1788541145.510285:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1788541145.510982:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:0.0:1788541145.511021:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a857b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.511049:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a8520 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3314ec expref: 52 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.511058:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a857b lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.511095:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a8520 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3314ec expref: 52 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.511110:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a8520 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3314ec expref: 52 pid: 6518 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541145.511124:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6520:1875420981122304:192.168.202.56@tcp:104: 00000100:00100000:0.0:1788541145.511212:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068fd3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788541145.514323:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541145.514426:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6520:1875420981122304:192.168.202.56@tcp:104: 00010000:00010000:0.0:1788541145.514455:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a857b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541145.514521:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955902464 00000100:00100000:3.0:1788541145.514529:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955902464 00010000:00010000:3.0:1788541145.514573:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a8520 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3314ec expref: 53 pid: 6518 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541145.514628:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 97 00000100:00100000:3.0:1788541145.514640:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:384f52e3-0481-4979-9299-157aff7472d2+53:2396:x1875420955902464:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541145.514655:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541145.514663:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a8520 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3314ec expref: 53 pid: 6518 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.514674:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a8520 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3314ec expref: 53 pid: 6518 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.514695:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a8520 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3314ec expref: 53 pid: 6518 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.514711:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a67078a1b00) 00010000:00010000:3.0:1788541145.514716:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a857b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.514727:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a857b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.514735:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a857b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.514777:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541145.514832:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:384f52e3-0481-4979-9299-157aff7472d2+52:2396:x1875420955902464:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 194us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541145.514839:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 97 00010000:00010000:1.0:1788541145.514909:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a857b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.514916:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a857b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788541145.515021:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:1.0:1788541145.515144:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:1.0:1788541145.515246:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708310000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6520:1875420981122432:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788541145.515295:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541145.515327:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67079a7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788541145.515627:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981122432 00000100:00100000:3.0:1788541145.515642:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981122432 00000100:00100000:3.0:1788541145.515688:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788541145.515695:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708311880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6520:x1875420981122432:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788541145.515784:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708311880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6520:x1875420981122432:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 88us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541145.515791:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00080000:0.0:1788541145.515855:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788541145.516016:0:6520:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:1.0:1788541145.516022:0:6520:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:1.0:1788541145.516048:0:6520:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a68355b6680, transno 4294967308 00000100:00100000:1.0:1788541145.516064:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708310000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6520:1875420981122432:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788541145.516171:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:1.0:1788541145.516229:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708310000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6520:1875420981122560:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788541145.516256:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541145.516273:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67079a79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788541145.516521:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981122560 00000100:00100000:0.0:1788541145.516526:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981122560 00000100:00100000:0.0:1788541145.516562:0:10866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788541145.516569:0:10866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708313b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6520:x1875420981122560:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788541145.516684:0:10866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708313b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6520:x1875420981122560:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 115us (426us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788541145.516704:0:10866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788541145.517667:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708310000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6520:1875420981122560:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788541145.517732:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:1.0:1788541145.517782:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a857b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.517793:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a857b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.517800:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a857b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.517805:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75ee00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541145.517810:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a857b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.517818:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a857b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.517833:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a67078a1b00) 00010000:00010000:1.0:1788541145.517836:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788541145.517841:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a857b lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.517848:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a857b lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788541145.517975:0:6520:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788541145.518029:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:1.0:1788541145.518041:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 426436170315ns, next at 427436168277ns, rc = 0 00000001:00080000:1.0:1788541145.518059:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:1.0:1788541145.518083:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a67078a1b00) 00010000:00010000:1.0:1788541145.518086:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788541145.518100:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a8566 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33150f expref: 56 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541145.518216:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6811403050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+55:12433:x1875420955902336:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 8267us (8494us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1788541145.518234:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 56 00000020:00080000:1.0:1788541145.518238:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788541145.526354:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541145.526448:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955902592 00000100:00100000:0.0:1788541145.526458:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955902592 00000100:00100000:0.0:1788541145.526520:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 220 00000100:00100000:0.0:1788541145.526531:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+55:12433:x1875420955902592:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1788541145.526558:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541145.526580:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a8582 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331516 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.526641:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a8582 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331516 expref: 56 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.526656:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a8582 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331516 expref: 56 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.526674:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a67078a1500) 00010000:00010000:0.0:1788541145.526677:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788541145.526680:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75ec00, rc 0) 00000100:00100000:0.0:1788541145.526741:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+56:12433:x1875420955902592:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 211us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541145.526748:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 220 00000100:00100000:2.0:1788541145.529365:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541145.529448:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955902848 00000100:00100000:3.0:1788541145.529459:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955902848 00000100:00100000:3.0:1788541145.529516:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 57 00000100:00100000:3.0:1788541145.529527:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+56:12433:x1875420955902848:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:3.0:1788541145.529748:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+57:12433:x1875420955902848:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 222us (392us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1788541145.529756:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 57 00000100:00100000:2.0:1788541145.617743:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541145.617849:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955902976 00000100:00100000:1.0:1788541145.617862:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955902976 00000100:00100000:1.0:1788541145.617970:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 221 00000100:00100000:1.0:1788541145.617981:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+57:12443:x1875420955902976:12345-192.168.202.56@tcp:34:lfs.0 00010000:00010000:1.0:1788541145.618077:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956000/0x2aac941e5f4a8589 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.618098:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956000/0x2aac941e5f4a8589 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.618111:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956000/0x2aac941e5f4a8589 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.618123:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957400/0x2aac941e5f4a8590 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.618130:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957400/0x2aac941e5f4a8590 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.618136:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957400/0x2aac941e5f4a8590 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.618213:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957a00/0x2aac941e5f4a8597 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.618271:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957a00/0x2aac941e5f4a8597 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.618278:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957a00/0x2aac941e5f4a8597 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788541145.618327:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957a00/0x2aac941e5f4a8597 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.618339:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956000/0x2aac941e5f4a8589 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.618346:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956000/0x2aac941e5f4a8589 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.618353:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956000/0x2aac941e5f4a8589 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.618358:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706956000 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541145.618362:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956000/0x2aac941e5f4a8589 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.618370:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956000/0x2aac941e5f4a8589 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.618381:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68350c0a00) 00010000:00010000:1.0:1788541145.618384:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541145.618389:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956000/0x2aac941e5f4a8589 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.618395:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956000/0x2aac941e5f4a8589 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.618415:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957400/0x2aac941e5f4a8590 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.618421:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957400/0x2aac941e5f4a8590 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.618427:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957400/0x2aac941e5f4a8590 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.618432:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706957400 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541145.618435:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957400/0x2aac941e5f4a8590 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.618441:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957400/0x2aac941e5f4a8590 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.618448:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a67078a1c00) 00010000:00010000:1.0:1788541145.618451:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541145.618454:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957400/0x2aac941e5f4a8590 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.618459:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957400/0x2aac941e5f4a8590 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.618469:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957a00/0x2aac941e5f4a8597 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.618475:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957a00/0x2aac941e5f4a8597 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.618480:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957a00/0x2aac941e5f4a8597 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.618491:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706957a00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541145.618495:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957a00/0x2aac941e5f4a8597 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.618500:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957a00/0x2aac941e5f4a8597 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.618509:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a67078a1500) 00010000:00010000:1.0:1788541145.618513:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541145.618516:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957a00/0x2aac941e5f4a8597 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.618521:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957a00/0x2aac941e5f4a8597 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541145.618597:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+57:12443:x1875420955902976:12345-192.168.202.56@tcp:34:lfs.0 Request processed in 618us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541145.618605:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 221 00000100:00100000:2.0:1788541145.656735:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541145.656846:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955903232 00000100:00100000:0.0:1788541145.656856:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955903232 00000100:00100000:0.0:1788541145.656946:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 222 00000100:00100000:0.0:1788541145.656957:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+57:12446:x1875420955903232:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1788541145.656978:0:12149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541145.657018:0:12149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a859e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a33151d expref: -99 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.657112:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a85a5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.657129:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a85a5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.657142:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a85a5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.657154:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a85ac lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.657162:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a85ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.657169:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a85ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.657289:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a85b3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.657310:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a85b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.657318:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a85b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541145.657329:0:12149:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788541145.657411:0:12149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a85a5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.657430:0:12149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a85a5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.657437:0:12149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a85a5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.657443:0:12149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75fe00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541145.657447:0:12149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a85a5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.657456:0:12149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a85a5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.657470:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68350c0a00) 00010000:00010000:0.0:1788541145.657473:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541145.657480:0:12149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a85a5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.657485:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a85a5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.657501:0:12149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a85ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.657506:0:12149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a85ac lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.657511:0:12149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a85ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.657516:0:12149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75f200 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541145.657525:0:12149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a85ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.657530:0:12149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a85ac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.657538:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a67078a1c00) 00010000:00010000:0.0:1788541145.657541:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541145.657544:0:12149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a85ac lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.657549:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a85ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.657587:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a859e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33151d expref: 60 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.657601:0:12149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a85b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33151d expref: 59 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.657607:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a67078a1500) 00010000:00010000:0.0:1788541145.657610:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788541145.657612:0:12149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6842172000, rc 0) 00000100:00100000:0.0:1788541145.657682:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+59:12446:x1875420955903232:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 726us (956us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1788541145.657689:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 222 00000100:00100000:2.0:1788541145.664676:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541145.664776:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955903360 00000100:00100000:3.0:1788541145.664788:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955903360 00000100:00100000:3.0:1788541145.664849:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 223 00000100:00100000:3.0:1788541145.664861:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6814a80450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+59:12446:x1875420955903360:12345-192.168.202.56@tcp:54:lfs.0 00010000:00010000:3.0:1788541145.664965:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a85c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.664983:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a85c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.664996:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a85c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.665034:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a85c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.665072:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a85c1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.665079:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a85c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.665085:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075adc00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541145.665090:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a85c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.665098:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a85c1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.665110:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a67078a1500) 00010000:00010000:3.0:1788541145.665112:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788541145.665118:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a85c1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.665123:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a85c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541145.665202:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6814a80450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+59:12446:x1875420955903360:12345-192.168.202.56@tcp:54:lfs.0 Request processed in 343us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541145.665210:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 223 00000100:00100000:1.0:1788541145.670452:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541145.670540:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955903616 00000100:00100000:3.0:1788541145.670550:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955903616 00000100:00100000:3.0:1788541145.670643:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 58 00000100:00100000:3.0:1788541145.670655:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708313100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+59:12446:x1875420955903616:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:3.0:1788541145.670940:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708313100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+60:12446:x1875420955903616:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 287us (497us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1788541145.670959:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 58 00010000:00010000:0.0:1788541145.676005:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541145.739139:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541145.739328:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955903872 00000100:00100000:3.0:1788541145.739338:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955903872 00000100:00100000:3.0:1788541145.739410:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 224 00000100:00100000:3.0:1788541145.739421:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+60:12456:x1875420955903872:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:3.0:1788541145.739450:0:9339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541145.739453:0:9339:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788541145.739484:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a8543 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331501 expref: 60 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.739505:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68350c0a00) 00010000:00010000:3.0:1788541145.739512:0:9339:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788541145.739530:0:9339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a85c8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331524 expref: -99 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.739654:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a85cf lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.739668:0:9339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a85b3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33151d expref: 60 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.739676:0:9339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a85cf lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.739713:0:9339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a85b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33151d expref: 60 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.739727:0:9339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a85b3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33151d expref: 60 pid: 12149 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541145.739749:0:9339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708836300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9339:1875420981122688:192.168.202.56@tcp:104: 00000100:00100000:3.0:1788541145.739916:0:9339:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683572bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788541145.742818:0:9339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708836300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9339:1875420981122688:192.168.202.56@tcp:104: 00010000:00010000:3.0:1788541145.742845:0:9339:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a85cf lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541145.744198:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541145.744375:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955904000 00000100:00100000:1.0:1788541145.744384:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955904000 00010000:00010000:1.0:1788541145.744425:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a85b3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33151d expref: 61 pid: 12149 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541145.744467:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 98 00000100:00100000:1.0:1788541145.744477:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:384f52e3-0481-4979-9299-157aff7472d2+61:2396:x1875420955904000:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788541145.744491:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541145.744498:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a85b3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33151d expref: 61 pid: 12149 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.744524:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a85b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33151d expref: 61 pid: 12149 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.744546:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a85b3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33151d expref: 61 pid: 12149 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.744561:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a67078a1500) 00010000:00010000:1.0:1788541145.744567:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a85cf lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.744576:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a85cf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.744583:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a85cf lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.744613:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788541145.744671:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:384f52e3-0481-4979-9299-157aff7472d2+60:2396:x1875420955904000:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 195us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541145.744678:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 98 00010000:00010000:0.0:1788541145.744778:0:9339:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a85cf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.744796:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a85cf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541145.744817:0:9339:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788541145.744981:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a85c8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331524 expref: 61 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.744997:0:9339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a85cf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331524 expref: 60 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.745004:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a67078a1500) 00010000:00010000:0.0:1788541145.745007:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788541145.745010:0:9339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075ad800, rc 0) 00000100:00100000:0.0:1788541145.745036:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+60:12456:x1875420955903872:12345-192.168.202.56@tcp:101:bash.0 Request processed in 5618us (5907us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1788541145.745043:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 224 00000100:00100000:2.0:1788541145.750937:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541145.751105:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955904128 00000100:00100000:0.0:1788541145.751116:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955904128 00000100:00100000:0.0:1788541145.751178:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 225 00000100:00100000:0.0:1788541145.751188:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+60:12456:x1875420955904128:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:0.0:1788541145.751213:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541145.751245:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a85dd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a33152b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.751280:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a85e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.751315:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a85e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.751328:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a85e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.751436:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a85dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33152b expref: 62 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.751453:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a85e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33152b expref: 61 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.751462:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a67078a1500) 00010000:00010000:0.0:1788541145.751464:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788541145.751468:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6842172000, rc 0) 00000100:00100000:0.0:1788541145.751533:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+61:12456:x1875420955904128:12345-192.168.202.56@tcp:101:bash.0 Request processed in 347us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541145.751540:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 225 00000100:00100000:2.0:1788541145.754549:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541145.754636:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955904384 00000100:00100000:3.0:1788541145.754646:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955904384 00000100:00100000:3.0:1788541145.754701:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 226 00000100:00100000:3.0:1788541145.754711:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+61:12456:x1875420955904384:12345-192.168.202.56@tcp:36:bash.0 00010000:00010000:3.0:1788541145.754981:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a85eb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.754998:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a85eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.755009:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a85eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788541145.755050:0:6517:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:3.0:1788541145.755073:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006ffcc3d1 reply state 0000000095e4633a transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a85eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.755086:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a85eb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.755093:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a67078a1500) 00010000:00010000:3.0:1788541145.755096:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788541145.755115:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788541145.755232:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+64:12456:x1875420955904384:12345-192.168.202.56@tcp:36:bash.0 Request processed in 522us (695us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1788541145.755240:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 226 00000020:00080000:3.0:1788541145.755245:0:6517:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788541145.758058:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541145.758143:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955904512 00000100:00100000:0.0:1788541145.758153:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955904512 00000100:00100000:0.0:1788541145.758213:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 227 00000100:00100000:0.0:1788541145.758233:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+64:12456:x1875420955904512:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:0.0:1788541145.758258:0:9339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541145.758279:0:9339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a85f2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331532 expref: -99 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.758376:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a85f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.758404:0:9339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a85cf lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331524 expref: 65 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.758414:0:9339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a85f9 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.758449:0:9339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a85cf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331524 expref: 65 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.758463:0:9339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a85cf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331524 expref: 65 pid: 9339 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541145.758478:0:9339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9339:1875420981122816:192.168.202.56@tcp:104: 00000100:00100000:0.0:1788541145.758572:0:9339:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068fd000 going to sleep for 11 seconds 00000100:00100000:0.0:1788541145.762468:0:9339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9339:1875420981122816:192.168.202.56@tcp:104: 00010000:00010000:0.0:1788541145.762507:0:9339:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a85f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541145.762580:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541145.762662:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955904640 00000100:00100000:3.0:1788541145.762669:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955904640 00010000:00010000:3.0:1788541145.762710:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a85cf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331524 expref: 66 pid: 9339 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541145.762790:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 99 00000100:00100000:3.0:1788541145.762800:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:384f52e3-0481-4979-9299-157aff7472d2+66:2397:x1875420955904640:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541145.762814:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541145.762821:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a85cf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331524 expref: 66 pid: 9339 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.762834:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a85cf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331524 expref: 66 pid: 9339 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.762854:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a85cf lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331524 expref: 66 pid: 9339 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.762951:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a67078a1500) 00010000:00010000:3.0:1788541145.762957:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a85f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.762968:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a85f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.762997:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a85f9 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.763020:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541145.763088:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:384f52e3-0481-4979-9299-157aff7472d2+65:2397:x1875420955904640:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 289us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541145.763096:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 99 00010000:00010000:1.0:1788541145.763153:0:9339:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a85f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.763159:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a85f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788541145.763223:0:9339:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788541145.763227:0:9339:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788541145.763248:0:9339:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a85f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.763289:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173800/0x2aac941e5f4a85f2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331532 expref: 65 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.763316:0:9339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a85f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331532 expref: 64 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541145.763324:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a67078a1500) 00010000:00010000:1.0:1788541145.763327:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788541145.763330:0:9339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75e600, rc 0) 00000100:00100000:1.0:1788541145.763356:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+64:12456:x1875420955904512:12345-192.168.202.56@tcp:101:bash.0 Request processed in 5126us (5320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541145.763363:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 227 00000100:00100000:1.0:1788541145.767180:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541145.767372:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955904896 00000100:00100000:2.0:1788541145.767383:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955904896 00000100:00100000:2.0:1788541145.767440:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 59 00000100:00100000:2.0:1788541145.767451:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708310700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+64:12456:x1875420955904896:12345-192.168.202.56@tcp:35:bash.0 00000100:00100000:2.0:1788541145.767701:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708310700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+65:12456:x1875420955904896:12345-192.168.202.56@tcp:35:bash.0 Request processed in 251us (533us total) trans 4294967503 rc 0/0 00000100:00100000:2.0:1788541145.767709:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 59 00000100:00100000:1.0:1788541145.825419:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541145.825520:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955905024 00000100:00100000:2.0:1788541145.825530:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955905024 00000100:00100000:2.0:1788541145.825590:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 228 00000100:00100000:2.0:1788541145.825601:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708311f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+65:12462:x1875420955905024:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1788541145.825628:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541145.825649:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a8600 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331539 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541145.825714:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a8607 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541145.825729:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a8607 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541145.825742:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a8607 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541145.825811:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788541145.825815:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788541145.825835:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a8607 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541145.825861:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a8600 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331539 expref: 67 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541145.825917:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a8607 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331539 expref: 66 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541145.825926:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68350c0a00) 00010000:00010000:2.0:1788541145.825929:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788541145.825933:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a683551b600, rc 0) 00000100:00100000:2.0:1788541145.825999:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708311f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+66:12462:x1875420955905024:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 400us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541145.826006:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 228 00000100:00100000:1.0:1788541145.830116:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541145.830271:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955905152 00000100:00100000:0.0:1788541145.830282:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955905152 00000100:00100000:0.0:1788541145.830356:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 229 00000100:00100000:0.0:1788541145.830366:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708312300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+66:12462:x1875420955905152:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1788541145.830386:0:12149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541145.830407:0:12149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a860e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331540 expref: -99 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.830475:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a8615 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.830507:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a8615 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.830520:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a8615 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.830532:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a861c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.830539:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a861c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.830545:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a861c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.830616:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031c00/0x2aac941e5f4a8623 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.830625:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031c00/0x2aac941e5f4a8623 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.830632:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031c00/0x2aac941e5f4a8623 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541145.830671:0:12149:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788541145.830675:0:12149:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788541145.830693:0:12149:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031c00/0x2aac941e5f4a8623 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.830705:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031c00/0x2aac941e5f4a8623 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.830722:0:12149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a8615 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.830729:0:12149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a8615 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.830735:0:12149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a8615 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.830740:0:12149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75f200 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541145.830744:0:12149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a8615 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.830751:0:12149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a8615 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.830761:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68350c0a00) 00010000:00010000:0.0:1788541145.830764:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541145.830768:0:12149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a8615 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.830774:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f200/0x2aac941e5f4a8615 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.830787:0:12149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a861c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.830794:0:12149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a861c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.830798:0:12149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a861c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.830809:0:12149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75fe00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541145.830812:0:12149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a861c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.830817:0:12149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a861c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.830825:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a67078a1c00) 00010000:00010000:0.0:1788541145.830827:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541145.830830:0:12149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a861c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.830835:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fe00/0x2aac941e5f4a861c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.830860:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a860e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331540 expref: 68 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.830922:0:12149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031c00/0x2aac941e5f4a8623 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331540 expref: 67 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.830929:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a67078a1500) 00010000:00010000:0.0:1788541145.830931:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788541145.830935:0:12149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6800031c00, rc 0) 00000100:00100000:0.0:1788541145.830986:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708312300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+67:12462:x1875420955905152:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 622us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541145.830994:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 229 00000100:00100000:1.0:1788541145.835432:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541145.835470:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541145.835544:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955905536 00000100:00100000:2.0:1788541145.835553:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955905536 00000100:00100000:2.0:1788541145.835612:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 16 00000100:00100000:2.0:1788541145.835621:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708313480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:384f52e3-0481-4979-9299-157aff7472d2+67:2397:x1875420955905536:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541145.835637:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541145.835660:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031c00/0x2aac941e5f4a8623 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331540 expref: 67 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541145.835679:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a67078a1500) 00010000:00010000:2.0:1788541145.835695:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541145.835743:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708313480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:384f52e3-0481-4979-9299-157aff7472d2+66:2397:x1875420955905536:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 123us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541145.835750:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 16 00000100:00100000:0.0:1788541145.835841:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955905408 00000100:00100000:0.0:1788541145.835852:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955905408 00000100:00100000:0.0:1788541145.835919:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 230 00000100:00100000:0.0:1788541145.835926:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708310380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+66:12462:x1875420955905408:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1788541145.835941:0:9339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541145.835956:0:9339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031e00/0x2aac941e5f4a862a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331547 expref: -99 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.836059:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031600/0x2aac941e5f4a8631 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.836072:0:9339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a85f9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331532 expref: 67 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.836080:0:9339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031600/0x2aac941e5f4a8631 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.836112:0:9339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a85f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331532 expref: 67 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.836125:0:9339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a85f9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331532 expref: 67 pid: 9339 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541145.836138:0:9339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9339:1875420981122944:192.168.202.56@tcp:104: 00000100:00100000:0.0:1788541145.836184:0:9339:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068fd000 going to sleep for 11 seconds 00000100:00100000:1.0:1788541145.839749:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541145.839855:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955905664 00000100:00100000:3.0:1788541145.839866:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955905664 00010000:00010000:3.0:1788541145.839966:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a85f9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331532 expref: 68 pid: 9339 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541145.840004:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 100 00000100:00100000:3.0:1788541145.840015:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708312d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:384f52e3-0481-4979-9299-157aff7472d2+68:2396:x1875420955905664:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541145.840030:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541145.840050:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a85f9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331532 expref: 68 pid: 9339 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.840063:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a85f9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331532 expref: 68 pid: 9339 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.840088:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a67078a1500) 00010000:00010000:3.0:1788541145.840094:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031600/0x2aac941e5f4a8631 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.840105:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031600/0x2aac941e5f4a8631 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.840131:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031600/0x2aac941e5f4a8631 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.840152:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541145.840208:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708312d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:384f52e3-0481-4979-9299-157aff7472d2+68:2396:x1875420955905664:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 195us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541145.840225:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 100 00010000:00010000:0.0:1788541145.841610:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a85f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331532 expref: 67 pid: 9339 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541145.841631:0:9339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9339:1875420981122944:192.168.202.56@tcp:104: 00010000:00010000:0.0:1788541145.841672:0:9339:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031600/0x2aac941e5f4a8631 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.841682:0:9339:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031600/0x2aac941e5f4a8631 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.841688:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031600/0x2aac941e5f4a8631 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541145.841710:0:9339:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788541145.841850:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031e00/0x2aac941e5f4a862a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331547 expref: 68 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.841898:0:9339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031600/0x2aac941e5f4a8631 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331547 expref: 67 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541145.841909:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a67078a1500) 00010000:00010000:0.0:1788541145.841912:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788541145.841915:0:9339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6800031600, rc 0) 00000100:00100000:0.0:1788541145.841972:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708310380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+67:12462:x1875420955905408:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 6046us (6548us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1788541145.841981:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 230 00000100:00100000:1.0:1788541145.845985:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541145.846095:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955905920 00000100:00100000:2.0:1788541145.846104:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955905920 00000100:00100000:2.0:1788541145.846174:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 17 00000100:00100000:2.0:1788541145.846183:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68076e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:384f52e3-0481-4979-9299-157aff7472d2+67:12462:x1875420955905920:12345-192.168.202.56@tcp:103:lfs.0 00010000:00010000:2.0:1788541145.846199:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541145.846233:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a8582 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331516 expref: 67 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541145.846251:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a67078a1500) 00010000:00010000:2.0:1788541145.846256:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541145.846315:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68076e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:384f52e3-0481-4979-9299-157aff7472d2+66:12462:x1875420955905920:12345-192.168.202.56@tcp:103:lfs.0 Request processed in 133us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541145.846323:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 17 00000100:00100000:2.0:1788541145.848740:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541145.848822:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955906048 00000100:00100000:3.0:1788541145.848831:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955906048 00000100:00100000:3.0:1788541145.848923:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 231 00000100:00100000:3.0:1788541145.848933:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+66:12462:x1875420955906048:12345-192.168.202.56@tcp:58:lfs.0 00010000:00010000:3.0:1788541145.849036:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a863f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.849064:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a863f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541145.849076:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a863f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788541145.849174:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1788541145.849260:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+66:12462:x1875420955906048:12345-192.168.202.56@tcp:58:lfs.0 Request processed in 328us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541145.849269:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 231 00000100:00100000:1.0:1788541145.852062:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541145.852173:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955906176 00000100:00100000:2.0:1788541145.852183:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955906176 00000100:00100000:2.0:1788541145.852248:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 232 00000100:00100000:2.0:1788541145.852258:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708312680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+66:12462:x1875420955906176:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1788541145.852278:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541145.852308:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a8646 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a33154e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541145.852365:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a863f lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541145.852391:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a8646 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33154e expref: 67 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541145.852411:0:6518:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a863f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541145.852425:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a8646 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33154e expref: 67 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541145.852438:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a67078a1500) 00010000:00010000:2.0:1788541145.852440:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788541145.852444:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a8646 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33154e expref: 67 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541145.852451:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a683551a000, rc 0) 00000100:00100000:2.0:1788541145.852512:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708312680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+67:12462:x1875420955906176:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 255us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541145.852519:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 232 00000040:00080000:2.0:1788541146.122126:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788541146.122135:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788541146.122160:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1788541146.122168:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788541146.122310:0:13798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67082f8e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1875420981123072:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788541146.122410:0:13798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6835519f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788541146.128038:0:13798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67082f8e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1875420981123072:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788541146.134935:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541146.135234:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955906304 00000100:00100000:0.0:1788541146.135248:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955906304 00000100:00100000:0.0:1788541146.135338:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 233 00000100:00100000:0.0:1788541146.135348:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+67:12463:x1875420955906304:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788541146.135388:0:9339:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788541146.135534:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+67:12463:x1875420955906304:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 187us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541146.135559:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 233 00000100:00080000:3.0:1788541146.135989:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788541146.144998:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541146.145273:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955906432 00000100:00100000:0.0:1788541146.145284:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955906432 00000100:00100000:0.0:1788541146.145374:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 234 00000100:00100000:0.0:1788541146.145384:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708313480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+67:12463:x1875420955906432:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788541146.145462:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030a00/0x2aac941e5f4a864d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.145480:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030a00/0x2aac941e5f4a864d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.145494:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030a00/0x2aac941e5f4a864d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.145585:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030400/0x2aac941e5f4a8654 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.145594:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030400/0x2aac941e5f4a8654 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.145602:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030400/0x2aac941e5f4a8654 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.145627:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031e00/0x2aac941e5f4a865b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.145636:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031e00/0x2aac941e5f4a865b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.145642:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031e00/0x2aac941e5f4a865b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541146.145703:0:12149:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788541146.145707:0:12149:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788541146.145721:0:12149:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031e00/0x2aac941e5f4a865b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.145731:0:12149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030a00/0x2aac941e5f4a864d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.145738:0:12149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030a00/0x2aac941e5f4a864d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.145745:0:12149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030a00/0x2aac941e5f4a864d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.145751:0:12149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6800030a00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541146.145756:0:12149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030a00/0x2aac941e5f4a864d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.145763:0:12149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030a00/0x2aac941e5f4a864d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.147463:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a68350c0d00) 00010000:00010000:0.0:1788541146.147473:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541146.147482:0:12149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030a00/0x2aac941e5f4a864d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.147491:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030a00/0x2aac941e5f4a864d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.147860:0:12149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030400/0x2aac941e5f4a8654 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.151042:0:12149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030400/0x2aac941e5f4a8654 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.151054:0:12149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030400/0x2aac941e5f4a8654 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.151061:0:12149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6800030400 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541146.151067:0:12149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030400/0x2aac941e5f4a8654 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.151079:0:12149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030400/0x2aac941e5f4a8654 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.151098:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff9a67078a1100) 00010000:00010000:0.0:1788541146.151101:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541146.151107:0:12149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030400/0x2aac941e5f4a8654 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.151115:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030400/0x2aac941e5f4a8654 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.151148:0:12149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031e00/0x2aac941e5f4a865b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.151155:0:12149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031e00/0x2aac941e5f4a865b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.151161:0:12149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031e00/0x2aac941e5f4a865b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.151166:0:12149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6800031e00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541146.151175:0:12149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031e00/0x2aac941e5f4a865b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.151194:0:12149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031e00/0x2aac941e5f4a865b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.151204:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a67078a1500) 00010000:00010000:0.0:1788541146.151206:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541146.151209:0:12149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031e00/0x2aac941e5f4a865b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.151224:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031e00/0x2aac941e5f4a865b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541146.151568:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708313480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+67:12463:x1875420955906432:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 Request processed in 6180us (6574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541146.151579:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 234 00000100:00100000:2.0:1788541146.158764:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541146.161141:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955906688 00000100:00100000:1.0:1788541146.161162:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955906688 00000100:00100000:1.0:1788541146.161290:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 235 00000100:00100000:1.0:1788541146.161301:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+67:12463:x1875420955906688:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788541146.161323:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541146.161360:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8662 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331555 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.161463:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a8669 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.161480:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a8669 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.161492:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a8669 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788541146.161636:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788541146.161732:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a8669 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.161741:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a8669 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.161747:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a8669 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.161752:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706957e00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541146.161757:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a8669 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.161765:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a8669 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.161786:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a67078a1500) 00010000:00010000:1.0:1788541146.161789:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788541146.161794:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a8669 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.161811:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a8669 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.161854:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8662 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331555 expref: 69 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.161866:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a68350c0d00) 00010000:00010000:1.0:1788541146.161868:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788541146.161916:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8662 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331555 expref: 69 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.161925:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6706956c00, rc 0) 00000100:00100000:1.0:1788541146.161998:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+68:12463:x1875420955906688:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 698us (3245us total) trans 4294967505 rc 301/301 00000100:00100000:1.0:1788541146.162005:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 235 00000100:00100000:2.0:1788541146.165475:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541146.165621:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955906816 00000100:00100000:1.0:1788541146.165633:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955906816 00000100:00100000:1.0:1788541146.165697:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 236 00000100:00100000:1.0:1788541146.165708:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+68:12463:x1875420955906816:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788541146.165747:0:6517:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788541146.165909:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+68:12463:x1875420955906816:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 201us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541146.165917:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 236 00000100:00100000:2.0:1788541146.170181:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541146.170287:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955907072 00000100:00100000:0.0:1788541146.170307:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955907072 00000100:00100000:0.0:1788541146.170369:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 237 00000100:00100000:0.0:1788541146.170379:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+68:12463:x1875420955907072:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788541146.170402:0:12149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541146.170405:0:12149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788541146.170434:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a8607 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331539 expref: 68 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.170454:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68350c0a00) 00010000:00010000:0.0:1788541146.170460:0:12149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788541146.170474:0:12149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031e00/0x2aac941e5f4a8677 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a33155c expref: -99 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788541146.170958:0:12149:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:0.0:1788541146.171114:0:12149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030400/0x2aac941e5f4a867e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.171128:0:12149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030400/0x2aac941e5f4a867e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.171139:0:12149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030400/0x2aac941e5f4a867e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.171191:0:12149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031e00/0x2aac941e5f4a8677 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33155c expref: 70 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.171208:0:12149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030400/0x2aac941e5f4a867e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33155c expref: 69 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.171227:0:12149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a67078a1100) 00010000:00010000:0.0:1788541146.171229:0:12149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788541146.171232:0:12149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6800030400, rc 0) 00000100:00100000:0.0:1788541146.171286:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+69:12463:x1875420955907072:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 908us (1115us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1788541146.171294:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 237 00000100:00100000:3.0:1788541146.176403:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541146.176608:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955907328 00000100:00100000:1.0:1788541146.176619:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955907328 00000100:00100000:1.0:1788541146.176728:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 238 00000100:00100000:1.0:1788541146.176766:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+69:12463:x1875420955907328:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788541146.176837:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541146.176903:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030400/0x2aac941e5f4a867e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33155c expref: 69 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.176926:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a67078a1100) 00010000:00010000:1.0:1788541146.176939:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788541146.176966:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a868c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.176980:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a868c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.176991:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a868c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.177033:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a8693 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x79ff4594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.177049:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a8693 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x79ff4594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.177057:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a8693 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x79ff4594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.177105:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a868c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.177112:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a868c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.177128:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a868c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.177134:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706956c00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541146.177138:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a868c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.177146:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a868c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.177154:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68350c0a00) 00010000:00010000:1.0:1788541146.177157:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541146.177161:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a868c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.177168:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a868c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.177177:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a8693 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x79ff4594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.177183:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a8693 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x79ff4594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.177188:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a8693 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x79ff4594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.177193:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706957e00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541146.177195:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a8693 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x79ff4594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.177221:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a8693 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x79ff4594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.177230:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x79ff4594 (ffff9a6809c1c100) 00010000:00010000:1.0:1788541146.177233:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541146.177236:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a8693 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x79ff4594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.177241:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a8693 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x79ff4594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541146.177340:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+68:12463:x1875420955907328:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 586us (946us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788541146.177347:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 238 00000100:00100000:2.0:1788541146.182108:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541146.182190:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955907456 00000100:00100000:0.0:1788541146.182201:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955907456 00000100:00100000:0.0:1788541146.182284:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 239 00000100:00100000:0.0:1788541146.182296:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+68:12463:x1875420955907456:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788541146.182321:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541146.182360:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030a00/0x2aac941e5f4a869a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331563 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.182405:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031c00/0x2aac941e5f4a86a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.182423:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031c00/0x2aac941e5f4a86a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.182438:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031c00/0x2aac941e5f4a86a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.182579:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030a00/0x2aac941e5f4a869a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331563 expref: 70 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.182601:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031c00/0x2aac941e5f4a86a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331563 expref: 69 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.182611:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a67078a1e00) 00010000:00010000:0.0:1788541146.182615:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788541146.182619:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6800031c00, rc 0) 00000100:00100000:0.0:1788541146.182696:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+69:12463:x1875420955907456:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 403us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541146.182704:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 239 00000100:00100000:2.0:1788541146.187277:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541146.187363:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955907712 00000100:00100000:1.0:1788541146.187373:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955907712 00000100:00100000:1.0:1788541146.187436:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 240 00000100:00100000:1.0:1788541146.187446:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+69:12463:x1875420955907712:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788541146.187550:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957200/0x2aac941e5f4a86a8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.187569:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957200/0x2aac941e5f4a86a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.187581:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957200/0x2aac941e5f4a86a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788541146.187765:0:9339:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00010000:1.0:1788541146.187826:0:9339:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e763bd03 reply state 00000000d97198e2 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957200/0x2aac941e5f4a86a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.187854:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957200/0x2aac941e5f4a86a8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.187862:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a67078a1e00) 00010000:00010000:1.0:1788541146.187866:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788541146.187897:0:9339:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788541146.188007:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+71:12463:x1875420955907712:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 562us (738us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1788541146.188015:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 240 00000100:00100000:2.0:1788541146.191668:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541146.191908:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955907840 00000100:00100000:1.0:1788541146.191918:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955907840 00000100:00100000:1.0:1788541146.191979:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 241 00000100:00100000:1.0:1788541146.191988:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+71:12463:x1875420955907840:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788541146.192013:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541146.192034:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956a00/0x2aac941e5f4a86af lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a33156a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.192104:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956a00/0x2aac941e5f4a86af lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33156a expref: 72 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.192119:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956a00/0x2aac941e5f4a86af lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33156a expref: 72 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.192137:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a67078a1e00) 00010000:00010000:1.0:1788541146.192141:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788541146.192145:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6706956a00, rc 0) 00000100:00100000:1.0:1788541146.192206:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+72:12463:x1875420955907840:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 218us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541146.192235:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 241 00000100:00100000:2.0:1788541146.195488:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541146.195659:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955907968 00000100:00100000:1.0:1788541146.195669:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955907968 00000100:00100000:1.0:1788541146.195758:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 70 00000100:00100000:1.0:1788541146.195787:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:384f52e3-0481-4979-9299-157aff7472d2+9:2396:x1875420955907968:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788541146.196027:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:384f52e3-0481-4979-9299-157aff7472d2+10:2396:x1875420955907968:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 Request processed in 259us (549us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1788541146.196045:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 70 00000100:00080000:3.0:1788541146.196707:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788541146.204803:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541146.204964:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955908224 00000100:00100000:2.0:1788541146.204974:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955908224 00000100:00100000:2.0:1788541146.205033:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 60 00000100:00100000:2.0:1788541146.205052:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+72:12463:x1875420955908224:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788541146.205297:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+73:12463:x1875420955908224:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 245us (505us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1788541146.205305:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 60 00000100:00100000:2.0:1788541146.208200:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541146.208296:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955908480 00000100:00100000:1.0:1788541146.208315:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955908480 00000100:00100000:1.0:1788541146.208377:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 242 00000100:00100000:1.0:1788541146.208387:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+73:12463:x1875420955908480:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788541146.208537:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+73:12463:x1875420955908480:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 151us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541146.208545:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 242 00000100:00100000:0.0:1788541146.213691:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541146.213911:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955908608 00000100:00100000:3.0:1788541146.213928:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955908608 00000100:00100000:3.0:1788541146.214020:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 243 00000100:00100000:3.0:1788541146.214032:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+73:12463:x1875420955908608:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788541146.214234:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541146.214258:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac200/0x2aac941e5f4a86b6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331571 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.214398:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a86bd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.214413:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a86bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.214424:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a86bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541146.214476:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788541146.214498:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a86bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.214538:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac200/0x2aac941e5f4a86b6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331571 expref: 75 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.214556:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a86bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331571 expref: 74 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.214565:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a67078a1e00) 00010000:00010000:3.0:1788541146.214567:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788541146.214584:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075adc00, rc 0) 00000100:00100000:3.0:1788541146.214647:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+74:12463:x1875420955908608:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 618us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541146.214654:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 243 00000100:00100000:3.0:1788541146.218166:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541146.218570:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955908736 00000100:00100000:0.0:1788541146.218581:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955908736 00000100:00100000:0.0:1788541146.218648:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 71 00000100:00100000:0.0:1788541146.218659:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708836d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:384f52e3-0481-4979-9299-157aff7472d2+10:2397:x1875420955908736:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788541146.218689:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541146.218709:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e86a0444/0x2aac941e5f4a86c4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331578 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788541146.218735:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9af8da, blocks: 0x0 00010000:00010000:0.0:1788541146.219100:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=427s v=(0 0) 00010000:00010000:0.0:1788541146.219106:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541146.219119:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e86a0444/0x2aac941e5f4a86c4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331578 expref: 11 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.219143:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e86a0444/0x2aac941e5f4a86c4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331578 expref: 11 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.219158:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6800031e00, rc 0) 00000100:00100000:2.0:1788541146.219332:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708836d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:384f52e3-0481-4979-9299-157aff7472d2+11:2397:x1875420955908736:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 673us (1175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541146.219341:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 71 00000100:00100000:2.0:1788541146.222754:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541146.222936:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955908992 00000100:00100000:0.0:1788541146.222949:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955908992 00000100:00100000:0.0:1788541146.223149:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 244 00000100:00100000:0.0:1788541146.223161:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+74:12463:x1875420955908992:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788541146.223390:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+74:12463:x1875420955908992:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 210us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541146.223419:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 244 00000100:00100000:0.0:1788541146.227837:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541146.228078:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955909120 00000100:00100000:1.0:1788541146.228093:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955909120 00000100:00100000:1.0:1788541146.228159:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 72 00000100:00100000:1.0:1788541146.228170:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:384f52e3-0481-4979-9299-157aff7472d2+11:12463:x1875420955909120:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788541146.228189:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541146.228209:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001974258/0x2aac941e5f4a86cb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a33157f expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.228254:0:8430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e86a0444/0x2aac941e5f4a86c4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331578 expref: 12 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.228287:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541146.228292:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541146.228297:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001974258/0x2aac941e5f4a86cb lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33157f expref: 12 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.228334:0:8430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e86a0444/0x2aac941e5f4a86c4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331578 expref: 12 pid: 8431 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.228347:0:8430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e86a0444/0x2aac941e5f4a86c4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331578 expref: 12 pid: 8431 timeout: 527 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541146.228362:0:8430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708312d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1875420981123200:192.168.202.56@tcp:104: 00000100:00100000:1.0:1788541146.228467:0:8430:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67079a7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788541146.232734:0:8430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708312d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1875420981123200:192.168.202.56@tcp:104: 00010000:00010000:1.0:1788541146.232790:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000001974258/0x2aac941e5f4a86cb lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xa16473202a33157f expref: 12 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.232815:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6706957e00, rc 0) 00000100:00100000:1.0:1788541146.232927:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:384f52e3-0481-4979-9299-157aff7472d2+12:12463:x1875420955909120:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 4758us (5099us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541146.232936:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 72 00000100:00100000:3.0:1788541146.234953:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541146.235149:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955909248 00000100:00100000:0.0:1788541146.235159:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955909248 00010000:00010000:0.0:1788541146.235199:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e86a0444/0x2aac941e5f4a86c4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331578 expref: 12 pid: 8431 timeout: 527 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541146.235293:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 101 00000100:00100000:0.0:1788541146.235304:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708835c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:384f52e3-0481-4979-9299-157aff7472d2+12:2397:x1875420955909248:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788541146.235319:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541146.235341:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e86a0444/0x2aac941e5f4a86c4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331578 expref: 12 pid: 8431 timeout: 527 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.235355:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e86a0444/0x2aac941e5f4a86c4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331578 expref: 12 pid: 8431 timeout: 527 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.235378:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e86a0444/0x2aac941e5f4a86c4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331578 expref: 12 pid: 8431 timeout: 527 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.235398:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541146.235402:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541146.235412:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000001974258/0x2aac941e5f4a86cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xa16473202a33157f expref: 11 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.235424:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001974258/0x2aac941e5f4a86cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xa16473202a33157f expref: 11 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.235464:0:6503:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000001974258/0x2aac941e5f4a86cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xa16473202a33157f expref: 11 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541146.235479:0:6503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6503:1875420981123328:192.168.202.56@tcp:105: 00000100:00100000:0.0:1788541146.235581:0:6503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068fd840 going to sleep for 11 seconds 00000100:00100000:3.0:1788541146.238690:0:6503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6503:1875420981123328:192.168.202.56@tcp:105: 00010000:00010000:3.0:1788541146.238721:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541146.238794:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708835c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:384f52e3-0481-4979-9299-157aff7472d2+11:2397:x1875420955909248:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 3491us (3848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541146.238807:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 101 00000100:00100000:3.0:1788541146.242851:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541146.243145:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955909376 00000100:00100000:2.0:1788541146.243156:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955909376 00002000:00100000:2.0:1788541146.243206:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff9a6708834e00 x1875420955909376/t0(0) o4->384f52e3-0481-4979-9299-157aff7472d2@192.168.202.56@tcp:517/0 lens 504/0 e 0 to 0 dl 1788541157 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788541146.243227:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6708834e00 with x1875420955909376 ext(0->12) 00002000:00010000:2.0:1788541146.243232:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a6708834e00 00000100:00100000:2.0:1788541146.243265:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 6 00000100:00100000:2.0:1788541146.243275:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708834e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:384f52e3-0481-4979-9299-157aff7472d2+11:2396:x1875420955909376:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788541146.244466:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708834e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:384f52e3-0481-4979-9299-157aff7472d2+13:2396:x1875420955909376:12345-192.168.202.56@tcp:4:lhsmtool_posix.0 Request processed in 1184us (1617us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1788541146.244477:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 6 00002000:00100000:2.0:1788541146.244486:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff9a6708834e00 x1875420955909376/t4294967321(0) o4->384f52e3-0481-4979-9299-157aff7472d2@192.168.202.56@tcp:517/0 lens 504/448 e 0 to 0 dl 1788541157 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788541146.244496:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6708834e00 with x1875420955909376 ext(0->12) 00002000:00010000:2.0:1788541146.244501:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a6708834e00 00000100:00100000:2.0:1788541146.248316:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541146.248623:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955909504 00000100:00100000:0.0:1788541146.248634:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955909504 00000100:00100000:0.0:1788541146.248693:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 245 00000100:00100000:0.0:1788541146.248703:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+74:12463:x1875420955909504:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788541146.250589:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:0.0:1788541146.250628:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:0.0:1788541146.250657:0:6496:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a67079a7b40 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1788541146.250662:0:6496:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a670791a700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a67079a7600 00000020:00080000:0.0:1788541146.250666:0:6496:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a680a09de00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a6707b8fc00 00000004:00080000:0.0:1788541146.250696:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:0.0:1788541146.250726:0:6496:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a6835493cc0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1788541146.250729:0:6496:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a6707949200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a6835493c00 00000020:00080000:0.0:1788541146.250732:0:6496:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a6707949300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a683f2f6800 00000020:00080000:0.0:1788541146.250742:0:6496:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:0.0:1788541146.250943:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+28:12463:x1875420955909504:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 Request processed in 2235us (2632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541146.250953:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 245 00000020:00080000:2.0:1788541146.251353:0:6549:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1788541146.251425:0:6549:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1788541146.251540:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981123584:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788541146.251598:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541146.251710:0:8973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981123584 00000100:00100000:2.0:1788541146.251718:0:8973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981123584 00000100:00100000:2.0:1788541146.251779:0:8973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788541146.251788:0:8973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3641:x1875420981123584:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788541146.251811:0:8973:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:2.0:1788541146.251845:0:8973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000265d9b95/0x2aac941e5f4a86d2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.251891:0:8973:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000056f0c80e/0x2aac941e5f4a8486 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3314d7 expref: 12 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.251902:0:8973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1788541146.251906:0:8973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788541146.251912:0:8973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000265d9b95/0x2aac941e5f4a86d2 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.251953:0:8973:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000056f0c80e/0x2aac941e5f4a8486 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.56@tcp remote: 0xa16473202a3314d7 expref: 12 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.251967:0:8973:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000056f0c80e/0x2aac941e5f4a8486 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.56@tcp remote: 0xa16473202a3314d7 expref: 12 pid: 8432 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541146.251980:0:8973:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080a4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8973:1875420981123712:192.168.202.56@tcp:104: 00000100:00100000:0.0:1788541146.252277:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708312d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981123456:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788541146.252311:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788541146.252456:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a83d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.252466:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a83d0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.252473:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a83d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.252479:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68354dba00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541146.252483:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a83d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.252491:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a83d0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.252576:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9a6809c1c700) 00010000:00010000:3.0:1788541146.252579:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541146.252592:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a83d0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.252599:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dba00/0x2aac941e5f4a83d0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.252629:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a8478 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.252636:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a8478 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.252642:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a8478 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.252648:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68354db800 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541146.252651:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a8478 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.252657:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a8478 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.252665:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9a683531b400) 00010000:00010000:3.0:1788541146.252668:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541146.252671:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a8478 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.252677:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db800/0x2aac941e5f4a8478 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.252692:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a84f6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.252698:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a84f6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.252712:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a84f6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.252717:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842173200 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541146.252720:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a84f6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.252727:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a84f6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.252735:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a67078a1c00) 00010000:00010000:3.0:1788541146.252738:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541146.252741:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a84f6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.252746:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173200/0x2aac941e5f4a84f6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.252955:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a8519 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.252963:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a8519 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.252969:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a8519 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.252974:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75fc00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541146.252977:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a8519 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788541146.252979:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788541146.252992:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a8519 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.253001:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a67078a1c00) 00010000:00010000:3.0:1788541146.253003:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541146.253006:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a8519 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.253027:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a8519 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.253042:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a85eb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.253049:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a85eb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.253053:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a85eb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.253058:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075ada00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541146.253061:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a85eb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.253066:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a85eb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.253075:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a67078a1500) 00010000:00010000:3.0:1788541146.253077:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541146.253080:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a85eb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.253095:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a85eb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.253108:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957200/0x2aac941e5f4a86a8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.253114:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957200/0x2aac941e5f4a86a8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.253119:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957200/0x2aac941e5f4a86a8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.253124:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706957200 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541146.253127:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957200/0x2aac941e5f4a86a8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.253133:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957200/0x2aac941e5f4a86a8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.253140:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a67078a1e00) 00010000:00010000:3.0:1788541146.253143:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788541146.253145:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957200/0x2aac941e5f4a86a8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.253151:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957200/0x2aac941e5f4a86a8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541146.254181:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981123456 00000100:00100000:1.0:1788541146.254191:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981123456 00000100:00100000:1.0:1788541146.254257:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788541146.254268:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1875420981123456:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788541146.254298:0:8431:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:1.0:1788541146.254328:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9af8d9, atime: 0x6a9af8d9, ctime: 0x6a9af8d9, blocks: 0x8 00010000:00010000:1.0:1788541146.254336:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007954e8dc/0x2aac941e5f4a86d9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.254349:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=427s v=(0 0) 00010000:00010000:1.0:1788541146.254354:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541146.254361:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007954e8dc/0x2aac941e5f4a86d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.254377:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007954e8dc/0x2aac941e5f4a86d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.254386:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007954e8dc/0x2aac941e5f4a86d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.254393:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007954e8dc/0x2aac941e5f4a86d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541146.254513:0:8973:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6835519540 going to sleep for 11 seconds 00010000:00010000:1.0:1788541146.255217:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788541146.255415:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3644:x1875420981123456:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1147us (3101us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788541146.255425:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000004:00080000:0.0:1788541146.255558:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a6708312d80/2, rc 0, transno 4294967311 00000100:00100000:0.0:1788541146.255566:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708312d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981123456:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788541146.257450:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788541146.257464:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007954e8dc/0x2aac941e5f4a86d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.257494:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706956c00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:3.0:1788541146.257498:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007954e8dc/0x2aac941e5f4a86d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.257510:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007954e8dc/0x2aac941e5f4a86d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.257531:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007954e8dc/0x2aac941e5f4a86d9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.257539:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007954e8dc/0x2aac941e5f4a86d9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.257562:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541146.257564:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541146.257566:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541146.259604:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541146.259626:0:8973:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080a4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8973:1875420981123712:192.168.202.56@tcp:104: 00010000:00010000:0.0:1788541146.259654:0:8973:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000265d9b95/0x2aac941e5f4a86d2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541146.259724:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541146.259785:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955909760 00000100:00100000:1.0:1788541146.259793:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955909760 00010000:00010000:1.0:1788541146.259831:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000056f0c80e/0x2aac941e5f4a8486 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.56@tcp remote: 0xa16473202a3314d7 expref: 13 pid: 8432 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541146.259948:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 102 00000100:00100000:1.0:1788541146.259959:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:384f52e3-0481-4979-9299-157aff7472d2+13:2396:x1875420955909760:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788541146.259974:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541146.259980:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000056f0c80e/0x2aac941e5f4a8486 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.56@tcp remote: 0xa16473202a3314d7 expref: 13 pid: 8432 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.259993:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000056f0c80e/0x2aac941e5f4a8486 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.56@tcp remote: 0xa16473202a3314d7 expref: 13 pid: 8432 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.260030:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056f0c80e/0x2aac941e5f4a8486 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.56@tcp remote: 0xa16473202a3314d7 expref: 13 pid: 8432 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.260048:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788541146.260051:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788541146.260057:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000265d9b95/0x2aac941e5f4a86d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.260067:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000265d9b95/0x2aac941e5f4a86d2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.260088:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788541146.260151:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:384f52e3-0481-4979-9299-157aff7472d2+12:2396:x1875420955909760:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 193us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541146.260167:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 102 00000100:00100000:3.0:1788541146.260640:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955909632 00000100:00100000:3.0:1788541146.260646:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955909632 00000100:00100000:3.0:1788541146.260677:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 75 00000100:00100000:3.0:1788541146.260685:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:384f52e3-0481-4979-9299-157aff7472d2+12:2396:x1875420955909632:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1788541146.261533:0:8973:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000265d9b95/0x2aac941e5f4a86d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.261548:0:8973:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000265d9b95/0x2aac941e5f4a86d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.261559:0:8973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000265d9b95/0x2aac941e5f4a86d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.261568:0:8973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000265d9b95/0x2aac941e5f4a86d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.261586:0:8973:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788541146.261768:0:8973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3641:x1875420981123584:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9980us (10168us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1788541146.261784:0:8973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00010000:2.0:1788541146.261809:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541146.261815:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000265d9b95/0x2aac941e5f4a86d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.261824:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551b400 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:2.0:1788541146.261829:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000265d9b95/0x2aac941e5f4a86d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.261838:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000265d9b95/0x2aac941e5f4a86d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.261854:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000265d9b95/0x2aac941e5f4a86d2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.261863:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000265d9b95/0x2aac941e5f4a86d2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.261917:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541146.261918:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541146.261920:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788541146.263374:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:3.0:1788541146.263394:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967318 is committed 00000100:00100000:2.0:1788541146.264197:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:384f52e3-0481-4979-9299-157aff7472d2+7:2396:x1875420955909632:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 Request processed in 3506us (4596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541146.264209:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 75 00000004:00080000:1.0:1788541146.264850:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a67080a4a80/2, rc 0, transno 4294967322 00000100:00100000:1.0:1788541146.264953:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981123584:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788541146.267997:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541146.268382:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955910016 00000100:00100000:1.0:1788541146.268392:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955910016 00000100:00100000:1.0:1788541146.268499:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 246 00000100:00100000:1.0:1788541146.268510:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+22:12463:x1875420955910016:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788541146.268569:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541146.268601:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075adc00/0x2aac941e5f4a86bd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331571 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.268619:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a67078a1e00) 00010000:00010000:1.0:1788541146.268625:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788541146.268653:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957c00/0x2aac941e5f4a86e0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.268664:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957c00/0x2aac941e5f4a86e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.268671:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957c00/0x2aac941e5f4a86e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788541146.268769:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002f1d2530 reply state 000000003a23c5d1 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957c00/0x2aac941e5f4a86e0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.268780:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957c00/0x2aac941e5f4a86e0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.268806:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a67078a1e00) 00010000:00010000:1.0:1788541146.268808:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788541146.268811:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788541146.268923:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+23:12463:x1875420955910016:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 415us (936us total) trans 4294967509 rc 0/0 00000100:00100000:1.0:1788541146.268937:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 246 00000100:00100000:0.0:1788541146.271287:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541146.271424:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955910144 00000100:00100000:1.0:1788541146.271434:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955910144 00000100:00100000:1.0:1788541146.271484:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 76 00000100:00100000:1.0:1788541146.271494:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:384f52e3-0481-4979-9299-157aff7472d2+7:2397:x1875420955910144:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788541146.271617:0:8431:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788541146.271620:0:8431:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1788541145 00002000:00010000:1.0:1788541146.271622:0:8431:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1788541145 00002000:00010000:1.0:1788541146.271623:0:8431:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788541146 -> 1788541145 00002000:00010000:1.0:1788541146.271625:0:8431:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788541146.271670:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:384f52e3-0481-4979-9299-157aff7472d2+8:2397:x1875420955910144:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 Request processed in 177us (396us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1788541146.271677:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 76 00000100:00100000:3.0:1788541146.273739:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541146.274602:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955910400 00000100:00100000:1.0:1788541146.274616:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955910400 00000100:00100000:1.0:1788541146.274718:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 247 00000100:00100000:1.0:1788541146.274731:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+23:12463:x1875420955910400:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788541146.274819:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956200/0x2aac941e5f4a86e7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.274839:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031c00/0x2aac941e5f4a86a1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331563 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.274864:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956200/0x2aac941e5f4a86e7 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.274929:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031c00/0x2aac941e5f4a86a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331563 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.274943:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031c00/0x2aac941e5f4a86a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331563 expref: 23 pid: 6518 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541146.274959:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1875420981123840:192.168.202.56@tcp:104: 00000100:00100000:1.0:1788541146.275061:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67079a7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788541146.278778:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1875420981123840:192.168.202.56@tcp:104: 00010000:00010000:1.0:1788541146.278815:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956200/0x2aac941e5f4a86e7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541146.280349:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541146.281029:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955910528 00000100:00100000:2.0:1788541146.281056:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955910528 00010000:00010000:2.0:1788541146.281096:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031c00/0x2aac941e5f4a86a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331563 expref: 24 pid: 6518 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541146.281149:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 103 00000100:00100000:2.0:1788541146.281159:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708835500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:384f52e3-0481-4979-9299-157aff7472d2+24:2396:x1875420955910528:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541146.281178:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541146.281185:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031c00/0x2aac941e5f4a86a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331563 expref: 24 pid: 6518 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.281198:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031c00/0x2aac941e5f4a86a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331563 expref: 24 pid: 6518 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.281229:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031c00/0x2aac941e5f4a86a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331563 expref: 24 pid: 6518 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.281246:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a67078a1e00) 00010000:00010000:2.0:1788541146.281250:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956200/0x2aac941e5f4a86e7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.281257:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956200/0x2aac941e5f4a86e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.281264:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956200/0x2aac941e5f4a86e7 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.281285:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541146.281341:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708835500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:384f52e3-0481-4979-9299-157aff7472d2+23:2396:x1875420955910528:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 183us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541146.281357:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 103 00010000:00010000:1.0:1788541146.281548:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956200/0x2aac941e5f4a86e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.281557:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956200/0x2aac941e5f4a86e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.281596:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956200/0x2aac941e5f4a86e7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.281603:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956200/0x2aac941e5f4a86e7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.281610:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956200/0x2aac941e5f4a86e7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.281622:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706956200 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541146.281632:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956200/0x2aac941e5f4a86e7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.281640:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956200/0x2aac941e5f4a86e7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.281650:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a67078a1e00) 00010000:00010000:1.0:1788541146.281652:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788541146.281655:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956200/0x2aac941e5f4a86e7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.281661:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956200/0x2aac941e5f4a86e7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541146.281700:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+22:12463:x1875420955910400:12345-192.168.202.56@tcp:55:lhsmtool_posix.0 Request processed in 6973us (7969us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788541146.281708:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 247 00000100:00100000:2.0:1788541146.285569:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541146.291278:0:8973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955910656 00000100:00100000:0.0:1788541146.291295:0:8973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955910656 00000100:00100000:0.0:1788541146.291367:0:8973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 77 00000100:00100000:0.0:1788541146.291377:0:8973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:384f52e3-0481-4979-9299-157aff7472d2+8:2397:x1875420955910656:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788541146.291437:0:8973:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e86a0444/0x2aac941e5f4a86ee lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.291459:0:8973:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000001974258/0x2aac941e5f4a86cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xa16473202a33157f expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.291468:0:8973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541146.291475:0:8973:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788541146.291480:0:8973:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e86a0444/0x2aac941e5f4a86ee lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.291525:0:8973:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000001974258/0x2aac941e5f4a86cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xa16473202a33157f expref: 8 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.291541:0:8973:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000001974258/0x2aac941e5f4a86cb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a33157f expref: 8 pid: 8430 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541146.291557:0:8973:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8973:1875420981123968:192.168.202.56@tcp:104: 00000100:00100000:0.0:1788541146.291698:0:8973:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068fd840 going to sleep for 11 seconds 00000100:00100000:2.0:1788541146.295475:0:8973:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8973:1875420981123968:192.168.202.56@tcp:104: 00010000:00010000:2.0:1788541146.295505:0:8973:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e86a0444/0x2aac941e5f4a86ee lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541146.295634:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541146.295739:0:9520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955910784 00000100:00100000:3.0:1788541146.296218:0:9520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955910784 00010000:00010000:3.0:1788541146.296263:0:9520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000001974258/0x2aac941e5f4a86cb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a33157f expref: 9 pid: 8430 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541146.296343:0:9520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 104 00000100:00100000:3.0:1788541146.296353:0:9520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:384f52e3-0481-4979-9299-157aff7472d2+9:2397:x1875420955910784:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541146.296369:0:9520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541146.296395:0:9520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000001974258/0x2aac941e5f4a86cb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a33157f expref: 9 pid: 8430 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.296409:0:9520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000001974258/0x2aac941e5f4a86cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a33157f expref: 9 pid: 8430 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.296436:0:9520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001974258/0x2aac941e5f4a86cb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a33157f expref: 9 pid: 8430 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.296455:0:9520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788541146.296460:0:9520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788541146.296467:0:9520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e86a0444/0x2aac941e5f4a86ee lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.296479:0:9520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e86a0444/0x2aac941e5f4a86ee lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.296515:0:9520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541146.296598:0:9520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:384f52e3-0481-4979-9299-157aff7472d2+8:2397:x1875420955910784:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 246us (965us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541146.296618:0:9520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 104 00010000:00010000:2.0:1788541146.296677:0:8973:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e86a0444/0x2aac941e5f4a86ee lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.296686:0:8973:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e86a0444/0x2aac941e5f4a86ee lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.296709:0:8973:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e86a0444/0x2aac941e5f4a86ee lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.296718:0:8973:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e86a0444/0x2aac941e5f4a86ee lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.296726:0:8973:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e86a0444/0x2aac941e5f4a86ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.296732:0:8973:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6800031e00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:2.0:1788541146.296736:0:8973:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e86a0444/0x2aac941e5f4a86ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.296768:0:8973:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e86a0444/0x2aac941e5f4a86ee lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.296790:0:8973:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e86a0444/0x2aac941e5f4a86ee lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.296799:0:8973:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e86a0444/0x2aac941e5f4a86ee lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8973 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541146.296857:0:8973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:384f52e3-0481-4979-9299-157aff7472d2+7:2397:x1875420955910656:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 5480us (11352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541146.296866:0:8973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 77 00000100:00100000:3.0:1788541146.303537:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541146.303638:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955911040 00000100:00100000:0.0:1788541146.303650:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955911040 00000100:00100000:0.0:1788541146.303715:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 248 00000100:00100000:0.0:1788541146.303725:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+22:12463:x1875420955911040:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788541146.303918:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030400/0x2aac941e5f4a86f5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.304405:0:9339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a85e4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33152b expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.304417:0:9339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030400/0x2aac941e5f4a86f5 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.304459:0:9339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a85e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33152b expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.304476:0:9339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a85e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33152b expref: 22 pid: 6518 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541146.304493:0:9339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9339:1875420981124096:192.168.202.56@tcp:104: 00000100:00100000:0.0:1788541146.304589:0:9339:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068fd600 going to sleep for 11 seconds 00000100:00100000:0.0:1788541146.309730:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541146.310163:0:9339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9339:1875420981124096:192.168.202.56@tcp:104: 00010000:00010000:2.0:1788541146.310190:0:9339:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030400/0x2aac941e5f4a86f5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541146.310345:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955911168 00000100:00100000:3.0:1788541146.310353:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955911168 00010000:00010000:3.0:1788541146.310388:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a85e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33152b expref: 23 pid: 6518 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541146.310427:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 105 00000100:00100000:3.0:1788541146.310437:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:384f52e3-0481-4979-9299-157aff7472d2+23:2397:x1875420955911168:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541146.310451:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541146.310458:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a85e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33152b expref: 23 pid: 6518 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.310469:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a85e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33152b expref: 23 pid: 6518 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.310490:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a85e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33152b expref: 23 pid: 6518 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.310506:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a67078a1500) 00010000:00010000:3.0:1788541146.310512:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a8646 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33154e expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.310522:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030400/0x2aac941e5f4a86f5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.310528:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030400/0x2aac941e5f4a86f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.310549:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030400/0x2aac941e5f4a86f5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.310578:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541146.310636:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:384f52e3-0481-4979-9299-157aff7472d2+22:2397:x1875420955911168:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 200us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541146.310644:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 105 00010000:00010000:0.0:1788541146.310702:0:9339:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030400/0x2aac941e5f4a86f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.310710:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030400/0x2aac941e5f4a86f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.311352:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030a00/0x2aac941e5f4a86fc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.311367:0:9339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956a00/0x2aac941e5f4a86af lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33156a expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.311375:0:9339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030a00/0x2aac941e5f4a86fc lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.311407:0:9339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956a00/0x2aac941e5f4a86af lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33156a expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.311420:0:9339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956a00/0x2aac941e5f4a86af lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33156a expref: 22 pid: 6518 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541146.311434:0:9339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9339:1875420981124224:192.168.202.56@tcp:104: 00000100:00100000:0.0:1788541146.311500:0:9339:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068fd3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788541146.322676:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541146.322846:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955911296 00000100:00100000:2.0:1788541146.322856:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955911296 00010000:00010000:2.0:1788541146.322925:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956a00/0x2aac941e5f4a86af lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33156a expref: 23 pid: 6518 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541146.322981:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 106 00000100:00100000:2.0:1788541146.322993:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:384f52e3-0481-4979-9299-157aff7472d2+23:2396:x1875420955911296:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541146.323010:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541146.323017:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956a00/0x2aac941e5f4a86af lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33156a expref: 23 pid: 6518 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.323051:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956a00/0x2aac941e5f4a86af lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33156a expref: 23 pid: 6518 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.323081:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a67078a1e00) 00010000:00010000:2.0:1788541146.323088:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030a00/0x2aac941e5f4a86fc lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.323099:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030a00/0x2aac941e5f4a86fc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.323116:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030a00/0x2aac941e5f4a86fc lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.323139:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541146.323200:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:384f52e3-0481-4979-9299-157aff7472d2+23:2396:x1875420955911296:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 209us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541146.323220:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 106 00010000:00010000:0.0:1788541146.324740:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956a00/0x2aac941e5f4a86af lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33156a expref: 22 pid: 6518 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541146.324999:0:9339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9339:1875420981124224:192.168.202.56@tcp:104: 00010000:00010000:0.0:1788541146.325028:0:9339:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030a00/0x2aac941e5f4a86fc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.325093:0:9339:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030a00/0x2aac941e5f4a86fc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.325100:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030a00/0x2aac941e5f4a86fc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788541146.325311:0:9339:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:0.0:1788541146.325431:0:9339:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:0.0:1788541146.325468:0:9339:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:0.0:1788541146.325638:0:9339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9339:1875420981124352:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788541146.325719:0:9339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541146.325958:0:9339:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67068fd840 going to sleep for 11 seconds 00000100:00100000:3.0:1788541146.326341:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981124352 00000100:00100000:3.0:1788541146.326350:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981124352 00000100:00100000:3.0:1788541146.326441:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788541146.326452:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9339:x1875420981124352:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788541146.326576:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9339:x1875420981124352:12345-0@lo:1000:mdt00_003.0 Request processed in 126us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541146.326583:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788541146.326661:0:9339:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967318 gen 2 00000004:00080000:2.0:1788541146.326667:0:9339:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967318 00000100:00100000:2.0:1788541146.326689:0:9339:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9a67080a4a80 x1875420981123584/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788541162 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541146.326701:0:9339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9339:1875420981124352:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788541146.326843:0:9339:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:2.0:1788541146.326948:0:9339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080a6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9339:1875420981124480:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788541146.326988:0:9339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541146.327533:0:9339:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6835519240 going to sleep for 11 seconds 00000100:00100000:0.0:1788541146.327658:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981124480 00000100:00100000:0.0:1788541146.327664:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981124480 00000100:00100000:0.0:1788541146.327697:0:10866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788541146.327703:0:10866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:9339:x1875420981124480:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788541146.327963:0:10866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:9339:x1875420981124480:12345-0@lo:1000:mdt00_003.0 Request processed in 259us (973us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1788541146.327971:0:10866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788541146.328157:0:9339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080a6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9339:1875420981124480:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1788541146.328230:0:9339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030a00/0x2aac941e5f4a86fc lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.328241:0:9339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030a00/0x2aac941e5f4a86fc lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.328251:0:9339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030a00/0x2aac941e5f4a86fc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.328256:0:9339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6800030a00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:2.0:1788541146.328262:0:9339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030a00/0x2aac941e5f4a86fc lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.328270:0:9339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030a00/0x2aac941e5f4a86fc lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.328287:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a67078a1e00) 00010000:00010000:2.0:1788541146.328291:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788541146.328296:0:9339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030a00/0x2aac941e5f4a86fc lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.328302:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030a00/0x2aac941e5f4a86fc lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.328328:0:9339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a863f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.328334:0:9339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a863f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.328339:0:9339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a863f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.328352:0:9339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075ad800 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:2.0:1788541146.328355:0:9339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a863f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.328361:0:9339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a863f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.328369:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a67078a1500) 00010000:00010000:2.0:1788541146.328371:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788541146.328378:0:9339:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a8646 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33154e expref: 25 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.328390:0:9339:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a8646 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33154e expref: 25 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.328400:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a8646 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33154e expref: 25 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.328429:0:9339:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a8646 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33154e expref: 25 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541146.328441:0:9339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080a6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9339:1875420981124608:192.168.202.56@tcp:105: 00000100:00100000:2.0:1788541146.328682:0:9339:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6835519240 going to sleep for 11 seconds 00000100:00100000:2.0:1788541146.332296:0:9339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080a6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9339:1875420981124608:192.168.202.56@tcp:105: 00010000:00010000:2.0:1788541146.332331:0:9339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a863f lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.332358:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad800/0x2aac941e5f4a863f lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.332391:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a8703 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.332404:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a8703 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.332417:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a8703 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.332429:0:9339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a8703 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.332434:0:9339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a8703 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.332440:0:9339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a8703 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.332445:0:9339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551b400 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:2.0:1788541146.332448:0:9339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a8703 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.332455:0:9339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a8703 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.332465:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a67078a1500) 00010000:00010000:2.0:1788541146.332468:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541146.332472:0:9339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a8703 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.332484:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a8703 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.332494:0:9339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030400/0x2aac941e5f4a86f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.332499:0:9339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030400/0x2aac941e5f4a86f5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.332572:0:9339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030400/0x2aac941e5f4a86f5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.332579:0:9339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6800030400 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:2.0:1788541146.332583:0:9339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030400/0x2aac941e5f4a86f5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.332589:0:9339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030400/0x2aac941e5f4a86f5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.332598:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a67078a1500) 00010000:00010000:2.0:1788541146.332601:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788541146.332604:0:9339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030400/0x2aac941e5f4a86f5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.332609:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800030400/0x2aac941e5f4a86f5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541146.332859:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+25:12463:x1875420955911040:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 29134us (29333us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1788541146.332888:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 248 00000020:00080000:2.0:1788541146.332900:0:9339:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788541146.333346:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788541146.333351:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1788541146.333585:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000040:00080000:0.0:1788541146.333997:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788541146.334008:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788541146.334104:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955911424 00000100:00100000:3.0:1788541146.334118:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955911424 00000100:00100000:3.0:1788541146.334171:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 61 00000100:00100000:3.0:1788541146.334180:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+25:12462:x1875420955911424:12345-192.168.202.56@tcp:49:lfs.0 00000100:00100000:3.0:1788541146.334303:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+25:12462:x1875420955911424:12345-192.168.202.56@tcp:49:lfs.0 Request processed in 124us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541146.334310:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 61 00000100:00100000:2.0:1788541146.337621:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541146.337699:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955911680 00000100:00100000:3.0:1788541146.337712:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955911680 00000100:00100000:3.0:1788541146.337782:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 62 00000100:00100000:3.0:1788541146.337793:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6811403850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+25:12463:x1875420955911680:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788541146.338098:0:6520:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788541146.338670:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:3.0:1788541146.338705:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac200/0x2aac941e5f4a870a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.338721:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac200/0x2aac941e5f4a870a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.338733:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac200/0x2aac941e5f4a870a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.338741:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac200/0x2aac941e5f4a870a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.338748:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac200/0x2aac941e5f4a870a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.338762:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac200/0x2aac941e5f4a870a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541146.338909:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788541146.339291:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541146.339298:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac200/0x2aac941e5f4a870a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.339310:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075ac200 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788541146.339315:0:8446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac200/0x2aac941e5f4a870a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.339324:0:8446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac200/0x2aac941e5f4a870a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.339348:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a67078a1e00) 00010000:00010000:0.0:1788541146.339351:0:8446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788541146.339356:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac200/0x2aac941e5f4a870a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.339362:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac200/0x2aac941e5f4a870a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541146.339373:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541146.339374:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541146.339376:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541146.340079:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6811403850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+27:12463:x1875420955911680:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 2282us (2574us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1788541146.340089:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 62 00000020:00080000:3.0:1788541146.340095:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788541146.342176:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541146.342304:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955911936 00000100:00100000:1.0:1788541146.342313:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955911936 00000100:00100000:1.0:1788541146.342415:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 249 00000100:00100000:1.0:1788541146.342426:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+27:12462:x1875420955911936:12345-192.168.202.56@tcp:58:lfs.0 00000040:00080000:1.0:1788541146.342605:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1788541146.342684:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+27:12462:x1875420955911936:12345-192.168.202.56@tcp:58:lfs.0 Request processed in 260us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541146.342692:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 249 00000100:00100000:1.0:1788541146.368734:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541146.368920:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955912064 00000100:00100000:2.0:1788541146.368940:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955912064 00000100:00100000:2.0:1788541146.368992:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 250 00000100:00100000:2.0:1788541146.369002:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+27:12465:x1875420955912064:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:2.0:1788541146.369043:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541146.369068:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a8711 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331586 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.369152:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a8718 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.369166:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a8718 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.369176:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a8718 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.369190:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a871f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.369198:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a871f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.369204:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a871f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.369329:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a8726 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.369358:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031600/0x2aac941e5f4a8631 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331547 expref: 28 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.369367:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a8726 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.369406:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031600/0x2aac941e5f4a8631 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331547 expref: 28 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.369420:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031600/0x2aac941e5f4a8631 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331547 expref: 28 pid: 9339 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541146.369435:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080a5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1875420981124736:192.168.202.56@tcp:104: 00000100:00100000:2.0:1788541146.370458:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68355196c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788541146.373230:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541146.373326:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955912320 00000100:00100000:3.0:1788541146.373337:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955912320 00000100:00100000:3.0:1788541146.373408:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 63 00000100:00100000:3.0:1788541146.373420:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+29:6165:x1875420955912320:12345-192.168.202.56@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788541146.373677:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+30:6165:x1875420955912320:12345-192.168.202.56@tcp:35:ldlm_bl.0 Request processed in 258us (466us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1788541146.373685:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 63 00000100:00100000:2.0:1788541146.374338:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080a5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1875420981124736:192.168.202.56@tcp:104: 00010000:00010000:2.0:1788541146.374368:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a8726 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541146.379729:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541146.380259:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955912448 00000100:00100000:3.0:1788541146.380272:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955912448 00010000:00010000:2.0:1788541146.380604:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031600/0x2aac941e5f4a8631 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331547 expref: 30 pid: 9339 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541146.380698:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 107 00000100:00100000:2.0:1788541146.380708:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68076eac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:384f52e3-0481-4979-9299-157aff7472d2+30:2397:x1875420955912448:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541146.380727:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541146.380735:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031600/0x2aac941e5f4a8631 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331547 expref: 30 pid: 9339 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.380850:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031600/0x2aac941e5f4a8631 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331547 expref: 30 pid: 9339 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.380897:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031600/0x2aac941e5f4a8631 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331547 expref: 30 pid: 9339 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.380921:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a67078a1500) 00010000:00010000:2.0:1788541146.380938:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a8726 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.380949:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a8726 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.380957:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a8726 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541146.381029:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541146.381116:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68076eac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:384f52e3-0481-4979-9299-157aff7472d2+29:2397:x1875420955912448:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 401us (1395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541146.381124:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 107 00010000:00010000:1.0:1788541146.383235:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a8726 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.383250:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a8726 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788541146.383565:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788541146.383571:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788541146.383595:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a8726 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.383613:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a8726 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.383625:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a8718 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.383633:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a8718 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.383641:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a8718 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.383647:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551b600 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541146.383652:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a8718 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.383660:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a8718 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.383676:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68350c0a00) 00010000:00010000:1.0:1788541146.383679:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541146.383702:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a8718 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.383708:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b600/0x2aac941e5f4a8718 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.383726:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a871f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.383732:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a871f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.383738:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a871f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.383743:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551aa00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541146.383746:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a871f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.383751:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a871f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.384250:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9a68350c0b00) 00010000:00010000:1.0:1788541146.384253:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541146.384257:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a871f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.384263:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551aa00/0x2aac941e5f4a871f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.384323:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a8711 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331586 expref: 29 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.384361:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a8726 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331586 expref: 28 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541146.384369:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a67078a1500) 00010000:00010000:1.0:1788541146.384371:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788541146.384374:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a683551b200, rc 0) 00000100:00100000:1.0:1788541146.384467:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+28:12465:x1875420955912064:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 15464us (15744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541146.384478:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 250 00000100:00100000:0.0:1788541146.571113:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981124864:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788541146.571204:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541146.571292:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981124864 00000100:00100000:2.0:1788541146.571301:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981124864 00000100:00100000:0.0:1788541146.571312:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788541146.571321:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981124992:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788541146.571346:0:10866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788541146.571352:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541146.571361:0:10866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981124864:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788541146.571385:0:14072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981124992 00000100:00100000:0.0:1788541146.571389:0:14072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981124992 00000004:00000024:2.0:1788541146.571407:0:10866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788541146.571427:0:14072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788541146.571435:0:14072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981124992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788541146.571452:0:14072:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3691950080 00000100:00100000:2.0:1788541146.571465:0:10866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981124864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541146.571490:0:14072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981124992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541146.571500:0:14072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788541146.571504:0:10866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00080000:0.0:1788541146.571525:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788541146.571574:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981124992:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788541146.571601:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981124864:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788541146.571742:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788541146.571750:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981125120:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788541146.571787:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541146.571825:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981125120 00000100:00100000:2.0:1788541146.571831:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981125120 00000100:00100000:2.0:1788541146.571866:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788541146.571893:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708836a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1875420981125120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788541146.571906:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3691950080 00000100:00100000:2.0:1788541146.571962:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708836a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1875420981125120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541146.571969:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788541146.572015:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981125120:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788541146.698622:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788541147.170167:0:14759:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788541147.170179:0:14759:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788541147.173866:0:14759:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788541147.174107:0:14759:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788541147.343554:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788541147.343568:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788541147.343595:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788541147.343604:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788541147.343757:0:13798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080a5880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1875420981125248:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788541147.343898:0:13798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6835519540 going to sleep for 11 seconds 00000100:00100000:2.0:1788541147.352839:0:13798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080a5880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13798:1875420981125248:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788541147.362104:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541147.365153:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955912576 00000100:00100000:3.0:1788541147.365172:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955912576 00000100:00100000:3.0:1788541147.365292:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 251 00000100:00100000:3.0:1788541147.365303:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+28:12477:x1875420955912576:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788541147.365352:0:9339:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788541147.365577:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+28:12477:x1875420955912576:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 275us (3481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541147.365586:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 251 00000100:00100000:0.0:1788541147.372668:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541147.372756:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955912832 00000100:00100000:1.0:1788541147.372768:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955912832 00000100:00100000:1.0:1788541147.372832:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 252 00000100:00100000:1.0:1788541147.372843:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+28:12477:x1875420955912832:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788541147.372865:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541147.372912:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956e00/0x2aac941e5f4a872d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a33158d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541147.373022:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957600/0x2aac941e5f4a8734 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541147.373040:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957600/0x2aac941e5f4a8734 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541147.373057:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957600/0x2aac941e5f4a8734 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788541147.373076:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788541147.373193:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956e00/0x2aac941e5f4a872d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33158d expref: 31 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541147.373228:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957600/0x2aac941e5f4a8734 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33158d expref: 30 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541147.373238:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a67078a1500) 00010000:00010000:1.0:1788541147.373242:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788541147.373245:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6706957600, rc 0) 00000100:00100000:1.0:1788541147.373316:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+30:12477:x1875420955912832:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 474us (659us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1788541147.373324:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 252 00000100:00100000:2.0:1788541147.392276:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541147.392367:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955913088 00000100:00100000:0.0:1788541147.392378:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955913088 00000100:00100000:0.0:1788541147.392457:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 253 00000100:00100000:0.0:1788541147.392468:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+30:12477:x1875420955913088:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788541147.392566:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031600/0x2aac941e5f4a8742 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541147.392586:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031600/0x2aac941e5f4a8742 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541147.392599:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031600/0x2aac941e5f4a8742 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541147.392775:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031600/0x2aac941e5f4a8742 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541147.392783:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031600/0x2aac941e5f4a8742 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541147.392790:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031600/0x2aac941e5f4a8742 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541147.392796:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6800031600 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541147.392800:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031600/0x2aac941e5f4a8742 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541147.392808:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031600/0x2aac941e5f4a8742 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541147.392847:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a67078a1500) 00010000:00010000:0.0:1788541147.392850:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788541147.392855:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031600/0x2aac941e5f4a8742 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541147.392861:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031600/0x2aac941e5f4a8742 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541147.393002:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:384f52e3-0481-4979-9299-157aff7472d2+31:12477:x1875420955913088:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 535us (736us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1788541147.393011:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 253 00000040:00080000:2.0:1788541147.396771:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788541147.396782:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788541147.397684:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788541147.397703:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788541147.400593:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541147.401280:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541147.401966:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955913472 00000100:00100000:0.0:1788541147.401979:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955913472 00000100:00100000:0.0:1788541147.402048:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 64 00000100:00100000:0.0:1788541147.402070:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+31:12477:x1875420955913472:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788541147.402347:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+32:12477:x1875420955913472:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 290us (1068us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1788541147.402356:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 64 00000100:00100000:3.0:1788541147.408111:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955913216 00000100:00100000:3.0:1788541147.408127:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955913216 00000100:00100000:0.0:1788541147.408266:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 18 00000100:00100000:0.0:1788541147.408277:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:384f52e3-0481-4979-9299-157aff7472d2+32:2396:x1875420955913216:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788541147.408292:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541147.408381:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957600/0x2aac941e5f4a8734 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33158d expref: 32 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541147.408398:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a67078a1500) 00010000:00010000:0.0:1788541147.408409:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541147.408541:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:384f52e3-0481-4979-9299-157aff7472d2+31:2396:x1875420955913216:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 266us (7957us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541147.408549:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 18 00000100:00100000:2.0:1788541147.594586:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788541147.594623:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981125376:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788541147.594693:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541147.594890:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981125376 00000100:00100000:3.0:1788541147.594899:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981125376 00000100:00100000:3.0:1788541147.594953:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788541147.594964:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981125376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788541147.595001:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788541147.595078:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981125376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541147.595085:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788541147.595390:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981125376:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788541147.722093:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541148.618058:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788541148.618089:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981125504:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788541148.618200:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541148.618270:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981125504 00000100:00100000:3.0:1788541148.618278:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981125504 00000100:00100000:3.0:1788541148.618342:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788541148.618352:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708835c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981125504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788541148.618384:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788541148.618437:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708835c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981125504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541148.618443:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:3.0:1788541148.618465:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788541148.618506:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981125504:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788541148.621677:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420981125632:0@lo:400:kworker.0 00000100:00100000:1.0:1788541148.621752:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541148.621791:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981126144:0@lo:400:kworker.0 00000100:00100000:1.0:1788541148.621832:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541148.621857:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981126656:0@lo:400:kworker.0 00000100:00100000:1.0:1788541148.621924:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541148.621948:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981126144 00000100:00100000:1.0:1788541148.621957:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788541148.621958:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981126144 00000100:00100000:1.0:1788541148.621966:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875420981125760:0@lo:400:kworker.0 00000100:00100000:1.0:1788541148.621997:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541148.622017:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875420981126272:0@lo:400:kworker.0 00000100:00100000:3.0:1788541148.622035:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788541148.622046:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981126144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541148.622103:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981126144:12345-0@lo:400:kworker.0 Request processed in 59us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541148.622110:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000004:00080000:2.0:1788541148.622255:0:9841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 429540383242ns, next at 430540380780ns, rc = 0 00000100:00100000:1.0:1788541148.622299:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541148.622327:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875420981126784:0@lo:400:kworker.0 00000100:00100000:1.0:1788541148.622349:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541148.622391:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981126144:0@lo:400:kworker.0 00000100:00100000:1.0:1788541148.622413:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981127168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788541148.622415:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981125760 00000100:00100000:3.0:1788541148.622422:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981125760 00000100:00100000:1.0:1788541148.622444:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541148.622456:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981126272 00000100:00100000:3.0:1788541148.622461:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981126272 00000100:00100000:1.0:1788541148.622491:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981125632 00000100:00100000:3.0:1788541148.622495:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981126784 00000100:00100000:1.0:1788541148.622497:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981125632 00000100:00100000:3.0:1788541148.622500:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981126784 00000100:00100000:3.0:1788541148.622526:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1788541148.622533:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706878e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875420981125760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541148.622542:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1788541148.622551:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+24:3643:x1875420981125632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541148.622583:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706878e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875420981125760:12345-0@lo:400:kworker.0 Request processed in 50us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541148.622595:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+24:3643:x1875420981125632:12345-0@lo:400:kworker.0 Request processed in 44us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541148.622602:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1788541148.622607:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1788541148.622620:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1788541148.622628:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706879180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875420981126272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541148.622644:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981126656 00000100:00100000:1.0:1788541148.622649:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981126656 00000100:00100000:3.0:1788541148.622662:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706879180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875420981126272:12345-0@lo:400:kworker.0 Request processed in 35us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541148.622670:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1788541148.622683:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788541148.622692:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706878000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3643:x1875420981126656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541148.622698:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1788541148.622707:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875420981126784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541148.622728:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706878000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3643:x1875420981126656:12345-0@lo:400:kworker.0 Request processed in 37us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541148.622735:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788541148.622758:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981127168 00000100:00100000:1.0:1788541148.622762:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981127168 00000100:00100000:1.0:1788541148.622788:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788541148.622795:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706879500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1875420981127168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788541148.622812:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788541148.622868:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875420981126784:12345-0@lo:400:kworker.0 Request processed in 162us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541148.622908:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00080000:3.0:1788541148.622938:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788541148.622943:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788541148.622947:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788541148.622994:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706879500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3643:x1875420981127168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 200us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541148.623006:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788541148.623035:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875420981126016:0@lo:400:kworker.0 00000100:00100000:1.0:1788541148.624243:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541148.624288:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981126528:0@lo:400:kworker.0 00000100:00100000:3.0:1788541148.624313:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981126016 00000100:00100000:3.0:1788541148.624322:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981126016 00000100:00100000:1.0:1788541148.624326:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541148.624352:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981127040:0@lo:400:kworker.0 00000100:00100000:1.0:1788541148.624376:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541148.624380:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1788541148.624393:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706878700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875420981126016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541148.624407:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788541148.624418:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981125888:0@lo:400:kworker.0 00000100:00100000:1.0:1788541148.624457:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541148.624458:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706878700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875420981126016:12345-0@lo:400:kworker.0 Request processed in 65us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541148.624467:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1788541148.624482:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875420981126400:0@lo:400:kworker.0 00000100:00100000:1.0:1788541148.624505:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541148.624527:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981126400 00000100:00100000:1.0:1788541148.624528:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875420981126912:0@lo:400:kworker.0 00000100:00100000:3.0:1788541148.624533:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981126400 00000100:00100000:1.0:1788541148.624554:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541148.624623:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981126528 00000100:00100000:2.0:1788541148.624629:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981126528 00000100:00100000:2.0:1788541148.624662:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981127040 00000100:00100000:2.0:1788541148.624665:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981127040 00000100:00100000:2.0:1788541148.624685:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788541148.624692:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670687a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981126528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541148.624757:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875420981126016:0@lo:400:kworker.0 00000100:00100000:1.0:1788541148.624789:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981125888 00000100:00100000:1.0:1788541148.624792:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981125888 00000100:00100000:1.0:1788541148.624820:0:10866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1788541148.624827:0:10866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670687a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981125888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541148.624868:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981126912 00000100:00100000:3.0:1788541148.624903:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981126912 00000100:00100000:3.0:1788541148.624938:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1788541148.624944:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670687b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875420981126400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541148.628795:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1788541148.629625:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706879f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875420981126912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541148.630112:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670687a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981126528:12345-0@lo:400:kworker.0 Request processed in 5417us (5784us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541148.630125:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788541148.630159:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788541148.630170:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670687aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3642:x1875420981127040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541148.630220:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670687aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3642:x1875420981127040:12345-0@lo:400:kworker.0 Request processed in 54us (5844us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541148.630225:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788541148.638275:0:10866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670687a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981125888:12345-0@lo:400:kworker.0 Request processed in 13436us (13808us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541148.638291:0:10866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1788541148.638385:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981125888:0@lo:400:kworker.0 00000100:00100000:1.0:1788541148.638402:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981126528:0@lo:400:kworker.0 00000100:00100000:1.0:1788541148.638431:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981127040:0@lo:400:kworker.0 00000100:00100000:1.0:1788541148.638509:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981127168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788541148.638522:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875420981125760:0@lo:400:kworker.0 00000100:00100000:1.0:1788541148.638535:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875420981126272:0@lo:400:kworker.0 00000100:00100000:1.0:1788541148.638547:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875420981126784:0@lo:400:kworker.0 00000100:00100000:1.0:1788541148.638558:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420981125632:0@lo:400:kworker.0 00000100:00100000:1.0:1788541148.638569:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981126656:0@lo:400:kworker.0 00000100:00080000:3.0:1788541148.641167:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788541148.641249:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788541148.641324:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670687b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875420981126400:12345-0@lo:400:kworker.0 Request processed in 16375us (16813us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541148.641336:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00010000:00080000:2.0:1788541148.646170:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670835e300 x1875420981126400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541148.646202:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875420981126400:0@lo:400:kworker.0 00000100:00100000:0.0:1788541148.653258:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706879f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1875420981126912:12345-0@lo:400:kworker.0 Request processed in 24437us (28692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541148.653275:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00010000:00080000:2.0:1788541148.653400:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670835e680 x1875420981126912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541148.653418:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875420981126912:0@lo:400:kworker.0 00010000:00010000:0.0:1788541148.753105:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788541148.982361:0:14810:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788541148.982371:0:14810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788541148.982399:0:14810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788541148.982406:0:14810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788541149.199683:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788541149.213411:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541149.213444:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955913728 00000100:00100000:3.0:1788541149.213452:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955913728 00000100:00100000:3.0:1788541149.213507:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 254 00000100:00100000:3.0:1788541149.213516:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+31:12498:x1875420955913728:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1788541149.213541:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541149.213565:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a8749 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331594 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541149.213668:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a8750 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541149.213683:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a8750 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541149.213697:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a8750 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541149.213708:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788541149.214219:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ada00/0x2aac941e5f4a8749 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331594 expref: 34 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541149.214239:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a8750 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331594 expref: 33 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541149.214267:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a67078a1500) 00010000:00010000:3.0:1788541149.214270:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788541149.214274:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075aca00, rc 0) 00000100:00100000:3.0:1788541149.214342:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+33:12498:x1875420955913728:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 826us (941us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1788541149.214350:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 254 00000100:00080000:3.0:1788541149.214377:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788541149.219486:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541149.219967:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955913856 00000100:00100000:0.0:1788541149.219977:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955913856 00000100:00100000:0.0:1788541149.220043:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 255 00000100:00100000:0.0:1788541149.220054:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+33:12498:x1875420955913856:12345-192.168.202.56@tcp:54:lfs.0 00010000:00010000:0.0:1788541149.220128:0:9339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031e00/0x2aac941e5f4a875e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541149.220147:0:9339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031e00/0x2aac941e5f4a875e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541149.220159:0:9339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031e00/0x2aac941e5f4a875e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541149.220203:0:9339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031e00/0x2aac941e5f4a875e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541149.220210:0:9339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031e00/0x2aac941e5f4a875e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541149.220217:0:9339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031e00/0x2aac941e5f4a875e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541149.220229:0:9339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6800031e00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541149.220234:0:9339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031e00/0x2aac941e5f4a875e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541149.220241:0:9339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031e00/0x2aac941e5f4a875e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541149.220253:0:9339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a67078a1500) 00010000:00010000:0.0:1788541149.220256:0:9339:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788541149.220260:0:9339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031e00/0x2aac941e5f4a875e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541149.220266:0:9339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6800031e00/0x2aac941e5f4a875e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9339 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541149.220758:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+33:12498:x1875420955913856:12345-192.168.202.56@tcp:54:lfs.0 Request processed in 703us (1280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541149.220766:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 255 00000100:00100000:3.0:1788541149.286650:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541149.286723:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955913984 00000100:00100000:2.0:1788541149.286750:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955913984 00000100:00080000:3.0:1788541149.286830:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788541149.286837:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 78 00000100:00100000:2.0:1788541149.286848:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708835180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:384f52e3-0481-4979-9299-157aff7472d2+7:2395:x1875420955913984:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:2.0:1788541149.287020:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541149.287410:0:8430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f658fe9c/0x2aac941e5f4a8765 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a33159b expref: -99 pid: 8430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788541149.287447:0:8430:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a9af8d9, atime: 0x6a9af8d9, ctime: 0x6a9af8d9, blocks: 0x8 00010000:00010000:3.0:1788541149.287469:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=430s v=(0 0) 00010000:00010000:3.0:1788541149.287473:0:8430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541149.287483:0:8430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f658fe9c/0x2aac941e5f4a8765 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33159b expref: 8 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541149.287505:0:8430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f658fe9c/0x2aac941e5f4a8765 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33159b expref: 8 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541149.287519:0:8430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075ace00, rc 0) 00000100:00100000:3.0:1788541149.287584:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708835180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:384f52e3-0481-4979-9299-157aff7472d2+8:2395:x1875420955913984:12345-192.168.202.56@tcp:101:cat.0 Request processed in 737us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541149.287604:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 78 00000100:00100000:3.0:1788541149.292563:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541149.292661:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955914112 00000100:00100000:0.0:1788541149.292670:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955914112 00002000:00100000:0.0:1788541149.292715:0:8436:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff9a6708834380 x1875420955914112/t0(0) o3->384f52e3-0481-4979-9299-157aff7472d2@192.168.202.56@tcp:520/0 lens 488/0 e 0 to 0 dl 1788541160 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788541149.292724:0:8436:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6708834380 with x1875420955914112 ext(0->4095) 00002000:00010000:0.0:1788541149.292729:0:8436:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a6708834380 00000100:00100000:0.0:1788541149.292795:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 7 00000100:00100000:0.0:1788541149.292803:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708834380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:384f52e3-0481-4979-9299-157aff7472d2+8:2394:x1875420955914112:12345-192.168.202.56@tcp:3:cat.0 00000100:00100000:0.0:1788541149.293086:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708834380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:384f52e3-0481-4979-9299-157aff7472d2+8:2394:x1875420955914112:12345-192.168.202.56@tcp:3:cat.0 Request processed in 283us (532us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788541149.293097:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 7 00002000:00100000:0.0:1788541149.293102:0:8436:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff9a6708834380 x1875420955914112/t0(0) o3->384f52e3-0481-4979-9299-157aff7472d2@192.168.202.56@tcp:520/0 lens 488/4536 e 0 to 0 dl 1788541160 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788541149.293107:0:8436:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9a6708834380 with x1875420955914112 ext(0->4095) 00002000:00010000:0.0:1788541149.293110:0:8436:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a6708834380 00000040:00080000:1.0:1788541149.450149:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788541149.450159:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788541149.450179:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788541149.450198:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788541149.770246:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541150.499107:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541150.499162:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541150.499253:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955914240 00000100:00100000:1.0:1788541150.499263:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955914240 00000100:00100000:1.0:1788541150.499321:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 395 00000100:00100000:1.0:1788541150.499331:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:2396:x1875420955914240:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1788541150.499396:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:2396:x1875420955914240:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 67us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541150.499404:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 395 00000100:00100000:0.0:1788541150.499556:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541150.499578:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541150.499606:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955914752 00000100:00100000:1.0:1788541150.499609:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955914752 00000100:00100000:1.0:1788541150.499637:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 132 00000100:00100000:1.0:1788541150.499643:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68357b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:384f52e3-0481-4979-9299-157aff7472d2+8:2396:x1875420955914752:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1788541150.499674:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68357b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:384f52e3-0481-4979-9299-157aff7472d2+8:2396:x1875420955914752:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 31us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541150.499680:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 132 00000100:00100000:0.0:1788541150.513969:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541150.514506:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955914496 00000100:00100000:2.0:1788541150.514520:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955914496 00000100:00100000:3.0:1788541150.514636:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955915008 00000100:00100000:3.0:1788541150.514641:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955915008 00000100:00100000:3.0:1788541150.514689:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 349 00000100:00100000:3.0:1788541150.514700:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+5:2396:x1875420955914496:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541150.514787:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:384f52e3-0481-4979-9299-157aff7472d2+5:2396:x1875420955914496:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 88us (15624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541150.514795:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 349 00000100:00100000:3.0:1788541150.514813:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 350 00000100:00100000:3.0:1788541150.514820:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2396:x1875420955915008:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541150.514845:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2396:x1875420955915008:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 26us (15266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541150.514851:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 350 00000100:00080000:2.0:1788541150.515228:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788541150.520935:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541150.520970:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541150.521011:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955914368 00000100:00100000:0.0:1788541150.521020:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955914368 00000100:00100000:0.0:1788541150.521075:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955914880 00000100:00100000:0.0:1788541150.521078:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955914880 00000100:00100000:0.0:1788541150.521114:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 351 00000100:00100000:0.0:1788541150.521125:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+33:2396:x1875420955914368:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541150.521231:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+33:2396:x1875420955914368:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 108us (7271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541150.521239:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 351 00000100:00100000:0.0:1788541150.521258:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 352 00000100:00100000:0.0:1788541150.521266:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2396:x1875420955914880:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1788541150.521966:0:8973:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955914624 00000100:00100000:1.0:1788541150.521975:0:8973:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955914624 00000100:00100000:1.0:1788541150.522030:0:8973:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 133 00000100:00100000:1.0:1788541150.522040:0:8973:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:384f52e3-0481-4979-9299-157aff7472d2+5:2396:x1875420955914624:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1788541150.522082:0:8973:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:384f52e3-0481-4979-9299-157aff7472d2+5:2396:x1875420955914624:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 44us (1158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541150.522088:0:8973:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 133 00000100:00080000:2.0:1788541150.522942:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788541150.522949:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788541150.524421:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2396:x1875420955914880:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 3141us (3436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541150.524446:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 352 00010000:00010000:2.0:1788541150.794032:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788541151.181295:0:8426:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000100:00100000:0.0:1788541151.692017:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981127296:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788541151.692088:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541151.692270:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981127424:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788541151.692303:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541151.693334:0:14072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981127296 00000100:00100000:2.0:1788541151.693345:0:14072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981127296 00000100:00100000:2.0:1788541151.693415:0:14072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788541151.693426:0:14072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981127296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788541151.693461:0:14072:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788541151.693524:0:14072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981127296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (1437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541151.693532:0:14072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:2.0:1788541151.693552:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788541151.693590:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981127296:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788541151.693925:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981127424 00000100:00100000:3.0:1788541151.693931:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981127424 00000100:00100000:3.0:1788541151.693964:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788541151.693971:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981127424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788541151.693993:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788541151.694034:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981127424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 64us (1730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541151.694041:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788541151.694094:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981127424:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788541151.696588:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788541151.696612:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981127552:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788541151.696696:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541151.697866:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981127552 00000100:00100000:0.0:1788541151.697900:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981127552 00000100:00100000:0.0:1788541151.697971:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788541151.697981:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708834a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981127552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788541151.698006:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788541151.698082:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708834a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981127552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (1386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541151.698089:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:1.0:1788541151.699318:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788541151.699907:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:3.0:1788541151.699915:0:3641:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:3.0:1788541151.699938:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a6708312d80, transno 4294967311 00000100:00100000:3.0:1788541151.699960:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981127552:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1788541151.710584:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000004:00080000:2.0:1788541151.710601:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:2.0:1788541151.710644:0:6496:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a6835519a80 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1788541151.710650:0:6496:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a6707573400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a68355193c0 00000020:00080000:2.0:1788541151.710666:0:6496:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9a6707573500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a67075a0e00 00000020:00080000:2.0:1788541151.710695:0:6496:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1788541151.710711:0:6549:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1788541151.710791:0:6549:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:1.0:1788541151.710965:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788541151.710996:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670687b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981127680:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788541151.711064:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541151.711129:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981127680 00000100:00100000:1.0:1788541151.711136:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981127680 00000100:00100000:1.0:1788541151.711206:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788541151.711217:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706878000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3644:x1875420981127680:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788541151.711334:0:8431:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788541151.711338:0:8431:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1788541145 -> 1788541145 00002000:00010000:1.0:1788541151.711341:0:8431:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 1788541145 -> 1788541145 00002000:00010000:1.0:1788541151.711343:0:8431:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788541145 -> 1788541145 00002000:00010000:1.0:1788541151.711353:0:8431:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788541151.711394:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706878000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3644:x1875420981127680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 179us (330us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1788541151.711402:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1788541151.711597:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1788541151.711632:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a670687b480/2, rc 0, transno 4294967325 00000100:00100000:1.0:1788541151.711639:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670687b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981127680:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1788541151.712291:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957c00/0x2aac941e5f4a86e0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541151.712305:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957c00/0x2aac941e5f4a86e0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541151.712313:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957c00/0x2aac941e5f4a86e0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541151.712319:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706957c00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541151.712324:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957c00/0x2aac941e5f4a86e0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541151.712332:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957c00/0x2aac941e5f4a86e0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541151.712350:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9a67078a1e00) 00010000:00010000:0.0:1788541151.712363:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541151.712369:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957c00/0x2aac941e5f4a86e0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541151.712375:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957c00/0x2aac941e5f4a86e0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788541151.716393:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:0.0:1788541151.716414:0:9510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00010000:00010000:0.0:1788541151.819034:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541152.716181:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788541152.716210:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670687a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981127808:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788541152.716292:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541152.716928:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981127808 00000100:00100000:1.0:1788541152.716937:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981127808 00000100:00100000:1.0:1788541152.716999:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1788541152.717009:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981127808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788541152.717046:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788541152.717106:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981127808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541152.717113:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1788541152.717172:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670687a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981127808:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788541152.842407:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541153.738373:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875420981128064:0@lo:400:kworker.0 00000100:00100000:0.0:1788541153.738446:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541153.738509:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875420981128576:0@lo:400:kworker.0 00000100:00100000:0.0:1788541153.738531:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541153.738554:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875420981129088:0@lo:400:kworker.0 00000100:00100000:0.0:1788541153.738576:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541153.738614:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1788541153.738620:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420981127936:0@lo:400:kworker.0 00000100:00100000:0.0:1788541153.738648:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541153.738670:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981128448:0@lo:400:kworker.0 00000100:00100000:0.0:1788541153.738694:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541153.738711:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981128960:0@lo:400:kworker.0 00000100:00100000:0.0:1788541153.738732:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541153.738749:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981129472:0@lo:400:kworker.0 00000100:00100000:0.0:1788541153.738788:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541153.738816:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981128192:0@lo:400:kworker.0 00000100:00100000:0.0:1788541153.738839:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541153.738896:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875420981128704:0@lo:400:kworker.0 00000100:00100000:0.0:1788541153.738919:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541153.738937:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875420981129216:0@lo:400:kworker.0 00000100:00100000:0.0:1788541153.738960:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541153.738979:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788541153.738985:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875420981128320:0@lo:400:kworker.0 00000100:00100000:0.0:1788541153.739015:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541153.739026:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981128832:0@lo:400:kworker.0 00000100:00100000:0.0:1788541153.739043:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541153.739058:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981129344:0@lo:400:kworker.0 00000100:00100000:0.0:1788541153.739259:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541153.739295:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981128064 00000100:00100000:0.0:1788541153.739303:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981128064 00000100:00100000:0.0:1788541153.739342:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981128576 00000100:00100000:0.0:1788541153.739345:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981128576 00000100:00100000:0.0:1788541153.739367:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981129088 00000100:00100000:0.0:1788541153.739370:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981129088 00000100:00100000:0.0:1788541153.739383:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981128704 00000100:00100000:0.0:1788541153.739385:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981128704 00000100:00100000:0.0:1788541153.739396:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981129216 00000100:00100000:0.0:1788541153.739398:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981129216 00000100:00100000:0.0:1788541153.739410:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981128320 00000100:00100000:0.0:1788541153.739413:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981128320 00000100:00100000:0.0:1788541153.739427:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1788541153.739436:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875420981128064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541153.739494:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875420981128064:12345-0@lo:400:kworker.0 Request processed in 58us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541153.739503:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1788541153.739521:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1788541153.739527:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875420981128576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541153.739553:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875420981128576:12345-0@lo:400:kworker.0 Request processed in 27us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541153.739560:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1788541153.739571:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1788541153.739576:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875420981129088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541153.739770:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788541153.739783:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981129600:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788541153.739815:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541153.739890:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981129600 00000100:00100000:2.0:1788541153.739895:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981129600 00000100:00100000:2.0:1788541153.739932:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788541153.739939:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670687a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981129600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788541153.739962:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788541153.740014:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670687a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981129600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541153.740020:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788541153.740055:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:2.0:1788541153.740061:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a67080a4a80, transno 4294967322 00000004:00080000:2.0:1788541153.740082:0:3641:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967325 00000004:00080000:2.0:1788541153.740099:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a670687b480, transno 4294967325 00000100:00100000:2.0:1788541153.740110:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981129600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788541153.740738:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875420981129088:12345-0@lo:400:kworker.0 Request processed in 1158us (2157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541153.740746:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1788541153.740764:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1788541153.740773:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875420981128704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541153.740826:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875420981128704:12345-0@lo:400:kworker.0 Request processed in 55us (1905us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541153.740832:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1788541153.740843:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1788541153.740850:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707818380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875420981129216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541153.740905:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707818380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875420981129216:12345-0@lo:400:kworker.0 Request processed in 56us (1944us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541153.740911:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1788541153.740923:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1788541153.740930:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670781a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875420981128320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541153.740970:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670781a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875420981128320:12345-0@lo:400:kworker.0 Request processed in 41us (1954us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541153.740975:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1788541153.741388:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981129728:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788541153.741426:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541153.741472:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875420981128320:0@lo:400:kworker.0 00010000:00080000:1.0:1788541153.741487:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707b7fb80 x1875420981128704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541153.741497:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875420981128704:0@lo:400:kworker.0 00010000:00080000:1.0:1788541153.741519:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707b7e300 x1875420981129216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541153.741529:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875420981129216:0@lo:400:kworker.0 00000100:00100000:2.0:1788541153.741793:0:14072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981129728 00000100:00100000:2.0:1788541153.741801:0:14072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981129728 00000100:00100000:2.0:1788541153.741853:0:14072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788541153.741861:0:14072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670687aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981129728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788541153.741907:0:14072:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788541153.741952:0:14072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670687aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981129728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541153.741958:0:14072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788541153.742003:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981129728:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788541153.742496:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981128448 00000100:00100000:3.0:1788541153.742503:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981128448 00000100:00100000:3.0:1788541153.742542:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981128192 00000100:00100000:3.0:1788541153.742545:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981128192 00000100:00100000:3.0:1788541153.742559:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788541153.742565:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981128448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541153.742702:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981128960 00000100:00100000:1.0:1788541153.742707:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981128960 00000100:00100000:1.0:1788541153.742731:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981129472 00000100:00100000:1.0:1788541153.742734:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981129472 00000100:00100000:1.0:1788541153.742744:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981128832 00000100:00100000:1.0:1788541153.742746:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981128832 00000100:00100000:1.0:1788541153.742756:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981129344 00000100:00100000:1.0:1788541153.742758:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981129344 00000100:00100000:1.0:1788541153.742769:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788541153.742775:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981128960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541153.742811:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981128960:12345-0@lo:400:kworker.0 Request processed in 36us (4077us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541153.742818:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788541153.742832:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788541153.742838:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981129472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541153.742899:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981129472:12345-0@lo:400:kworker.0 Request processed in 61us (4110us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541153.742906:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788541153.742917:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788541153.742922:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670781bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981128832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541153.742954:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670781bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981128832:12345-0@lo:400:kworker.0 Request processed in 32us (3910us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541153.742960:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788541153.742982:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788541153.743000:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707818e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981129344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541153.743033:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707818e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981129344:12345-0@lo:400:kworker.0 Request processed in 45us (3774us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541153.743038:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788541153.743435:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788541153.743447:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981128192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541153.743485:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981128192:12345-0@lo:400:kworker.0 Request processed in 42us (4646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541153.743492:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788541153.743535:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981128832:0@lo:400:kworker.0 00000100:00100000:2.0:1788541153.743546:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981129344:0@lo:400:kworker.0 00000100:00100000:2.0:1788541153.743556:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981128192:0@lo:400:kworker.0 00000100:00100000:3.0:1788541153.743652:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981128448:12345-0@lo:400:kworker.0 Request processed in 1086us (4956us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541153.743660:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788541153.743692:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981127936 00000100:00100000:3.0:1788541153.743697:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981127936 00000100:00100000:3.0:1788541153.743728:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1788541153.743734:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+24:3642:x1875420981127936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541153.743767:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:425687b6-1d99-41d2-88d8-2fb230997596+24:3642:x1875420981127936:12345-0@lo:400:kworker.0 Request processed in 33us (5118us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541153.743773:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00080000:0.0:1788541153.744278:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788541153.744284:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788541153.744287:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788541153.744290:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788541153.744314:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420981127936:0@lo:400:kworker.0 00000100:00100000:0.0:1788541153.744327:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981128448:0@lo:400:kworker.0 00000100:00100000:0.0:1788541153.744340:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981128960:0@lo:400:kworker.0 00000100:00100000:0.0:1788541153.744351:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981129472:0@lo:400:kworker.0 00000100:00100000:0.0:1788541153.744361:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875420981128064:0@lo:400:kworker.0 00000100:00100000:0.0:1788541153.744371:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875420981128576:0@lo:400:kworker.0 00000100:00100000:0.0:1788541153.744382:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875420981129088:0@lo:400:kworker.0 00010000:00010000:2.0:1788541153.867236:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541154.731491:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541154.739743:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955915136 00000100:00100000:0.0:1788541154.739761:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955915136 00000100:00100000:0.0:1788541154.739961:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 256 00000100:00100000:0.0:1788541154.739972:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+19:12143:x1875420955915136:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788541154.740072:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:384f52e3-0481-4979-9299-157aff7472d2+19:12143:x1875420955915136:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 Request processed in 102us (8592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541154.740079:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 256 00000100:00080000:1.0:1788541154.741512:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788541154.741974:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541154.747784:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955915264 00000100:00100000:2.0:1788541154.747803:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955915264 00000100:00100000:0.0:1788541154.748574:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 257 00000100:00100000:0.0:1788541154.748587:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+5:12143:x1875420955915264:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788541154.748715:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+5:12143:x1875420955915264:12345-192.168.202.56@tcp:60:lhsmtool_posix.0 Request processed in 130us (6745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541154.748723:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 257 00000100:00080000:2.0:1788541154.748805:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788541154.753496:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541154.754104:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955915520 00000100:00100000:2.0:1788541154.754117:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955915520 00000100:00100000:2.0:1788541154.754184:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 65 00000100:00100000:0.0:1788541154.754191:0:6521:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:2.0:1788541154.754195:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707819180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+19:12143:x1875420955915520:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788541154.754200:0:6521:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:2.0:1788541154.755153:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707819180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+20:12143:x1875420955915520:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 956us (1663us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1788541154.755164:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 65 00010000:00010000:0.0:1788541154.890521:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541155.015564:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541155.015677:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955915648 00000100:00100000:1.0:1788541155.015687:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955915648 00000100:00100000:1.0:1788541155.015761:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 258 00000100:00100000:1.0:1788541155.015772:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:12956:x1875420955915648:12345-192.168.202.56@tcp:101:lsof.0 00010000:00010000:1.0:1788541155.015796:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541155.015820:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a876c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3315a2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541155.015912:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956400/0x2aac941e5f4a8773 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541155.015926:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956400/0x2aac941e5f4a8773 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541155.015938:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956400/0x2aac941e5f4a8773 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788541155.016239:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:1.0:1788541155.016443:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788541155.016448:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788541155.016472:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956400/0x2aac941e5f4a8773 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541155.016496:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a876c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3315a2 expref: 7 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541155.016533:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956400/0x2aac941e5f4a8773 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3315a2 expref: 6 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541155.016542:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68350c0500) 00010000:00010000:1.0:1788541155.016546:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788541155.016549:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6706956400, rc 0) 00000100:00100000:1.0:1788541155.016645:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:73b94cba-5efa-45eb-b12c-fe84e695d78a+6:12956:x1875420955915648:12345-192.168.202.56@tcp:101:lsof.0 Request processed in 874us (1094us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541155.016652:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 258 00000100:00100000:3.0:1788541155.617470:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541155.617530:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541155.617584:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541155.617605:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541155.617629:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541155.617647:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541155.617689:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541155.617724:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955916288 00000100:00100000:3.0:1788541155.617737:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955916288 00000100:00100000:3.0:1788541155.617806:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955916160 00000100:00100000:3.0:1788541155.617810:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955916160 00000100:00100000:3.0:1788541155.617834:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 138 00000100:00100000:3.0:1788541155.617843:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708834000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:384f52e3-0481-4979-9299-157aff7472d2+7:2395:x1875420955916288:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541155.617952:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708834000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:384f52e3-0481-4979-9299-157aff7472d2+7:2395:x1875420955916288:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 109us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541155.617961:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 138 00000100:00100000:3.0:1788541155.617978:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 139 00000100:00100000:3.0:1788541155.617985:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708835180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:384f52e3-0481-4979-9299-157aff7472d2+5:2395:x1875420955916160:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541155.618011:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708835180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:384f52e3-0481-4979-9299-157aff7472d2+5:2395:x1875420955916160:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 27us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541155.618017:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 139 00000100:00080000:3.0:1788541155.618032:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788541155.618036:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788541155.618166:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955916032 00000100:00100000:3.0:1788541155.618170:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955916032 00000100:00100000:3.0:1788541155.618195:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955916544 00000100:00100000:3.0:1788541155.618198:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955916544 00000100:00100000:3.0:1788541155.618217:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955915904 00000100:00100000:3.0:1788541155.618220:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955915904 00000100:00100000:3.0:1788541155.618290:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955916416 00000100:00100000:3.0:1788541155.618300:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955916416 00000100:00100000:3.0:1788541155.618320:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 359 00000100:00100000:3.0:1788541155.618326:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+5:2395:x1875420955916032:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541155.618360:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+5:2395:x1875420955916032:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 34us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541155.618368:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 359 00000100:00100000:3.0:1788541155.618388:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 360 00000100:00100000:3.0:1788541155.618395:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2395:x1875420955916544:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541155.618418:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2395:x1875420955916544:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 24us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541155.618424:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 360 00000100:00100000:3.0:1788541155.618437:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 361 00000100:00100000:3.0:1788541155.618443:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+20:2395:x1875420955915904:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541155.618474:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+20:2395:x1875420955915904:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 32us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541155.618481:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 361 00000100:00100000:3.0:1788541155.618492:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 362 00000100:00100000:3.0:1788541155.618498:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b94cba-5efa-45eb-b12c-fe84e695d78a+6:2395:x1875420955916416:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541155.618520:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b94cba-5efa-45eb-b12c-fe84e695d78a+6:2395:x1875420955916416:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 23us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541155.618526:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 362 00000100:00080000:3.0:1788541155.618541:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788541155.619082:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955915776 00000100:00100000:2.0:1788541155.619088:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955915776 00000100:00100000:2.0:1788541155.619136:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 397 00000100:00100000:2.0:1788541155.619143:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:2395:x1875420955915776:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:2.0:1788541155.619208:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:2395:x1875420955915776:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 65us (1754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541155.619215:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 397 00010000:00010000:3.0:1788541155.914198:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541156.810451:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67082f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981129856:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788541156.810560:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541156.810666:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981129856 00000100:00100000:3.0:1788541156.810673:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981129856 00000100:00100000:3.0:1788541156.810726:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00080000:1.0:1788541156.810729:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788541156.810735:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981129856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788541156.810764:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788541156.810823:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981129856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541156.810831:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788541156.810994:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788541156.811006:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707818a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981129984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788541156.811049:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541156.811078:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981129984 00000100:00100000:0.0:1788541156.811082:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981129984 00000100:00100000:0.0:1788541156.811123:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788541156.811130:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670781b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981129984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788541156.811142:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788541156.811173:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670781b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981129984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541156.811179:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:0.0:1788541156.811196:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788541156.811229:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707818a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981129984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788541156.811393:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67082f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981129856:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788541156.812143:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981130112:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788541156.812190:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541156.812534:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981130112 00000100:00100000:2.0:1788541156.812541:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981130112 00000100:00100000:2.0:1788541156.812576:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788541156.812585:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707818a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981130112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788541156.812614:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788541156.812666:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707818a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981130112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541156.812673:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788541156.812701:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981130112:0@lo:41:osp-pre-1-0.0 00000001:00080000:1.0:1788541156.815977:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:1.0:1788541156.815995:0:6496:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1788541156.816174:0:6549:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1788541156.816186:0:6549:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1788541156.938037:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541157.834216:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788541157.834239:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706879880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981130240:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788541157.834309:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541157.834591:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981130240 00000100:00100000:0.0:1788541157.834600:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981130240 00000100:00100000:0.0:1788541157.834653:0:10866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788541157.834686:0:10866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981130240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788541157.834718:0:10866:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788541157.834775:0:10866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981130240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541157.834782:0:10866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788541157.834982:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706879880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981130240:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788541157.962176:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541158.858033:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788541158.858057:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981130368:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788541158.858143:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541158.858389:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788541158.858399:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706879880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981130496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788541158.858427:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541158.858457:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981130368 00000100:00100000:1.0:1788541158.858464:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981130368 00000100:00100000:1.0:1788541158.858534:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981130496 00000100:00100000:1.0:1788541158.858546:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981130496 00000100:00100000:1.0:1788541158.858567:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788541158.858575:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981130368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788541158.858603:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788541158.858652:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981130368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541158.858666:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788541158.858681:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788541158.858687:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670687ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981130496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788541158.858697:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788541158.858722:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670687ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981130496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541158.858727:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:1.0:1788541158.858739:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788541158.858769:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706879880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981130496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788541158.859215:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981130368:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788541158.861311:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670687b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981130880:0@lo:400:kworker.0 00000100:00100000:3.0:1788541158.861376:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541158.861415:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875420981131392:0@lo:400:kworker.0 00000100:00100000:3.0:1788541158.861436:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541158.861456:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875420981131904:0@lo:400:kworker.0 00000100:00100000:3.0:1788541158.861473:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541158.861507:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788541158.861519:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706879c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875420981130752:0@lo:400:kworker.0 00000100:00100000:3.0:1788541158.861696:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541158.861716:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875420981131264:0@lo:400:kworker.0 00000100:00100000:3.0:1788541158.861738:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541158.861757:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875420981131776:0@lo:400:kworker.0 00000100:00100000:3.0:1788541158.861773:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541158.861810:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981131392 00000100:00100000:3.0:1788541158.861816:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981131392 00000100:00100000:3.0:1788541158.861856:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981131904 00000100:00100000:3.0:1788541158.861859:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981131904 00000100:00100000:3.0:1788541158.861891:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981130752 00000100:00100000:3.0:1788541158.861894:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981130752 00000100:00100000:3.0:1788541158.861907:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981131264 00000100:00100000:3.0:1788541158.861909:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981131264 00000100:00100000:2.0:1788541158.862011:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706879880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420981130624:0@lo:400:kworker.0 00000100:00100000:2.0:1788541158.862051:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541158.862074:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670687b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981131136:0@lo:400:kworker.0 00000100:00100000:2.0:1788541158.862094:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541158.862123:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981131648:0@lo:400:kworker.0 00000100:00100000:2.0:1788541158.862143:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541158.862161:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788541158.862633:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706878380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875420981131008:0@lo:400:kworker.0 00000100:00100000:2.0:1788541158.862720:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541158.862733:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981131520:0@lo:400:kworker.0 00000100:00100000:2.0:1788541158.862752:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541158.862786:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981130624 00000100:00100000:2.0:1788541158.862791:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981130624 00000100:00100000:2.0:1788541158.862822:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:2.0:1788541158.862831:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+24:3642:x1875420981130624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541158.862903:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:425687b6-1d99-41d2-88d8-2fb230997596+24:3642:x1875420981130624:12345-0@lo:400:kworker.0 Request processed in 72us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541158.862910:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1788541158.863846:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981131776 00000100:00100000:3.0:1788541158.863852:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981131776 00000100:00100000:3.0:1788541158.863901:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981131008 00000100:00100000:3.0:1788541158.863904:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981131008 00000100:00100000:2.0:1788541158.864045:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981130880 00000100:00100000:2.0:1788541158.864050:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981130880 00000100:00100000:2.0:1788541158.864079:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981131136 00000100:00100000:2.0:1788541158.864082:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981131136 00000100:00100000:2.0:1788541158.864106:0:10866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1788541158.864113:0:10866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981130880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541158.864347:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1788541158.864357:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981131136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541158.864395:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981131136:12345-0@lo:400:kworker.0 Request processed in 41us (2300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541158.864402:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1788541158.864763:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1788541158.864778:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708312d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875420981131392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541158.865217:0:10866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981130880:12345-0@lo:400:kworker.0 Request processed in 1101us (3837us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541158.865225:0:10866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1788541158.865284:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706879880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420981130624:0@lo:400:kworker.0 00000100:00100000:2.0:1788541158.865298:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670687b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981131136:0@lo:400:kworker.0 00000100:00100000:2.0:1788541158.865363:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1788541158.865373:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708310000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875420981131904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541158.865455:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708312d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875420981131392:12345-0@lo:400:kworker.0 Request processed in 681us (4017us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541158.865463:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1788541158.865480:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1788541158.865498:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708310e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875420981130752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541158.865549:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708310e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875420981130752:12345-0@lo:400:kworker.0 Request processed in 53us (3999us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541158.865555:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1788541158.865568:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1788541158.865574:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708310a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875420981131264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541158.865612:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708310a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875420981131264:12345-0@lo:400:kworker.0 Request processed in 39us (3874us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541158.865619:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1788541158.865631:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1788541158.865638:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708311500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875420981131776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541158.865691:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708311500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875420981131776:12345-0@lo:400:kworker.0 Request processed in 54us (3916us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541158.865698:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1788541158.865710:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1788541158.865717:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875420981131008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541158.865752:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875420981131008:12345-0@lo:400:kworker.0 Request processed in 36us (3032us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541158.865757:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1788541158.865780:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981131648 00000100:00100000:3.0:1788541158.865787:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981131648 00000100:00100000:3.0:1788541158.865822:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981131520 00000100:00100000:3.0:1788541158.865825:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981131520 00000100:00100000:3.0:1788541158.865843:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788541158.865850:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981131648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541158.865900:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981131648:12345-0@lo:400:kworker.0 Request processed in 51us (3756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541158.865906:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788541158.865916:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788541158.865932:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981131520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541158.865958:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981131520:12345-0@lo:400:kworker.0 Request processed in 38us (3205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541158.865964:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:3.0:1788541158.865983:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788541158.865987:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788541158.865990:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788541158.867948:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706878380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875420981131008:0@lo:400:kworker.0 00000100:00100000:0.0:1788541158.867965:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981131520:0@lo:400:kworker.0 00000100:00100000:0.0:1788541158.867978:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981131648:0@lo:400:kworker.0 00000100:00100000:2.0:1788541158.873778:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708310000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875420981131904:12345-0@lo:400:kworker.0 Request processed in 8169us (12064us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541158.873803:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1788541158.874372:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670687b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981130880:0@lo:400:kworker.0 00010000:00080000:1.0:1788541158.874392:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707b7f480 x1875420981131392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541158.874404:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875420981131392:0@lo:400:kworker.0 00010000:00080000:1.0:1788541158.874427:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707b7ce00 x1875420981131904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541158.874436:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875420981131904:0@lo:400:kworker.0 00000100:00100000:1.0:1788541158.874464:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706879c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875420981130752:0@lo:400:kworker.0 00000100:00100000:1.0:1788541158.874490:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875420981131264:0@lo:400:kworker.0 00000100:00100000:1.0:1788541158.874502:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875420981131776:0@lo:400:kworker.0 00010000:00010000:3.0:1788541158.987418:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788541159.441472:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:0.0:1788541159.641186:0:15009:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 12:59:17 (1788541157) 00000040:00080000:1.0:1788541159.691008:0:13798:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788541159.691018:0:13798:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788541159.691139:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1788541159.691147:0:13798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788541160.010048:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541160.751118:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541160.751402:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541160.751478:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541160.751512:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541160.751556:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955917184 00000100:00100000:2.0:1788541160.751566:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955917184 00000100:00100000:2.0:1788541160.751624:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 142 00000100:00100000:2.0:1788541160.751633:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:384f52e3-0481-4979-9299-157aff7472d2+7:2394:x1875420955917184:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541160.751688:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955916672 00000100:00100000:2.0:1788541160.751719:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:384f52e3-0481-4979-9299-157aff7472d2+7:2394:x1875420955917184:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 85us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541160.751726:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 142 00000100:00100000:3.0:1788541160.751768:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955916672 00000100:00100000:3.0:1788541160.755673:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 399 00000100:00100000:3.0:1788541160.755697:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:2394:x1875420955916672:12345-192.168.202.56@tcp:400:kworker.0 00000100:00080000:2.0:1788541160.757378:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788541160.761043:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:2394:x1875420955916672:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 5351us (9928us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541160.761056:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 399 00000100:00100000:1.0:1788541160.768112:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541160.772510:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955916928 00000100:00100000:0.0:1788541160.772538:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955916928 00000100:00100000:0.0:1788541160.772621:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955917440 00000100:00100000:0.0:1788541160.772624:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955917440 00000100:00100000:0.0:1788541160.772650:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 369 00000100:00100000:0.0:1788541160.772660:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+5:2394:x1875420955916928:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541160.773088:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+5:2394:x1875420955916928:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 417us (21675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541160.773097:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 369 00000100:00100000:0.0:1788541160.773118:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 370 00000100:00100000:0.0:1788541160.773125:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2394:x1875420955917440:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541160.773153:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2394:x1875420955917440:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 29us (21640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541160.773158:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 370 00000100:00080000:0.0:1788541160.773189:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788541160.773849:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541160.773903:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541160.774033:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955917056 00000100:00100000:3.0:1788541160.774039:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955917056 00000100:00100000:3.0:1788541160.774156:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 143 00000100:00100000:3.0:1788541160.774165:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:384f52e3-0481-4979-9299-157aff7472d2+5:2394:x1875420955917056:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541160.774208:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:384f52e3-0481-4979-9299-157aff7472d2+5:2394:x1875420955917056:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 45us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541160.774215:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 143 00000100:00100000:0.0:1788541160.795680:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955916800 00000100:00100000:0.0:1788541160.795696:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955916800 00000100:00100000:0.0:1788541160.795786:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955917312 00000100:00100000:0.0:1788541160.795789:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955917312 00000100:00100000:0.0:1788541160.795817:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 371 00000100:00100000:0.0:1788541160.795827:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+19:2394:x1875420955916800:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541160.795937:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+19:2394:x1875420955916800:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 111us (27834us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541160.795944:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 371 00000100:00100000:0.0:1788541160.795960:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 372 00000100:00100000:0.0:1788541160.795965:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:73b94cba-5efa-45eb-b12c-fe84e695d78a+6:2394:x1875420955917312:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541160.795988:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:73b94cba-5efa-45eb-b12c-fe84e695d78a+6:2394:x1875420955917312:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 23us (22085us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541160.795994:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 372 00000100:00080000:0.0:1788541160.796028:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788541160.796033:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788541161.034647:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541161.930053:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670781b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981132032:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788541161.930133:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541161.930190:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788541161.930196:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707818000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981132160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788541161.930224:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541161.930258:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981132032 00000100:00100000:0.0:1788541161.930265:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981132032 00000100:00100000:0.0:1788541161.930455:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788541161.930467:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707819500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981132032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788541161.930610:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788541161.930777:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707819500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981132032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 312us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541161.930785:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788541161.930814:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981132160 00000100:00100000:0.0:1788541161.930818:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981132160 00000100:00100000:0.0:1788541161.930850:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788541161.930857:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670781ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981132160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788541161.930904:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788541161.930944:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670781ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981132160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541161.930951:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:0.0:1788541161.930967:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788541161.931060:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707818000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981132160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788541161.931086:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670781b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981132032:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788541161.931185:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707819880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981132288:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788541161.931217:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541161.932969:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981132288 00000100:00100000:3.0:1788541161.932981:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981132288 00000100:00100000:3.0:1788541161.933040:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788541161.933049:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981132288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788541161.933083:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1788541161.933229:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788541161.940007:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981132288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6947us (8776us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541161.940024:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788541161.942002:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707819880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981132288:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788541162.063021:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541162.954170:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788541162.954192:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981132416:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788541162.954263:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541162.954447:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981132416 00000100:00100000:3.0:1788541162.954456:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981132416 00000100:00100000:3.0:1788541162.954518:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788541162.954529:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981132416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788541162.954561:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788541162.954636:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981132416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541162.954643:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1788541162.954940:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981132416:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788541163.082980:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541163.978244:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788541163.978268:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981132544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788541163.978344:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541163.978467:0:14072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981132544 00000100:00100000:1.0:1788541163.978477:0:14072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981132544 00000100:00100000:1.0:1788541163.978541:0:14072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788541163.978552:0:14072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708313100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981132544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788541163.978599:0:14072:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788541163.978650:0:14072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708313100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981132544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541163.978657:0:14072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788541163.978704:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981132544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788541163.978912:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706879c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875420981132800:0@lo:400:kworker.0 00000100:00100000:2.0:1788541163.978955:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541163.978980:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706879880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875420981133312:0@lo:400:kworker.0 00000100:00100000:2.0:1788541163.979002:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541163.979021:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875420981133824:0@lo:400:kworker.0 00000100:00100000:2.0:1788541163.979042:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541163.979069:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788541163.979074:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670687b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981132928:0@lo:400:kworker.0 00000100:00100000:2.0:1788541163.979098:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541163.979124:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875420981133440:0@lo:400:kworker.0 00000100:00100000:2.0:1788541163.979146:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541163.979159:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875420981133952:0@lo:400:kworker.0 00000100:00100000:2.0:1788541163.979177:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541163.979313:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981132800 00000100:00100000:1.0:1788541163.979317:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981132800 00000100:00100000:1.0:1788541163.979339:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981133312 00000100:00100000:1.0:1788541163.979341:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981133312 00000100:00100000:1.0:1788541163.979356:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981133824 00000100:00100000:1.0:1788541163.979359:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981133824 00000100:00100000:1.0:1788541163.979371:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981133440 00000100:00100000:1.0:1788541163.979373:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981133440 00000100:00100000:1.0:1788541163.979383:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981133952 00000100:00100000:1.0:1788541163.979385:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981133952 00000100:00100000:1.0:1788541163.979400:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1788541163.979407:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875420981132800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541163.979454:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875420981132800:12345-0@lo:400:kworker.0 Request processed in 47us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541163.979461:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1788541163.979475:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1788541163.979481:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875420981133312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541163.979509:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875420981133312:12345-0@lo:400:kworker.0 Request processed in 29us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541163.979514:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1788541163.979525:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1788541163.979530:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875420981133824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541163.979564:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875420981133824:12345-0@lo:400:kworker.0 Request processed in 34us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541163.979570:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1788541163.979581:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1788541163.979587:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875420981133440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541163.979611:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875420981133440:12345-0@lo:400:kworker.0 Request processed in 25us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541163.979617:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1788541163.979627:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1788541163.979633:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875420981133952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541163.979659:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875420981133952:12345-0@lo:400:kworker.0 Request processed in 26us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541163.979664:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1788541163.979682:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420981132672:0@lo:400:kworker.0 00000100:00100000:1.0:1788541163.979708:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541163.979730:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670687b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981133184:0@lo:400:kworker.0 00000100:00100000:1.0:1788541163.979752:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541163.979767:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981133696:0@lo:400:kworker.0 00000100:00100000:1.0:1788541163.979790:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541163.979806:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981134208:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788541163.979826:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541163.979843:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788541163.979849:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706878380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875420981133056:0@lo:400:kworker.0 00000100:00100000:1.0:1788541163.979892:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541163.980008:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981132672 00000100:00100000:2.0:1788541163.980013:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981132672 00000100:00100000:2.0:1788541163.980044:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:2.0:1788541163.980061:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+24:3642:x1875420981132672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541163.980092:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+24:3642:x1875420981132672:12345-0@lo:400:kworker.0 Request processed in 42us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541163.980098:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:2.0:1788541163.980128:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981133696 00000100:00100000:2.0:1788541163.980132:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981133696 00000100:00100000:2.0:1788541163.980161:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788541163.980167:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981133696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541163.980195:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981133696:12345-0@lo:400:kworker.0 Request processed in 29us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541163.980201:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00010000:00080000:2.0:1788541163.980243:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6705aa5500 x1875420981133440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541163.980256:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875420981133440:0@lo:400:kworker.0 00010000:00080000:2.0:1788541163.980265:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6705aa5f80 x1875420981133952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541163.980274:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875420981133952:0@lo:400:kworker.0 00000100:00100000:2.0:1788541163.980282:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706879c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875420981132800:0@lo:400:kworker.0 00000100:00100000:2.0:1788541163.980299:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706879880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875420981133312:0@lo:400:kworker.0 00000100:00100000:2.0:1788541163.980307:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875420981133824:0@lo:400:kworker.0 00000100:00100000:2.0:1788541163.980347:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981133056 00000100:00100000:2.0:1788541163.980349:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981133056 00000100:00100000:2.0:1788541163.980366:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1788541163.980371:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875420981133056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541163.980395:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1875420981133056:12345-0@lo:400:kworker.0 Request processed in 25us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541163.980401:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1788541163.980522:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981133568:0@lo:400:kworker.0 00000100:00100000:1.0:1788541163.980548:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541163.980571:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981134080:0@lo:400:kworker.0 00000100:00100000:1.0:1788541163.980589:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541163.980607:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420981132672:0@lo:400:kworker.0 00000100:00100000:1.0:1788541163.980617:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981133696:0@lo:400:kworker.0 00000100:00100000:1.0:1788541163.980631:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706878380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3642:1875420981133056:0@lo:400:kworker.0 00000100:00080000:3.0:1788541163.980832:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788541163.980839:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788541163.980842:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788541163.980844:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788541163.980862:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981134208 00000100:00100000:3.0:1788541163.980867:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981134208 00000100:00100000:3.0:1788541163.980945:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788541163.980953:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981134208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788541163.980968:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788541163.981010:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981134208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (1182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541163.981016:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788541163.981040:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981132928 00000100:00100000:3.0:1788541163.981044:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981132928 00000100:00100000:3.0:1788541163.981075:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981133184 00000100:00100000:3.0:1788541163.981078:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981133184 00000100:00100000:3.0:1788541163.981090:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788541163.981096:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981132928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541163.981131:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981132928:12345-0@lo:400:kworker.0 Request processed in 36us (2033us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541163.981137:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788541163.981148:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788541163.981162:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981133184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541163.981192:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981133184:12345-0@lo:400:kworker.0 Request processed in 31us (1439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541163.981198:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788541163.981230:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670687b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981132928:0@lo:400:kworker.0 00000100:00100000:0.0:1788541163.981400:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981133568 00000100:00100000:0.0:1788541163.981404:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981133568 00000100:00100000:0.0:1788541163.981440:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981134080 00000100:00100000:0.0:1788541163.981443:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981134080 00000100:00100000:0.0:1788541163.981462:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788541163.981468:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981133568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541163.981501:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981133568:12345-0@lo:400:kworker.0 Request processed in 33us (952us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541163.981506:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788541163.981522:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788541163.981527:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981134080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541163.981553:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981134080:12345-0@lo:400:kworker.0 Request processed in 26us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541163.981603:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:1.0:1788541163.981676:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788541163.981679:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788541163.981701:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981133568:0@lo:400:kworker.0 00000100:00100000:1.0:1788541163.981711:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981134080:0@lo:400:kworker.0 00000100:00100000:1.0:1788541163.981718:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670687b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981133184:0@lo:400:kworker.0 00000100:00100000:1.0:1788541163.981734:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981134208:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788541164.110859:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541164.782358:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541164.782739:0:14972:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955917696 00000100:00100000:1.0:1788541164.782751:0:14972:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955917696 00000100:00100000:1.0:1788541164.782839:0:14972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 66 00000100:00100000:1.0:1788541164.782851:0:14972:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707819c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:384f52e3-0481-4979-9299-157aff7472d2+19:13180:x1875420955917696:12345-192.168.202.56@tcp:35:umount.0 00000100:00100000:1.0:1788541164.783401:0:14972:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707819c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:384f52e3-0481-4979-9299-157aff7472d2+20:13180:x1875420955917696:12345-192.168.202.56@tcp:35:umount.0 Request processed in 551us (1049us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1788541164.783410:0:14972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 66 00000100:00080000:3.0:1788541164.785283:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1788541164.786437:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000100:00100000:3.0:1788541164.802420:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541164.802600:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955917952 00000100:00100000:0.0:1788541164.802612:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955917952 00000100:00100000:0.0:1788541164.802679:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 67 00000100:00100000:0.0:1788541164.802691:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708310700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+19:13180:x1875420955917952:12345-192.168.202.56@tcp:35:umount.0 00000100:00100000:0.0:1788541164.804780:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708310700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+20:13180:x1875420955917952:12345-192.168.202.56@tcp:35:umount.0 Request processed in 2073us (2424us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1788541164.804794:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 67 00000100:00100000:1.0:1788541164.825982:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541164.826294:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955918208 00000100:00100000:2.0:1788541164.826305:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955918208 00000100:00100000:2.0:1788541164.826377:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 68 00000100:00100000:2.0:1788541164.826391:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6807dff450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+20:13180:x1875420955918208:12345-192.168.202.56@tcp:35:umount.0 00000100:00100000:2.0:1788541164.827842:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6807dff450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:384f52e3-0481-4979-9299-157aff7472d2+21:13180:x1875420955918208:12345-192.168.202.56@tcp:35:umount.0 Request processed in 1448us (1862us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1788541164.827854:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 68 00000100:00100000:2.0:1788541164.833007:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541164.833233:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955918464 00000100:00100000:0.0:1788541164.833244:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955918464 00000100:00100000:0.0:1788541164.833296:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 69 00000100:00100000:0.0:1788541164.833307:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+21:13180:x1875420955918464:12345-192.168.202.56@tcp:35:umount.0 00000100:00100000:0.0:1788541164.835079:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:384f52e3-0481-4979-9299-157aff7472d2+22:13180:x1875420955918464:12345-192.168.202.56@tcp:35:umount.0 Request processed in 1759us (2068us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1788541164.835096:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 69 00000100:00100000:0.0:1788541164.841826:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541164.842258:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541164.842300:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541164.842330:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541164.842437:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955919104 00000100:00100000:0.0:1788541164.842448:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955919104 00000100:00100000:0.0:1788541164.842580:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955918976 00000100:00100000:0.0:1788541164.842584:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955918976 00000100:00100000:3.0:1788541164.842686:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955919232 00000100:00100000:3.0:1788541164.842691:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955919232 00000100:00100000:3.0:1788541164.842716:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 19 00000100:00100000:3.0:1788541164.842725:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670781b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de51b185-1fb8-4395-8428-f3d8fb602cc3+14:2394:x1875420955919104:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541164.842740:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541164.842829:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6812045c00/0x2aac941e5f4a768d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3310b6 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541164.842851:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541164.842996:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 20 00000100:00100000:0.0:1788541164.843003:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707818700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de51b185-1fb8-4395-8428-f3d8fb602cc3+14:2394:x1875420955919232:12345-192.168.202.56@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788541164.843252:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670781b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de51b185-1fb8-4395-8428-f3d8fb602cc3+14:2394:x1875420955919104:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 526us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541164.843261:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 19 00000100:00100000:3.0:1788541164.843283:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 21 00000100:00100000:3.0:1788541164.843290:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670781a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de51b185-1fb8-4395-8428-f3d8fb602cc3+13:2394:x1875420955918976:12345-192.168.202.56@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788541164.843359:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955918848 00000100:00100000:2.0:1788541164.843364:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955918848 00000100:00100000:2.0:1788541164.843406:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 80 00000100:00100000:2.0:1788541164.843413:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670781aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:384f52e3-0481-4979-9299-157aff7472d2+7:2393:x1875420955918848:12345-192.168.202.56@tcp:9:umount.0 00000020:00000080:2.0:1788541164.843436:0:8431:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a7cde 00000020:00010000:2.0:1788541164.843444:0:8431:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9a6815c6a800: total 0 00000100:00080000:2.0:1788541164.843448:0:8431:0:(import.c:65:import_set_state_nolock()) ffff9a6815c6f000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788541164.843498:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1788541164.843639:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670781aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:384f52e3-0481-4979-9299-157aff7472d2+5:2393:x1875420955918848:12345-192.168.202.56@tcp:9:umount.0 Request processed in 225us (1824us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541164.843646:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 80 00000020:00010000:1.0:1788541164.845151:0:6506:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9a6815c6a800: total 0 00010000:00010000:1.0:1788541164.845205:0:6506:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a6815c6a800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1788541164.845271:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f658fe9c/0x2aac941e5f4a8765 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33159b expref: 4 pid: 8430 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541164.845307:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006450c9ea/0x2aac941e5f4a8096 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3313b8 expref: 3 pid: 8973 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541164.845324:0:6506:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a6815c6a800, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1788541164.845564:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541164.845579:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a683551bc00/0x2aac941e5f4a7965 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3311ce expref: 13 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541164.845830:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541164.845835:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541164.845837:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541164.845956:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:2.0:1788541164.846577:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788541164.846630:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707818700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de51b185-1fb8-4395-8428-f3d8fb602cc3+12:2394:x1875420955919232:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 3005us (3677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541164.846643:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 20 00010000:00010000:2.0:1788541164.855093:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541164.855142:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a682e75f600/0x2aac941e5f4a76cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3310f5 expref: 11 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541164.855166:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541164.855234:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670781a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de51b185-1fb8-4395-8428-f3d8fb602cc3+10:2394:x1875420955918976:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 11942us (12932us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541164.855244:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 21 00000100:00100000:0.0:1788541164.858015:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541164.858250:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955919360 00000100:00100000:2.0:1788541164.858262:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955919360 00000100:00100000:2.0:1788541164.858364:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 81 00000100:00100000:2.0:1788541164.858375:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707819180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:384f52e3-0481-4979-9299-157aff7472d2+5:2393:x1875420955919360:12345-192.168.202.56@tcp:9:umount.0 00000020:00000080:2.0:1788541164.858412:0:8432:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a7a68 00000100:00080000:2.0:1788541164.858423:0:8432:0:(import.c:65:import_set_state_nolock()) ffff9a683f195000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788541164.858596:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1788541164.858968:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707819180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:384f52e3-0481-4979-9299-157aff7472d2+2:2393:x1875420955919360:12345-192.168.202.56@tcp:9:umount.0 Request processed in 593us (3206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541164.858977:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 81 00010000:00010000:2.0:1788541164.859000:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788541164.859437:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788541164.872696:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541164.876272:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955920384 00000100:00100000:1.0:1788541164.876289:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955920384 00000100:00100000:1.0:1788541164.876385:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 259 00000100:00100000:1.0:1788541164.876397:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+22:2393:x1875420955920384:12345-192.168.202.56@tcp:39:umount.0 00000020:00000080:1.0:1788541164.876433:0:9339:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a769b 00000020:00010000:1.0:1788541164.876464:0:9339:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9a6707a3c800: total 0 00000100:00080000:1.0:1788541164.876469:0:9339:0:(import.c:65:import_set_state_nolock()) ffff9a6707a3b800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788541164.876503:0:9339:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:1.0:1788541164.876684:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:384f52e3-0481-4979-9299-157aff7472d2+21:2393:x1875420955920384:12345-192.168.202.56@tcp:39:umount.0 Request processed in 288us (3998us total) trans 4294967527 rc 0/0 00000100:00100000:1.0:1788541164.876692:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 259 00000020:00010000:0.0:1788541164.878346:0:8446:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9a6707a3c800: total 0 00010000:00010000:0.0:1788541164.878412:0:8446:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a6707a3c800, canceled 0 locks, left on hash table 14. 00010000:00010000:0.0:1788541164.878448:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68350c0500) 00010000:00010000:0.0:1788541164.878452:0:8446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788541164.878464:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a80ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3313d4 expref: 20 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541164.878484:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68350c4300) 00010000:00010000:0.0:1788541164.878486:0:8446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788541164.878490:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac000/0x2aac941e5f4a7a3e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3311f8 expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541164.878502:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a68350c0800) 00010000:00010000:0.0:1788541164.878505:0:8446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788541164.878508:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dbc00/0x2aac941e5f4a8049 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3313a3 expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541164.878543:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68350c0a00) 00010000:00010000:0.0:1788541164.878545:0:8446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788541164.878549:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354dac00/0x2aac941e5f4a8408 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3314b4 expref: 17 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541164.878561:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9a68350c4300) 00010000:00010000:0.0:1788541164.878563:0:8446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788541164.878566:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354da000/0x2aac941e5f4a7d39 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3312d1 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541164.878584:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a68350c0d00) 00010000:00010000:0.0:1788541164.878586:0:8446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541164.878590:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a200/0x2aac941e5f4a79e3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3311e3 expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541164.878605:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a67078a1500) 00010000:00010000:0.0:1788541164.878607:0:8446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788541164.878610:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a000/0x2aac941e5f4a8646 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33154e expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541164.878622:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a68350c0800) 00010000:00010000:0.0:1788541164.878624:0:8446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788541164.878627:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a8081 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3313b1 expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541164.878638:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a68350c0800) 00010000:00010000:0.0:1788541164.878641:0:8446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788541164.878651:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ad400/0x2aac941e5f4a7f77 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33136b expref: 12 pid: 12149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541164.878665:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9a68350c0a00) 00010000:00010000:0.0:1788541164.878667:0:8446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788541164.878671:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075ac800/0x2aac941e5f4a811b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3313db expref: 11 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541164.878685:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9a68350c0800) 00010000:00010000:0.0:1788541164.878687:0:8446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788541164.878690:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68354db600/0x2aac941e5f4a8073 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3313aa expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541164.878702:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a67078a1500) 00010000:00010000:0.0:1788541164.878704:0:8446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788541164.878707:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a67075aca00/0x2aac941e5f4a8750 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331594 expref: 9 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541164.878716:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a67078a1d00) 00010000:00010000:0.0:1788541164.878718:0:8446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788541164.878721:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fa00/0x2aac941e5f4a79c7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3311dc expref: 8 pid: 9339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541164.878734:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9a67078a1500) 00010000:00010000:0.0:1788541164.878737:0:8446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788541164.878740:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b200/0x2aac941e5f4a8726 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331586 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541164.878751:0:8446:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a6707a3c800, canceled 14 locks, left on hash table 0. 00010000:00010000:0.0:1788541164.878782:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541164.878785:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541164.878787:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541164.895356:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541164.895454:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955920512 00000100:00100000:0.0:1788541164.895463:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955920512 00000100:00100000:0.0:1788541164.895530:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 260 00000100:00100000:0.0:1788541164.895538:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+5:2393:x1875420955920512:12345-192.168.202.56@tcp:39:umount.0 00000020:00000080:0.0:1788541164.895568:0:12149:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a76a2 00000100:00080000:0.0:1788541164.895586:0:12149:0:(import.c:65:import_set_state_nolock()) ffff9a67078db000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788541164.895618:0:12149:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788541164.895751:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:384f52e3-0481-4979-9299-157aff7472d2+3:2393:x1875420955920512:12345-192.168.202.56@tcp:39:umount.0 Request processed in 213us (415us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788541164.895756:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 260 00000100:00080000:2.0:1788541164.896078:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788541164.896252:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541165.131968:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541165.872729:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541165.872777:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541165.872819:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541165.872853:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955920896 00000100:00100000:0.0:1788541165.872915:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955920896 00000100:00100000:0.0:1788541165.872973:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955920768 00000100:00100000:0.0:1788541165.872976:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955920768 00000100:00100000:0.0:1788541165.873003:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 379 00000100:00100000:0.0:1788541165.873019:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707819c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2394:x1875420955920896:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541165.873482:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707819c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2394:x1875420955920896:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 469us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541165.873491:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 379 00000100:00100000:0.0:1788541165.873512:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 380 00000100:00100000:0.0:1788541165.873519:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707819880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b94cba-5efa-45eb-b12c-fe84e695d78a+6:2394:x1875420955920768:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541165.873562:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707819880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:73b94cba-5efa-45eb-b12c-fe84e695d78a+6:2394:x1875420955920768:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 43us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541165.873569:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 380 00000100:00080000:0.0:1788541165.873587:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788541165.873591:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788541165.874099:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955920640 00000100:00100000:0.0:1788541165.874106:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955920640 00000100:00100000:0.0:1788541165.874142:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 401 00000100:00100000:0.0:1788541165.874150:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+10:2394:x1875420955920640:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:0.0:1788541165.874187:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de51b185-1fb8-4395-8428-f3d8fb602cc3+10:2394:x1875420955920640:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 38us (1468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541165.874194:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 401 00010000:00010000:0.0:1788541166.154170:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541167.053768:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670781b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981134464:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788541167.053864:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541167.053977:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788541167.053985:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981134336:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788541167.054016:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541167.054270:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981134336 00000100:00100000:3.0:1788541167.054278:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981134336 00000100:00100000:3.0:1788541167.054350:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788541167.054359:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981134336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788541167.054407:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788541167.054460:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981134336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541167.054468:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1788541167.054630:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981134336:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788541167.054699:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981134464 00000100:00100000:1.0:1788541167.054704:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981134464 00000100:00100000:1.0:1788541167.054752:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788541167.054760:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707818000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981134464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788541167.054780:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788541167.054823:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707818000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981134464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541167.054830:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:0.0:1788541167.055050:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788541167.055079:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670781b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981134464:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788541167.056899:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981134592:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788541167.056969:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541167.057224:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981134592 00000100:00100000:2.0:1788541167.057232:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981134592 00000100:00100000:2.0:1788541167.057329:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788541167.057338:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981134592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788541167.057360:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788541167.057409:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981134592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541167.057415:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788541167.057461:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981134592:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788541167.058334:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788541167.178191:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541167.249914:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541167.249976:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541167.250014:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541167.250061:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955921024 00000100:00100000:0.0:1788541167.250071:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955921024 00000100:00100000:0.0:1788541167.250129:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955921280 00000100:00100000:0.0:1788541167.250132:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955921280 00000100:00100000:0.0:1788541167.250144:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955921152 00000100:00100000:0.0:1788541167.250147:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955921152 00000100:00100000:0.0:1788541167.250162:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 22 00000100:00100000:0.0:1788541167.250172:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de51b185-1fb8-4395-8428-f3d8fb602cc3+12:2397:x1875420955921024:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788541167.250188:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541167.250208:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6842172c00/0x2aac941e5f4a779e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33110a expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541167.250228:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541167.250293:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de51b185-1fb8-4395-8428-f3d8fb602cc3+11:2397:x1875420955921024:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 122us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541167.250301:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 22 00000100:00100000:0.0:1788541167.250318:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 23 00000100:00100000:0.0:1788541167.250324:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de51b185-1fb8-4395-8428-f3d8fb602cc3+10:2397:x1875420955921280:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788541167.250332:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541167.250342:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a682e75f000/0x2aac941e5f4a795e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3311c7 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541167.250350:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541167.250367:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de51b185-1fb8-4395-8428-f3d8fb602cc3+9:2397:x1875420955921280:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 44us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541167.250374:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 23 00000100:00100000:0.0:1788541167.250396:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 24 00000100:00100000:0.0:1788541167.250401:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68076e9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de51b185-1fb8-4395-8428-f3d8fb602cc3+8:2397:x1875420955921152:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788541167.250412:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541167.250421:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a682e75f400/0x2aac941e5f4a77a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33113b expref: 8 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541167.250429:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541167.250445:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68076e9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de51b185-1fb8-4395-8428-f3d8fb602cc3+7:2397:x1875420955921152:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 44us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541167.250451:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 24 00000100:00100000:1.0:1788541167.261708:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541167.261803:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955921536 00000100:00100000:0.0:1788541167.261814:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955921536 00000100:00100000:0.0:1788541167.261922:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 261 00000100:00100000:0.0:1788541167.261931:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:73b94cba-5efa-45eb-b12c-fe84e695d78a+6:2393:x1875420955921536:12345-192.168.202.56@tcp:39:umount.0 00000020:00000080:0.0:1788541167.261973:0:6519:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a77b3 00000020:00010000:0.0:1788541167.261981:0:6519:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9a6707748800: total 0 00000100:00080000:0.0:1788541167.261986:0:6519:0:(import.c:65:import_set_state_nolock()) ffff9a6707749800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788541167.262028:0:6519:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:0.0:1788541167.262187:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2393:x1875420955921536:12345-192.168.202.56@tcp:39:umount.0 Request processed in 257us (490us total) trans 4294967528 rc 0/0 00000100:00100000:0.0:1788541167.262195:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 261 00000100:00080000:2.0:1788541167.262604:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:3.0:1788541167.263226:0:6505:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9a6707748800: total 0 00010000:00010000:3.0:1788541167.263232:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541167.263292:0:6505:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a6707748800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788541167.263346:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68350c0500) 00010000:00010000:3.0:1788541167.263350:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788541167.263359:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956400/0x2aac941e5f4a8773 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3315a2 expref: 4 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541167.263384:0:6505:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a6707748800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788541167.263396:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541167.263397:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541167.263399:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541167.283755:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541167.283981:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955921664 00000100:00100000:2.0:1788541167.283992:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955921664 00000100:00100000:2.0:1788541167.284083:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 262 00000100:00100000:2.0:1788541167.284094:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:73b94cba-5efa-45eb-b12c-fe84e695d78a+5:2393:x1875420955921664:12345-192.168.202.56@tcp:39:umount.0 00000020:00000080:2.0:1788541167.284137:0:12149:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a77ba 00000100:00080000:2.0:1788541167.284147:0:12149:0:(import.c:65:import_set_state_nolock()) ffff9a670774f800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788541167.284203:0:12149:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1788541167.284398:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:73b94cba-5efa-45eb-b12c-fe84e695d78a+3:2393:x1875420955921664:12345-192.168.202.56@tcp:39:umount.0 Request processed in 305us (662us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788541167.284406:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 262 00010000:00010000:1.0:1788541167.284652:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788541167.284831:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788541167.364932:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541167.365043:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955921920 00000100:00100000:2.0:1788541167.365054:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955921920 00000100:00100000:2.0:1788541167.365116:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 402 00000100:00100000:2.0:1788541167.365127:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+7:2393:x1875420955921920:12345-192.168.202.56@tcp:251:umount.0 00000020:00000080:2.0:1788541167.365174:0:6509:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a7678 00000020:00010000:2.0:1788541167.365183:0:6509:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9a6707a3a000: total 0 00000100:00080000:2.0:1788541167.365187:0:6509:0:(import.c:65:import_set_state_nolock()) ffff9a6707a3f800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788541167.365266:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de51b185-1fb8-4395-8428-f3d8fb602cc3+3:2393:x1875420955921920:12345-192.168.202.56@tcp:251:umount.0 Request processed in 140us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541167.365286:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 402 00000020:00010000:3.0:1788541167.365407:0:6506:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9a6707a3a000: total 0 00010000:00010000:3.0:1788541167.365463:0:6506:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a6707a3a000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788541167.365499:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6812044a00/0x2aac941e5f4a76d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3310fc expref: 2 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541167.365513:0:6506:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a6707a3a000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1788541167.365524:0:6506:0:(genops.c:885:class_export_put()) final put ffff9a6707a3a000/de51b185-1fb8-4395-8428-f3d8fb602cc3 00010000:00010000:3.0:1788541167.365542:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541167.365544:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541167.365545:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788541167.365751:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6707a3a000/de51b185-1fb8-4395-8428-f3d8fb602cc3 for MGS 00000020:00000080:2.0:1788541167.365799:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a6707a3f800 for MGS 00000100:00100000:1.0:1788541168.075049:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788541168.075074:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981134720:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788541168.075244:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541168.075316:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981134720 00000100:00100000:1.0:1788541168.075324:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981134720 00000100:00100000:1.0:1788541168.075373:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788541168.075382:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981134720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788541168.075420:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788541168.075468:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981134720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541168.075475:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788541168.075524:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981134720:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788541168.202270:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541169.098646:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875420981135104:0@lo:400:kworker.0 00000100:00100000:0.0:1788541169.098663:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:425687b6-1d99-41d2-88d8-2fb230997596:3644:1875420981134976:0@lo:400:kworker.0 00000100:00100000:3.0:1788541169.098741:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981134848:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788541169.100425:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541169.100495:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875420981135616:0@lo:400:kworker.0 00000100:00100000:2.0:1788541169.100524:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541169.100634:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875420981136128:0@lo:400:kworker.0 00000100:00100000:2.0:1788541169.100733:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541169.100758:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708310700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981136640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788541169.100785:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541169.100915:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788541169.100923:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981135232:0@lo:400:kworker.0 00000100:00100000:2.0:1788541169.100951:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541169.100969:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875420981135744:0@lo:400:kworker.0 00000100:00100000:2.0:1788541169.101136:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541169.101158:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875420981136256:0@lo:400:kworker.0 00000100:00100000:2.0:1788541169.101180:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541169.101214:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981135104 00000100:00100000:2.0:1788541169.101222:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981135104 00000100:00100000:2.0:1788541169.101261:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981135616 00000100:00100000:2.0:1788541169.101264:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981135616 00000100:00100000:2.0:1788541169.101287:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981136128 00000100:00100000:2.0:1788541169.101290:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981136128 00000100:00100000:2.0:1788541169.101375:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981135744 00000100:00100000:2.0:1788541169.101392:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981135744 00000100:00100000:2.0:1788541169.101406:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981136256 00000100:00100000:2.0:1788541169.101409:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981136256 00000100:00100000:2.0:1788541169.101423:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1788541169.101430:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875420981135104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541169.101481:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875420981135104:12345-0@lo:400:kworker.0 Request processed in 51us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541169.101488:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1788541169.101504:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1788541169.101509:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875420981135616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541169.101535:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875420981135616:12345-0@lo:400:kworker.0 Request processed in 26us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541169.101540:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1788541169.103053:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981135232 00000100:00100000:1.0:1788541169.103065:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981135232 00000100:00100000:1.0:1788541169.103112:0:10866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788541169.103120:0:10866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981135232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541169.103191:0:10866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981135232:12345-0@lo:400:kworker.0 Request processed in 72us (2239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541169.103197:0:10866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788541169.103220:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1788541169.103228:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875420981136128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541169.103269:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1875420981136128:12345-0@lo:400:kworker.0 Request processed in 42us (2609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541169.103274:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1788541169.103289:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1788541169.103294:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875420981135744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541169.103322:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875420981135744:12345-0@lo:400:kworker.0 Request processed in 28us (2186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541169.103327:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1788541169.103337:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1788541169.103343:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875420981136256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541169.103370:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875420981136256:12345-0@lo:400:kworker.0 Request processed in 28us (2189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541169.103376:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1788541169.105487:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981135232:0@lo:400:kworker.0 00010000:00080000:2.0:1788541169.105511:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707a70a80 x1875420981135744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541169.105523:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875420981135744:0@lo:400:kworker.0 00010000:00080000:2.0:1788541169.105537:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707a72a00 x1875420981136256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541169.105559:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875420981136256:0@lo:400:kworker.0 00000100:00100000:2.0:1788541169.105575:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875420981136128:0@lo:400:kworker.0 00000100:00100000:2.0:1788541169.105589:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875420981135104:0@lo:400:kworker.0 00000100:00100000:2.0:1788541169.105601:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875420981135616:0@lo:400:kworker.0 00000100:00100000:3.0:1788541169.107045:0:14072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981136640 00000100:00100000:3.0:1788541169.107055:0:14072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981136640 00000100:00100000:3.0:1788541169.107118:0:14072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788541169.107127:0:14072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981136640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788541169.107157:0:14072:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788541169.107233:0:14072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981136640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (6447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541169.107240:0:14072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788541169.107287:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708310700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981136640:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788541169.107330:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541169.107352:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981134848 00000100:00100000:3.0:1788541169.107355:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981134848 00000100:00100000:3.0:1788541169.107375:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788541169.107381:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708310700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981134848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788541169.107390:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788541169.107414:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708310700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981134848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (83us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541169.107419:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788541169.107454:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981134848:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788541169.107585:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875420981135360:0@lo:400:kworker.0 00000100:00100000:3.0:1788541169.107615:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541169.107645:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981135872:0@lo:400:kworker.0 00000100:00100000:3.0:1788541169.107669:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541169.107693:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981135872 00000100:00100000:3.0:1788541169.107696:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981135872 00000100:00100000:1.0:1788541169.107781:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981135360 00000100:00100000:1.0:1788541169.107797:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981135360 00000100:00100000:1.0:1788541169.107828:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1788541169.107834:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875420981135360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541169.107885:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875420981135360:12345-0@lo:400:kworker.0 Request processed in 35us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541169.107891:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1788541169.108024:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788541169.108031:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706831f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981135872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541169.108061:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706831f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981135872:12345-0@lo:400:kworker.0 Request processed in 31us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541169.108067:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788541169.108091:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981135872:0@lo:400:kworker.0 00000100:00100000:3.0:1788541169.108097:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981136384:0@lo:400:kworker.0 00000100:00100000:3.0:1788541169.108116:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541169.108134:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981136384 00000100:00100000:3.0:1788541169.108137:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981136384 00000100:00100000:3.0:1788541169.108155:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788541169.108160:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706832300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981136384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541169.108184:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706832300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981136384:12345-0@lo:400:kworker.0 Request processed in 24us (67us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541169.108189:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788541169.108211:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981136384:0@lo:400:kworker.0 00000100:00100000:3.0:1788541169.108234:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875420981135360:0@lo:400:kworker.0 00000100:00080000:1.0:1788541169.108921:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788541169.108927:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788541169.108930:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788541169.108933:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788541169.109081:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541169.109119:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981135488:0@lo:400:kworker.0 00000100:00100000:3.0:1788541169.109225:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981134976 00000100:00100000:3.0:1788541169.109231:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981134976 00000100:00100000:0.0:1788541169.109298:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541169.109327:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981135488 00000100:00100000:0.0:1788541169.109331:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981135488 00000100:00100000:0.0:1788541169.109360:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788541169.109366:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981135488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541169.109410:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981135488:12345-0@lo:400:kworker.0 Request processed in 43us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541169.109416:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788541169.109447:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981135488:0@lo:400:kworker.0 00000100:00100000:0.0:1788541169.109454:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981136000:0@lo:400:kworker.0 00000100:00100000:0.0:1788541169.109546:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541169.109569:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981136000 00000100:00100000:0.0:1788541169.109572:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981136000 00000100:00100000:0.0:1788541169.109603:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788541169.109609:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981136000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541169.109640:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981136000:12345-0@lo:400:kworker.0 Request processed in 31us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541169.109646:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:0.0:1788541169.109661:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788541169.109677:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981136000:0@lo:400:kworker.0 00000100:00100000:0.0:1788541169.109684:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981136512:0@lo:400:kworker.0 00000100:00100000:0.0:1788541169.109769:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541169.109973:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:3.0:1788541169.109982:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6831c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+24:3644:x1875420981134976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541169.110026:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6831c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:425687b6-1d99-41d2-88d8-2fb230997596+24:3644:x1875420981134976:12345-0@lo:400:kworker.0 Request processed in 46us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541169.110032:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:0.0:1788541169.110080:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981136512 00000100:00100000:0.0:1788541169.110084:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981136512 00000100:00100000:0.0:1788541169.110112:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788541169.110119:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981136512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541169.110156:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981136512:12345-0@lo:400:kworker.0 Request processed in 37us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541169.110162:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788541169.110187:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981136512:0@lo:400:kworker.0 00000100:00100000:0.0:1788541169.110213:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:425687b6-1d99-41d2-88d8-2fb230997596:3644:1875420981134976:0@lo:400:kworker.0 00010000:00010000:1.0:1788541169.230644:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788541169.482354:0:15206:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788541169.490665:0:15206:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788541169.490846:0:15206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75e000/0x2aac941e5f4a772e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7735 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541169.490861:0:15206:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75e000/0x2aac941e5f4a772e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a7735 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541169.490889:0:15206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75e000/0x2aac941e5f4a772e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a7735 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541169.490898:0:15206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.156@tcp lock: ffff9a682e75e000/0x2aac941e5f4a772e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a7735 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541169.490917:0:15206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788541169.490923:0:15206:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788541169.490951:0:15206:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788541169.490955:0:15206:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788541169.490961:0:15206:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788541169.490986:0:15206:0:(import.c:65:import_set_state_nolock()) ffff9a682b4e2000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1788541169.491630:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788541169.491650:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a682e75e000/0x2aac941e5f4a772e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a7735 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541169.491658:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75e000 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:3.0:1788541169.491661:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a682e75e000/0x2aac941e5f4a772e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a7735 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541169.491671:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a682e75e000/0x2aac941e5f4a772e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x2aac941e5f4a7735 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788541169.491678:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a682e75e000/0x2aac941e5f4a772e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x2aac941e5f4a7735 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541169.491685:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788541169.491687:0:6506:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788541169.491690:0:6506:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788541169.491790:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a682e75e000/0x2aac941e5f4a772e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a7735 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541169.491798:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788541169.491840:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a682e75e000/0x2aac941e5f4a772e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a7735 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541169.491848:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a682e75e000/0x2aac941e5f4a772e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a7735 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541169.491862:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541169.491864:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541169.491866:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541169.491907:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875420981136768:0@lo:39:umount.0 00000100:00100000:3.0:1788541169.491987:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541169.492078:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788541169.492087:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420981136896:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788541169.492116:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541169.492154:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981136768 00000100:00100000:3.0:1788541169.492161:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981136768 00000100:00100000:3.0:1788541169.492207:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788541169.492216:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875420981136768:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788541169.492242:0:12149:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a728f 00000100:00080000:3.0:1788541169.492252:0:12149:0:(import.c:65:import_set_state_nolock()) ffff9a682b4e7800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788541169.492313:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3640:x1875420981136768:12345-0@lo:39:umount.0 Request processed in 97us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541169.492320:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000020:00000080:3.0:1788541169.492330:0:12149:0:(genops.c:885:class_export_put()) final put ffff9a682b4e5800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:3.0:1788541169.492353:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981136896 00000100:00100000:3.0:1788541169.492358:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981136896 00000100:00100000:3.0:1788541169.492387:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788541169.492393:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706830a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:425687b6-1d99-41d2-88d8-2fb230997596+24:3641:x1875420981136896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788541169.492404:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541169.492419:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a682e75f800/0x2aac941e5f4a7735 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2aac941e5f4a772e expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541169.492433:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00000080:2.0:1788541169.493924:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a682b4e5800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788541169.494010:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a682b4e7800 for lustre-MDT0000 00000100:00080000:2.0:1788541169.500090:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a682b4e2000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788541169.500119:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875420981136768:0@lo:39:umount.0 00010000:00010000:2.0:1788541169.500164:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788541169.500184:0:15206:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788541169.500188:0:15206:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788541169.500194:0:15206:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788541169.501134:0:15206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551be00/0x2aac941e5f4a773c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7743 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541169.501150:0:15206:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551be00/0x2aac941e5f4a773c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a7743 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541169.501158:0:15206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551be00/0x2aac941e5f4a773c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a7743 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541169.501165:0:15206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.156@tcp lock: ffff9a683551be00/0x2aac941e5f4a773c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a7743 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541169.501194:0:15206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788541169.501202:0:15206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6842172a00/0x2aac941e5f4a7632 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7639 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541169.501209:0:15206:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6842172a00/0x2aac941e5f4a7632 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a7639 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541169.501215:0:15206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6842172a00/0x2aac941e5f4a7632 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a7639 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541169.501221:0:15206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.156@tcp lock: ffff9a6842172a00/0x2aac941e5f4a7632 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a7639 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541169.501234:0:15206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788541169.501240:0:15206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a67075ade00/0x2aac941e5f4a7996 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a799d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541169.501247:0:15206:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a67075ade00/0x2aac941e5f4a7996 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a799d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541169.501264:0:15206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a67075ade00/0x2aac941e5f4a7996 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a799d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541169.501271:0:15206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.156@tcp lock: ffff9a67075ade00/0x2aac941e5f4a7996 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a799d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541169.501285:0:15206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788541169.501301:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788541169.501307:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a683551be00/0x2aac941e5f4a773c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a7743 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541169.501313:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551be00 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:2.0:1788541169.501317:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a683551be00/0x2aac941e5f4a773c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a7743 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541169.501324:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a683551be00/0x2aac941e5f4a773c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x2aac941e5f4a7743 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788541169.501331:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a683551be00/0x2aac941e5f4a773c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x2aac941e5f4a7743 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788541169.501338:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788541169.501340:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1788541169.501372:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a683551be00/0x2aac941e5f4a773c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a7743 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541169.501378:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788541169.501407:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a683551be00/0x2aac941e5f4a773c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a7743 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541169.501425:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a683551be00/0x2aac941e5f4a773c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a7743 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541169.501438:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788541169.501441:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a6842172a00/0x2aac941e5f4a7632 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a7639 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541169.501447:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842172a00 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:2.0:1788541169.501450:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a6842172a00/0x2aac941e5f4a7632 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a7639 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541169.501456:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a6842172a00/0x2aac941e5f4a7632 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2aac941e5f4a7639 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788541169.501462:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a6842172a00/0x2aac941e5f4a7632 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2aac941e5f4a7639 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788541169.501467:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788541169.501470:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788541169.501472:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788541169.501487:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a6842172a00/0x2aac941e5f4a7632 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a7639 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541169.501493:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788541169.501500:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a6842172a00/0x2aac941e5f4a7632 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a7639 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541169.501506:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a6842172a00/0x2aac941e5f4a7632 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a7639 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541169.501525:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541169.501528:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a67075ade00/0x2aac941e5f4a7996 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a799d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541169.501534:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075ade00 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:2.0:1788541169.501537:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a67075ade00/0x2aac941e5f4a7996 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a799d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541169.501543:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a67075ade00/0x2aac941e5f4a7996 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x2aac941e5f4a799d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788541169.501550:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a67075ade00/0x2aac941e5f4a7996 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x2aac941e5f4a799d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788541169.501555:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788541169.501557:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788541169.501559:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788541169.501572:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a67075ade00/0x2aac941e5f4a7996 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a799d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541169.501577:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788541169.501591:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a67075ade00/0x2aac941e5f4a7996 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a799d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541169.501597:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a67075ade00/0x2aac941e5f4a7996 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a799d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541169.501605:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541169.501607:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541169.501614:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541169.501623:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788541169.501641:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420981137280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788541169.501710:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541169.501764:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981137280 00000100:00100000:2.0:1788541169.501770:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981137280 00000100:00100000:2.0:1788541169.501815:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788541169.501825:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670687b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+24:3642:x1875420981137280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788541169.501838:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541169.501851:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a67075ad600/0x2aac941e5f4a799d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2aac941e5f4a7996 expref: 24 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541169.501863:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541169.501922:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670687b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+23:3642:x1875420981137280:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541169.501930:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788541169.501963:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420981137280:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788541169.501983:0:15206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6842049600/0x2aac941e5f4a71ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a71f5 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541169.501990:0:15206:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6842049600/0x2aac941e5f4a71ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a71f5 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541169.501996:0:15206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6842049600/0x2aac941e5f4a71ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a71f5 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541169.502014:0:15206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.156@tcp lock: ffff9a6842049600/0x2aac941e5f4a71ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a71f5 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541169.502035:0:15206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788541169.502038:0:15206:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1788541169.502041:0:15206:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:2.0:1788541169.502072:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541169.502076:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a6842049600/0x2aac941e5f4a71ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a71f5 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541169.502083:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842049600 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:2.0:1788541169.502086:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a6842049600/0x2aac941e5f4a71ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a71f5 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541169.502093:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a6842049600/0x2aac941e5f4a71ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2aac941e5f4a71f5 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788541169.502099:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a6842049600/0x2aac941e5f4a71ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2aac941e5f4a71f5 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788541169.502104:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788541169.502105:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788541169.502107:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788541169.502120:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a6842049600/0x2aac941e5f4a71ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a71f5 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541169.502125:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788541169.502134:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a6842049600/0x2aac941e5f4a71ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a71f5 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541169.502141:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a6842049600/0x2aac941e5f4a71ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a71f5 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541169.502159:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541169.502160:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541169.502162:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541169.502170:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670687b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420981137408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788541169.502191:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541169.502215:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981137408 00000100:00100000:2.0:1788541169.502218:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981137408 00000100:00100000:2.0:1788541169.502238:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788541169.502244:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706878380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+23:3642:x1875420981137408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788541169.502251:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541169.502259:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6800030200/0x2aac941e5f4a71f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2aac941e5f4a71ee expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541169.502269:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541169.502291:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706878380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+22:3642:x1875420981137408:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541169.502298:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788541169.502320:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670687b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420981137408:0@lo:103:ldlm_bl.0 00000020:01000004:2.0:1788541169.502340:0:15206:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788541169.502344:0:15206:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1788541169.502348:0:15206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788541169.502354:0:15206:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:2.0:1788541169.502358:0:15206:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9a6705afb000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788541169.502365:0:15206:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9a683548e000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788541169.502369:0:15206:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9a683517c000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788541169.502373:0:15206:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9a683517a800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:2.0:1788541169.502386:0:15206:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9a6707748800 73b94cba-5efa-45eb-b12c-fe84e695d78a 192.168.202.56@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788541169.502391:0:15206:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9a6707a3c800 384f52e3-0481-4979-9299-157aff7472d2 192.168.202.56@tcp 5 (0 5 0) 1 0 0 0: 0000000000000000 4294967523 stale:0 00000020:00080000:2.0:1788541169.502396:0:15206:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9a68045fcd40) has exports, disconnecting them 00000020:00080000:2.0:1788541169.502401:0:15206:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a6705afb000), last request at 1788541169 00000020:00000080:2.0:1788541169.502408:0:15206:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a759f 00000100:00080000:2.0:1788541169.502431:0:15206:0:(import.c:65:import_set_state_nolock()) ffff9a6705af9800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788541169.502465:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788541169.502475:0:15206:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a6705afb000): rc 0 00000020:00000080:2.0:1788541169.502477:0:15206:0:(genops.c:885:class_export_put()) final put ffff9a6705afb000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1788541169.502488:0:15206:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a683548e000), last request at 1788541169 00000020:00000080:2.0:1788541169.502490:0:15206:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a7480 00000100:00080000:2.0:1788541169.502495:0:15206:0:(import.c:65:import_set_state_nolock()) ffff9a683548b800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788541169.502502:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788541169.502507:0:15206:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a683548e000): rc 0 00000020:00000080:2.0:1788541169.502509:0:15206:0:(genops.c:885:class_export_put()) final put ffff9a683548e000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1788541169.502513:0:15206:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a683517c000), last request at 1788540921 00000020:00000080:2.0:1788541169.502515:0:15206:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a7376 00000100:00080000:2.0:1788541169.502518:0:15206:0:(import.c:65:import_set_state_nolock()) ffff9a683517f000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788541169.502526:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788541169.502532:0:15206:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a683517c000): rc 0 00000020:00000080:2.0:1788541169.502534:0:15206:0:(genops.c:885:class_export_put()) final put ffff9a683517c000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1788541169.502537:0:15206:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a683517a800), last request at 1788540921 00000020:00000080:2.0:1788541169.502540:0:15206:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a7337 00000100:00080000:2.0:1788541169.502543:0:15206:0:(import.c:65:import_set_state_nolock()) ffff9a683517d000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788541169.502551:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1788541169.502557:0:15206:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:2.0:1788541169.502620:0:15206:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a683517a800): rc 0 00000004:00000080:2.0:1788541169.502632:0:15206:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb5cdc1907ae0 00000100:00080000:2.0:1788541169.502649:0:15206:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788541169.502652:0:15206:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00010000:00010000:1.0:1788541169.502926:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541169.503802:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:425687b6-1d99-41d2-88d8-2fb230997596:3644:1875420981137152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788541169.503891:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541169.503931:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788541169.503939:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:425687b6-1d99-41d2-88d8-2fb230997596:3644:1875420981137024:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788541169.503958:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1788541169.503989:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6705afb000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788541169.504054:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a683548e000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788541169.504075:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a683517c000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788541169.504099:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a6705af9800 for lustre-MDT0000 00000020:00000080:0.0:1788541169.504103:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a683548b800 for lustre-MDT0000 00000020:00000080:0.0:1788541169.504107:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a683517f000 for lustre-MDT0000 00000100:00100000:1.0:1788541169.506042:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981137152 00000100:00100000:1.0:1788541169.506082:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981137152 00000100:00100000:1.0:1788541169.506141:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981137024 00000100:00100000:1.0:1788541169.506145:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981137024 00000100:00100000:1.0:1788541169.506167:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788541169.506176:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+23:3644:x1875420981137152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788541169.506192:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541169.506212:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6842173a00/0x2aac941e5f4a7639 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2aac941e5f4a7632 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541169.506232:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788541169.506312:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+22:3644:x1875420981137152:12345-0@lo:103:ldlm_bl.0 Request processed in 137us (2442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541169.506319:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788541169.506336:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788541169.506342:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+21:3644:x1875420981137024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788541169.506353:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541169.506362:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6812045400/0x2aac941e5f4a7743 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2aac941e5f4a773c expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541169.506371:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788541169.506393:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425687b6-1d99-41d2-88d8-2fb230997596+20:3644:x1875420981137024:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (2433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541169.506398:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788541169.510173:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:425687b6-1d99-41d2-88d8-2fb230997596:3644:1875420981137024:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788541169.510191:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:425687b6-1d99-41d2-88d8-2fb230997596:3644:1875420981137152:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788541169.511437:0:15206:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788541169.511485:0:15206:0:(import.c:65:import_set_state_nolock()) ffff9a683f37d000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788541169.511533:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670687b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981137536:0@lo:39:umount.0 00000100:00100000:2.0:1788541169.511606:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541169.511792:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981137536 00000100:00100000:1.0:1788541169.511801:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981137536 00000100:00100000:1.0:1788541169.511852:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788541169.511862:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706879880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875420981137536:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788541169.511910:0:6522:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a73f4 00000100:00080000:1.0:1788541169.511931:0:6522:0:(import.c:65:import_set_state_nolock()) ffff9a683517d800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788541169.511956:0:6522:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1788541169.512112:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706879880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3640:x1875420981137536:12345-0@lo:39:umount.0 Request processed in 251us (505us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788541169.512118:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00010000:00010000:1.0:1788541169.512140:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788541169.512164:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a683f37d000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788541169.512170:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670687b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981137536:0@lo:39:umount.0 00000100:00100000:3.0:1788541169.513338:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706830a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:425687b6-1d99-41d2-88d8-2fb230997596+19:3641:x1875420981136896:12345-0@lo:103:ldlm_bl.0 Request processed in 20939us (21215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541169.513349:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788541169.514299:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420981136896:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788541169.514328:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788541169.514629:0:15206:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788541169.514635:0:15206:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:2.0:1788541169.514661:0:15206:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788541169.514789:0:15206:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788541169.514920:0:15206:0:(import.c:65:import_set_state_nolock()) ffff9a6705aef000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788541169.514942:0:15206:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788541169.514944:0:15206:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:2.0:1788541169.514952:0:15206:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788541169.515037:0:15206:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788541169.515049:0:15206:0:(import.c:65:import_set_state_nolock()) ffff9a6705afe000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788541169.515080:0:15206:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9a68045fcd40) has no exports 00000100:00100000:1.0:1788541169.515435:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706879c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981137664:0@lo:9:umount.0 00000100:00100000:1.0:1788541169.515749:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541169.515788:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981137792:0@lo:9:umount.0 00000100:00100000:1.0:1788541169.515812:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541169.518482:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981137664 00000100:00100000:3.0:1788541169.518509:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981137664 00000100:00100000:3.0:1788541169.518573:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981137792 00000100:00100000:3.0:1788541169.518577:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981137792 00000100:00100000:3.0:1788541169.518606:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788541169.518616:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1875420981137664:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788541169.518646:0:8431:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a7521 00000100:00080000:3.0:1788541169.518656:0:8431:0:(import.c:65:import_set_state_nolock()) ffff9a67067e4800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788541169.518704:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1788541169.518984:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788541169.518995:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1875420981137792:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788541169.519019:0:8430:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a7671 00000100:00080000:1.0:1788541169.519025:0:8430:0:(import.c:65:import_set_state_nolock()) ffff9a68379b5000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788541169.519055:0:8430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1788541169.519203:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3640:x1875420981137792:12345-0@lo:9:umount.0 Request processed in 210us (3388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541169.519211:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:1.0:1788541169.519236:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788541169.519269:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a6705afe000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788541169.519281:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788541169.519283:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788541169.519287:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981137792:0@lo:9:umount.0 00000100:00100000:3.0:1788541169.519435:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3640:x1875420981137664:12345-0@lo:9:umount.0 Request processed in 820us (3686us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541169.519443:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00010000:3.0:1788541169.519467:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788541169.519571:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a6705aef000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788541169.519588:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788541169.519602:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788541169.519606:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706879c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981137664:0@lo:9:umount.0 00000020:00080000:1.0:1788541169.527832:0:15206:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9a68045fcd40) has no exports 00000020:00000080:1.0:1788541169.587194:0:15206:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a7249 00000020:00000080:1.0:1788541169.587212:0:15206:0:(genops.c:885:class_export_put()) final put ffff9a682fdc5000/lustre-QMT0000_UUID 00000020:01000000:1.0:1788541169.587272:0:15206:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788541169.587935:0:15206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788541169.587948:0:15206:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788541169.587952:0:15206:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9a682e74cd40) has no exports 00000020:00000080:2.0:1788541169.588257:0:15206:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a7242 00000020:00000080:2.0:1788541169.588264:0:15206:0:(genops.c:885:class_export_put()) final put ffff9a68045b7000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788541169.589729:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a682fdc5000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788541169.590048:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68045b7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788541169.590135:0:15206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788541169.590145:0:15206:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788541169.590150:0:15206:0:(genops.c:885:class_export_put()) final put ffff9a68045b3800/lustre-QMT0000_UUID 00000020:00000080:2.0:1788541169.590153:0:15206:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68045b3800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788541169.590162:0:15206:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000040:00080000:3.0:1788541169.674660:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788541170.253424:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788541171.150151:0:8426:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788541171.150161:0:8426:0:(genops.c:885:class_export_put()) final put ffff9a67067e6800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788541171.150184:0:8426:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 384f52e3-0481-4979-9299-157aff7472d2 00000020:00000080:3.0:1788541171.150187:0:8426:0:(genops.c:885:class_export_put()) final put ffff9a683f196800/384f52e3-0481-4979-9299-157aff7472d2 00000020:00000080:0.0:1788541171.151224:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a67067e6800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788541171.151293:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a683f196800/384f52e3-0481-4979-9299-157aff7472d2 for lustre-OST0000 00000020:00000080:0.0:1788541171.151311:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a67067e4800 for lustre-OST0000 00000020:00000080:0.0:1788541171.151328:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a683f195000 for lustre-OST0000 00000001:00100000:2.0:1788541171.153859:0:7448:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788541171.153899:0:7448:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:2.0:1788541171.153905:0:7448:0:(genops.c:885:class_export_put()) final put ffff9a683517b000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788541171.153920:0:7448:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 73b94cba-5efa-45eb-b12c-fe84e695d78a 00000001:00080000:2.0:1788541171.153925:0:7448:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:2.0:1788541171.153927:0:7448:0:(genops.c:885:class_export_put()) final put ffff9a670774a800/73b94cba-5efa-45eb-b12c-fe84e695d78a 00000001:00100000:2.0:1788541171.153932:0:7448:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 384f52e3-0481-4979-9299-157aff7472d2 00000001:00080000:2.0:1788541171.153937:0:7448:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:2.0:1788541171.153938:0:7448:0:(genops.c:885:class_export_put()) final put ffff9a67078da800/384f52e3-0481-4979-9299-157aff7472d2 00000020:00000080:3.0:1788541171.154210:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a683517b000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1788541171.154274:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a670774a800/73b94cba-5efa-45eb-b12c-fe84e695d78a for lustre-MDT0001 00000020:00000080:3.0:1788541171.154299:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a67078da800/384f52e3-0481-4979-9299-157aff7472d2 for lustre-MDT0001 00000020:00000080:3.0:1788541171.154322:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a683517d800 for lustre-MDT0001 00000020:00000080:3.0:1788541171.154326:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a670774f800 for lustre-MDT0001 00000020:00000080:3.0:1788541171.154330:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a67078db000 for lustre-MDT0001 00000001:00100000:3.0:1788541171.155604:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788541171.155612:0:9510:0:(genops.c:885:class_export_put()) final put ffff9a68379b1000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788541171.155634:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 384f52e3-0481-4979-9299-157aff7472d2 00000020:00000080:3.0:1788541171.155637:0:9510:0:(genops.c:885:class_export_put()) final put ffff9a6815c6a800/384f52e3-0481-4979-9299-157aff7472d2 00000020:00000080:0.0:1788541171.155715:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68379b1000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788541171.155755:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6815c6a800/384f52e3-0481-4979-9299-157aff7472d2 for lustre-OST0001 00000020:00000080:0.0:1788541171.155769:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a68379b5000 for lustre-OST0001 00000020:00000080:0.0:1788541171.155773:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a6815c6f000 for lustre-OST0001 00000001:00100000:1.0:1788541171.167450:0:6496:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788541171.167462:0:6496:0:(genops.c:885:class_export_put()) final put ffff9a683517a800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1788541171.167489:0:6496:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 73b94cba-5efa-45eb-b12c-fe84e695d78a 00000001:00080000:1.0:1788541171.167498:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:1.0:1788541171.167503:0:6496:0:(genops.c:885:class_export_put()) final put ffff9a6707748800/73b94cba-5efa-45eb-b12c-fe84e695d78a 00000001:00100000:1.0:1788541171.167508:0:6496:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 384f52e3-0481-4979-9299-157aff7472d2 00000001:00080000:1.0:1788541171.167513:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:1.0:1788541171.167522:0:6496:0:(genops.c:885:class_export_put()) final put ffff9a6707a3c800/384f52e3-0481-4979-9299-157aff7472d2 00000020:00000080:3.0:1788541171.170047:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a683517a800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1788541171.170391:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6707748800/73b94cba-5efa-45eb-b12c-fe84e695d78a for lustre-MDT0000 00000020:00000080:3.0:1788541171.170418:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6707a3c800/384f52e3-0481-4979-9299-157aff7472d2 for lustre-MDT0000 00000020:00000080:3.0:1788541171.170448:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a683517d000 for lustre-MDT0000 00000020:00000080:3.0:1788541171.170452:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a6707749800 for lustre-MDT0000 00000020:00000080:3.0:1788541171.170456:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a6707a3b800 for lustre-MDT0000 00010000:00010000:1.0:1788541171.274143:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788541171.594302:0:15206:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a6701099a80 - data ffff9a6839f0dd80/ffff9a6707931800 00000020:01000000:2.0:1788541171.594476:0:15206:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a682fdcbd20 - data ffff9a6839ca4d80/ffff9a682fdce000 00000001:00000004:0.0:1788541171.604488:0:15206:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:3.0:1788541171.698661:0:15206:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788541171.698671:0:15206:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1788541171.698688:0:15206:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9a670687b100 x1875420981137536/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788541179 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541171.698729:0:15206:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788541171.702599:0:15206:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788541171.702607:0:15206:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:3.0:1788541171.702621:0:15206:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788541171.702624:0:15206:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788541171.703515:0:8970:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788541171.703520:0:8970:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1788541171.703530:0:8970:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1788541171.704056:0:15206:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788541171.704061:0:15206:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:1.0:1788541171.704081:0:15206:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788541171.704083:0:15206:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788541171.705795:0:9840:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788541171.705811:0:9840:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1788541171.705824:0:9840:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1788541171.707644:0:15206:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a7211 00000020:00000080:3.0:1788541171.707657:0:15206:0:(genops.c:885:class_export_put()) final put ffff9a682e978000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788541171.709155:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a682e978000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788541171.710505:0:15206:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a7226 00000020:00000080:3.0:1788541171.710516:0:15206:0:(genops.c:885:class_export_put()) final put ffff9a6839113800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788541171.710570:0:15206:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788541171.710575:0:15206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788541171.710582:0:15206:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788541171.710587:0:15206:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9a68045f8000) has no exports 00000004:01000000:3.0:1788541171.710756:0:15206:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788541171.710765:0:15206:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a765c 00000020:00000080:3.0:1788541171.710769:0:15206:0:(genops.c:885:class_export_put()) final put ffff9a6707a39800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788541171.711181:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6839113800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788541171.711308:0:15206:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788541171.711326:0:15206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788541171.711336:0:15206:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788541171.711339:0:15206:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff9a6835314d40) has no exports 00000020:00000080:3.0:1788541171.711354:0:15206:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a7655 00000020:00000080:3.0:1788541171.711358:0:15206:0:(genops.c:885:class_export_put()) final put ffff9a6705af9000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788541171.711720:0:15206:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788541171.711726:0:15206:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788541171.711730:0:15206:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:3.0:1788541171.711735:0:15206:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788541171.711737:0:15206:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788541171.711768:0:15206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788541171.711777:0:15206:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788541171.711783:0:15206:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a751a 00000020:00000080:3.0:1788541171.711787:0:15206:0:(genops.c:885:class_export_put()) final put ffff9a6705aee800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788541171.711791:0:15206:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788541171.711794:0:15206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788541171.711798:0:15206:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788541171.711800:0:15206:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9a6835313380) has no exports 00000020:00000080:3.0:1788541171.711804:0:15206:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a7513 00000020:00000080:3.0:1788541171.711806:0:15206:0:(genops.c:885:class_export_put()) final put ffff9a6839111000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788541171.712101:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6707a39800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788541171.712108:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6705af9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788541171.712112:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a6705afe000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788541171.712118:0:36:0:(genops.c:885:class_export_put()) final put ffff9a670774b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788541171.712120:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a670774b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788541171.712123:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788541171.712195:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6705aee800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788541171.712211:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6839111000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788541171.712460:0:15206:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788541171.712463:0:15206:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788541171.712466:0:15206:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:3.0:1788541171.712469:0:15206:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788541171.712470:0:15206:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788541171.712507:0:15206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788541171.712514:0:15206:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1788541171.712524:0:15206:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788541171.712529:0:15206:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a73df 00000020:00000080:3.0:1788541171.712533:0:15206:0:(genops.c:885:class_export_put()) final put ffff9a683533a800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788541171.712537:0:15206:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1788541171.712541:0:15206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788541171.712544:0:15206:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788541171.712546:0:15206:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9a683f36cd40) has no exports 00000020:00000080:3.0:1788541171.712551:0:15206:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a73d8 00000020:00000080:3.0:1788541171.712560:0:15206:0:(genops.c:885:class_export_put()) final put ffff9a683f37a800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788541171.713434:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a6705aef000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788541171.713446:0:36:0:(genops.c:885:class_export_put()) final put ffff9a683f195800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788541171.713449:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a683f195800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788541171.713454:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788541171.713515:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a683533a800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788541171.713520:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a683f37a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788541171.717926:0:15206:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1788541171.717935:0:15206:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788541171.717939:0:15206:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1788541171.717947:0:15206:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788541171.718149:0:15206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788541171.718161:0:15206:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788541171.718186:0:15206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788541171.718189:0:15206:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788541171.718194:0:15206:0:(genops.c:885:class_export_put()) final put ffff9a682e97b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788541171.718208:0:15206:0:(genops.c:844:class_export_destroy()) destroying export ffff9a682e97b000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788541171.718217:0:15206:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788541171.718321:0:15206:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a722d 00000020:00000080:0.0:1788541171.718328:0:15206:0:(genops.c:885:class_export_put()) final put ffff9a6839116000/lustre-MDD0000_UUID 00000020:01000000:0.0:1788541171.718334:0:15206:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788541171.718338:0:15206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788541171.718343:0:15206:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788541171.718347:0:15206:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9a68045f99c0) has no exports 00000020:00000080:0.0:1788541171.718366:0:15206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788541171.718370:0:15206:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788541171.718375:0:15206:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a7234 00000020:00000080:0.0:1788541171.718379:0:15206:0:(genops.c:885:class_export_put()) final put ffff9a6839111800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788541171.718387:0:15206:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a68112dc000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788541171.718390:0:15206:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a68112dc000 3 00000020:01000004:0.0:1788541171.718393:0:15206:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a68112dc000 from lustre-MDT0000 00000020:00000080:0.0:1788541171.718409:0:15206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788541171.718413:0:15206:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788541171.718415:0:15206:0:(genops.c:885:class_export_put()) final put ffff9a682e97f000/lustre-MDT0000_UUID 00000020:00000080:0.0:1788541171.718417:0:15206:0:(genops.c:844:class_export_destroy()) destroying export ffff9a682e97f000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788541171.718424:0:15206:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788541171.718462:0:15206:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1788541171.718466:0:15206:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788541171.718477:0:15206:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788541171.718480:0:15206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788541171.718482:0:15206:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788541171.718489:0:15206:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9a680b3c0800 425687b6-1d99-41d2-88d8-2fb230997596 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788541171.718495:0:15206:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9a6831d44d40) has exports, disconnecting them 00000020:00080000:0.0:1788541171.718499:0:15206:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9a680b3c0800), last request at 1788540900 00000020:00000080:0.0:1788541171.718512:0:15206:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a71d2 00000020:00010000:0.0:1788541171.718516:0:15206:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9a680b3c0800: total 2 00000100:00080000:0.0:1788541171.718520:0:15206:0:(import.c:65:import_set_state_nolock()) ffff9a680b3c5800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788541171.718534:0:15206:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a680b3c0800): rc 0 00000020:00080000:0.0:1788541171.718538:0:15206:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9a6831d44d40) has no exports 00000100:00100000:0.0:1788541171.718590:0:6512:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9a682e741c00:6512] 2 exiting: rc = 0 00000100:00100000:1.0:1788541171.718802:0:6509:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9a68076fd200:6509] 0 exiting: rc = 1 00000020:00000080:1.0:1788541171.718847:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a683f37d000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788541171.718856:0:36:0:(genops.c:885:class_export_put()) final put ffff9a683f35d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788541171.718858:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a683f35d800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788541171.718862:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788541171.718948:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6839116000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788541171.718951:0:36:0:(genops.c:885:class_export_put()) final put ffff9a6814845800/lustre-MDD0000_UUID 00000020:00000080:1.0:1788541171.718953:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6814845800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788541171.718956:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788541171.719015:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6839111800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:0.0:1788541171.725202:0:8446:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9a680b3c0800: total 0 00010000:00010000:0.0:1788541171.725272:0:8446:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9a680b3c0800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788541171.725307:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a683551ba00/0x2aac941e5f4a7981 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2aac941e5f4a797a expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541171.725326:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a683551a800/0x2aac941e5f4a7751 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2aac941e5f4a774a expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541171.725336:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a683551ac00/0x2aac941e5f4a798f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2aac941e5f4a7988 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541171.725345:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a682e75e800/0x2aac941e5f4a75f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2aac941e5f4a75ec expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541171.725357:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a68354da400/0x2aac941e5f4a76ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2aac941e5f4a76e8 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541171.725366:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a68354da600/0x2aac941e5f4a76e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2aac941e5f4a76da expref: 9 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541171.725391:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a68354dae00/0x2aac941e5f4a76fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2aac941e5f4a76f6 expref: 8 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541171.725401:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6812045200/0x2aac941e5f4a770b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2aac941e5f4a7704 expref: 7 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541171.725409:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a68354db200/0x2aac941e5f4a7973 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2aac941e5f4a796c expref: 6 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541171.725420:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6812044c00/0x2aac941e5f4a7719 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2aac941e5f4a7712 expref: 5 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541171.725430:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6842049800/0x2aac941e5f4a72ce lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2aac941e5f4a72c7 expref: 4 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541171.725440:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6812045e00/0x2aac941e5f4a7727 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2aac941e5f4a7720 expref: 3 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541171.725450:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6812045000/0x2aac941e5f4a72dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2aac941e5f4a72d5 expref: 2 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541171.725459:0:8446:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9a680b3c0800, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1788541171.725472:0:8446:0:(genops.c:885:class_export_put()) final put ffff9a680b3c0800/425687b6-1d99-41d2-88d8-2fb230997596 00010000:00010000:0.0:1788541171.725494:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541171.725496:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541171.725499:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788541171.725810:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a680b3c0800/425687b6-1d99-41d2-88d8-2fb230997596 for MGS 00000100:00100000:3.0:1788541171.726050:0:6511:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9a68076fda00:6511] 1 exiting: rc = 0 00000100:00100000:0.0:1788541171.726627:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726637:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726643:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726649:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726664:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726670:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726675:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726681:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726687:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726692:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726698:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726705:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726710:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726717:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726723:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726729:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726735:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726741:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726746:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726752:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726757:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726763:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726769:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726775:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726781:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726787:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726792:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726797:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726802:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726808:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726814:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726820:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726825:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726830:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726835:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726840:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726845:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726851:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726856:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726886:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726893:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726898:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726904:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726910:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726915:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726921:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726926:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726931:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726936:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726941:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726946:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726950:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726955:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726970:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.726976:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788541171.727132:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a680b3c5800 for MGS 00000100:00100000:0.0:1788541171.727326:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.727333:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.727339:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.727345:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.727350:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.727356:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.727361:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.727366:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541171.727372:0:15206:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1788541171.728301:0:15206:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a67010990c0 - data ffff9a6839f0dca8/ffff9a6707933000 00000020:01000000:0.0:1788541171.728409:0:15206:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a68065a75a0 - data ffff9a6839c4ae58/ffff9a682e78ac00 00000020:00000080:0.0:1788541171.728901:0:15206:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a71b6 00000020:00000080:0.0:1788541171.728909:0:15206:0:(genops.c:885:class_export_put()) final put ffff9a68112d9000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788541171.728921:0:15206:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a68112dc000 from MGS, refs=2 00000020:01000004:0.0:1788541171.728925:0:15206:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a68112dc000 2 00000020:01000004:0.0:1788541171.728928:0:15206:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a68112dc000 from MGS 00000020:00000080:0.0:1788541171.728949:0:15206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788541171.728955:0:15206:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788541171.729311:0:15206:0:(genops.c:885:class_export_put()) final put ffff9a68112da000/MGS 00000020:00000080:0.0:1788541171.729314:0:15206:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68112da000/MGS for MGS 00000020:01000000:0.0:1788541171.729320:0:15206:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788541171.729375:0:15206:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788541171.729378:0:15206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788541171.729383:0:15206:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788541171.729389:0:15206:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9a682b4e1000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788541171.729395:0:15206:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9a682fe0b380) has exports, disconnecting them 00000020:00080000:0.0:1788541171.729400:0:15206:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9a682b4e1000), last request at 1788540901 00000020:00000080:0.0:1788541171.729405:0:15206:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a7281 00000020:00080000:0.0:1788541171.729413:0:15206:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a682b4e1000): rc 0 00000020:00000080:0.0:1788541171.729417:0:15206:0:(genops.c:885:class_export_put()) final put ffff9a682b4e1000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788541171.730141:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68112d9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788541171.730157:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a682b4e1000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788541171.753363:0:15206:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788541171.753374:0:15206:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788541171.753379:0:15206:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788541171.753387:0:15206:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788541171.753619:0:15206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788541171.753628:0:15206:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788541171.753636:0:15206:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a68112dc000 1 00000020:00000080:0.0:1788541171.753642:0:15206:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a71a8 00000020:00000080:0.0:1788541171.753651:0:15206:0:(genops.c:885:class_export_put()) final put ffff9a68112d8800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788541171.753950:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a682b4e2000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788541171.753959:0:36:0:(genops.c:885:class_export_put()) final put ffff9a682b4e7000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788541171.754041:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a682b4e7000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788541171.754055:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:0.0:1788541171.754286:0:15206:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788541171.754291:0:15206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788541171.754297:0:15206:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788541171.754301:0:15206:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9a6831d40000) has no exports 00000020:00000080:1.0:1788541171.757070:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68112d8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788541171.822286:0:15206:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788541171.822300:0:15206:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1788541171.822306:0:15206:0:(genops.c:885:class_export_put()) final put ffff9a68112df000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788541171.822310:0:15206:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68112df000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788541171.822317:0:15206:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1788541171.822450:0:15206:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a68112db000 00000020:02000400:3.0:1788541171.822514:0:15206:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:0.0:1788541172.170077:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788541172.170100:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981137920:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788541172.170167:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541172.170229:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981137920 00000100:00100000:0.0:1788541172.170237:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981137920 00000100:00100000:0.0:1788541172.170299:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788541172.170308:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981137920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788541172.170339:0:8434:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788541172.170386:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981137920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541172.170393:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:0.0:1788541172.170412:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788541172.170448:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981137920:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788541172.298026:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541173.194135:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981138048:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788541173.194226:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541173.194460:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981138048 00000100:00100000:1.0:1788541173.194469:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981138048 00000100:00100000:1.0:1788541173.194560:0:10866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788541173.194569:0:10866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3644:x1875420981138048:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1788541173.194577:0:10866:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788541173.194632:0:10866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3644:x1875420981138048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (405us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788541173.194639:0:10866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:02020000:0.0:1788541173.194710:0:3644:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:0.0:1788541173.204600:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788541173.204608:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a6808b0f000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788541173.204613:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788541173.228224:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9a6808b0f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788541173.228241:0:3644:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 202 00000100:00080000:0.0:1788541173.228254:0:3644:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9a6808b0f000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:1.0:1788541173.228475:0:3644:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a670835d180 x1875420981138176/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788541173.229082:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981138176:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1788541173.229155:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541173.229260:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981138176 00000100:00100000:1.0:1788541173.229268:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981138176 00000100:00100000:1.0:1788541173.229317:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788541173.229324:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875420981138176:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:1.0:1788541173.229350:0:6523:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788541173.229399:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875420981138176:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 74us (244us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788541173.229416:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00080000:0.0:1788541173.229531:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a6808b0f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788541173.229536:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788541173.229540:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981138176:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:1.0:1788541173.324133:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788541174.218613:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788541174.218620:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788541174.218637:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a6808b0f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788541174.218645:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 454 00000100:00080000:0.0:1788541174.218651:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788541174.218658:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9a6808b0f000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:0.0:1788541174.218681:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6707a73b80 x1875420981138432/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788541174.218787:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875420981138688:0@lo:400:kworker.0 00000100:00100000:0.0:1788541174.218854:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541174.218921:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670781b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875420981139200:0@lo:400:kworker.0 00000100:00100000:0.0:1788541174.218940:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541174.218970:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788541174.218975:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875420981138816:0@lo:400:kworker.0 00000100:00100000:0.0:1788541174.218997:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541174.219013:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707818700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981139328:0@lo:400:kworker.0 00000100:00100000:0.0:1788541174.219033:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541174.219068:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981138688 00000100:00100000:0.0:1788541174.219077:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981138688 00000100:00100000:0.0:1788541174.219111:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981139200 00000100:00100000:0.0:1788541174.219114:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981139200 00000100:00100000:0.0:1788541174.219143:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981138816 00000100:00100000:0.0:1788541174.219146:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981138816 00000100:00100000:1.0:1788541174.219526:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981138432:0@lo:38:kworker.0 00000100:00100000:1.0:1788541174.219561:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541174.219605:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:1.0:1788541174.219614:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670781b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875420981139200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541174.219668:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670781b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875420981139200:12345-0@lo:400:kworker.0 Request processed in 55us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541174.219675:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:1.0:1788541174.219693:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788541174.219697:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670781a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875420981138688:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788541174.219703:0:6519:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788541174.219726:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670781a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1875420981138688:12345-0@lo:400:kworker.0 Request processed in 28us (873us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788541174.219732:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788541174.219747:0:10866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981138432 00000100:00100000:1.0:1788541174.219750:0:10866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981138432 00000100:00100000:1.0:1788541174.219770:0:10866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788541174.219775:0:10866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875420981138432:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788541174.219854:0:10866:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788541174.219910:0:10866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1875420981138432:12345-0@lo:38:kworker.0 Request processed in 134us (347us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788541174.219917:0:10866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00080000:1.0:1788541174.219951:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a6808b0f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788541174.219966:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788541174.219981:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981138432:0@lo:38:kworker.0 00000100:00100000:3.0:1788541174.220102:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420981138304:0@lo:400:kworker.0 00000400:00000100:3.0:1788541174.220127:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875420981138304 offset 0 length 224: 4 00000100:00100000:3.0:1788541174.220160:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981138944:0@lo:400:kworker.0 00000100:00100000:3.0:1788541174.220183:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541174.220206:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788541174.220212:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707a72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875420981138560:0@lo:400:kworker.0 00000100:00100000:3.0:1788541174.220234:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541174.220253:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875420981139072:0@lo:400:kworker.0 00000100:00100000:3.0:1788541174.220271:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541174.220293:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981138560 00000100:00100000:3.0:1788541174.220296:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981138560 00000100:00100000:3.0:1788541174.220319:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981139072 00000100:00100000:3.0:1788541174.220321:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981139072 00000100:00100000:3.0:1788541174.220331:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788541174.220335:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1875420981138560:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788541174.220339:0:6517:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788541174.220365:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1875420981138560:12345-0@lo:400:kworker.0 Request processed in 29us (130us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788541174.220370:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788541174.220391:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788541174.220566:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1788541174.220572:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875420981138816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541174.220605:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875420981138816:12345-0@lo:400:kworker.0 Request processed in 34us (1608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541174.220611:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1788541174.220634:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981139328 00000100:00100000:0.0:1788541174.220637:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981139328 00000100:00100000:0.0:1788541174.220658:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981138944 00000100:00100000:0.0:1788541174.220660:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981138944 00000100:00100000:0.0:1788541174.220676:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788541174.220681:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981139328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541174.220709:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981139328:12345-0@lo:400:kworker.0 Request processed in 28us (1675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541174.220715:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788541174.220724:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788541174.220729:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706830e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981138944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541174.220749:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706830e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981138944:12345-0@lo:400:kworker.0 Request processed in 20us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541174.220754:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:0.0:1788541174.220766:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788541174.220769:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788541174.220772:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788541174.221071:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788541174.221107:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1875420981139072:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788541174.221117:0:6517:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788541174.221145:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1875420981139072:12345-0@lo:400:kworker.0 Request processed in 749us (873us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788541174.221160:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:3.0:1788541174.221207:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788541174.221211:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9a682ff98000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788541174.221214:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00010000:00080000:0.0:1788541174.225121:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9a6707a70e00 x1875420981138816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541174.225140:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875420981138816:0@lo:400:kworker.0 00000100:00100000:0.0:1788541174.225159:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707818700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981139328:0@lo:400:kworker.0 00000100:00080000:0.0:1788541174.225173:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788541174.225178:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9a6705afc800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788541174.225182:0:3643:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788541174.225188:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9a6705afc800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788541174.225191:0:3643:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 222 00000100:00080000:0.0:1788541174.225218:0:3643:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a6705afc800 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:0.0:1788541174.225254:0:3643:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a670831e680 x1875420981139584/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788541174.225285:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875420981138688:0@lo:400:kworker.0 00010000:00080000:0.0:1788541174.225299:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9a670781b480 x1875420981139200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541174.225309:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670781b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875420981139200:0@lo:400:kworker.0 00000100:00100000:0.0:1788541174.225348:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875420981139584:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788541174.225405:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541174.225445:0:9339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981139584 00000100:00100000:0.0:1788541174.225451:0:9339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981139584 00000100:00100000:0.0:1788541174.225487:0:9339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788541174.225493:0:9339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875420981139584:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:0.0:1788541174.225513:0:9339:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788541174.225553:0:9339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1875420981139584:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 58us (147us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788541174.225560:0:9339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:0.0:1788541174.225587:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a6705afc800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788541174.225591:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788541174.225594:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875420981139584:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1788541174.226148:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981139456:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788541174.226189:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541174.228502:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981139456 00000100:00100000:1.0:1788541174.228515:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981139456 00000100:00100000:1.0:1788541174.229901:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788541174.229918:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981139456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788541174.229953:0:8433:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788541174.230052:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981139456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 141us (3862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541174.230059:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788541174.231349:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981139456:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788541174.232586:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9a682ff98000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788541174.232597:0:3641:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 202 00000100:00080000:3.0:1788541174.232608:0:3641:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9a682ff98000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:3.0:1788541174.232647:0:3641:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6706831880 x1875420981139712/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788541174.232711:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875420981139712:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788541174.232787:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541174.233262:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875420981138560:0@lo:400:kworker.0 00000100:00080000:3.0:1788541174.233285:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788541174.233289:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9a6705ae9800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788541174.233293:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788541174.233296:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9a6705ae9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788541174.233300:0:3641:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 247 00000100:00080000:3.0:1788541174.233304:0:3641:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a6705ae9800 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:3.0:1788541174.233319:0:3641:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6706831c00 x1875420981139840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788541174.233563:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875420981139840:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788541174.233594:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541174.233690:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3641:1875420981139072:0@lo:400:kworker.0 00000100:00100000:3.0:1788541174.233722:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981138944:0@lo:400:kworker.0 00000100:00100000:2.0:1788541174.233906:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981139712 00000100:00100000:2.0:1788541174.233913:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981139712 00000100:00100000:2.0:1788541174.235518:0:12149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981139840 00000100:00100000:2.0:1788541174.235528:0:12149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981139840 00000100:00100000:2.0:1788541174.235559:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788541174.235568:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1875420981139712:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1788541174.235589:0:12149:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788541174.235665:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1875420981139712:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 96us (2886us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788541174.235672:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788541174.235687:0:12149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788541174.235692:0:12149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1875420981139840:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1788541174.235702:0:12149:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788541174.235722:0:12149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3640:x1875420981139840:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 29us (2127us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788541174.235733:0:12149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00080000:2.0:1788541174.235771:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a6705ae9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788541174.235776:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788541174.235791:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875420981139840:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:2.0:1788541174.235801:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a682ff98000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788541174.235804:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788541174.235807:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875420981139712:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:1.0:1788541174.352912:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541175.371095:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788541175.463227:0:15407:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788541175.490992:0:15407:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1788541175.491051:0:15407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6812044200/0x2aac941e5f4a7712 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7719 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541175.491073:0:15407:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6812044200/0x2aac941e5f4a7712 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a7719 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541175.491080:0:15407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6812044200/0x2aac941e5f4a7712 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a7719 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541175.491088:0:15407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.156@tcp lock: ffff9a6812044200/0x2aac941e5f4a7712 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a7719 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541175.491123:0:15407:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788541175.491129:0:15407:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788541175.491160:0:15407:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788541175.491165:0:15407:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788541175.491173:0:15407:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788541175.491180:0:15407:0:(import.c:65:import_set_state_nolock()) ffff9a682ff98000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788541175.491185:0:15407:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788541175.491200:0:15407:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788541175.491204:0:15407:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788541175.492085:0:15407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6812044e00/0x2aac941e5f4a7720 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7727 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541175.492097:0:15407:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6812044e00/0x2aac941e5f4a7720 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a7727 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541175.492104:0:15407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6812044e00/0x2aac941e5f4a7720 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a7727 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541175.492110:0:15407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.156@tcp lock: ffff9a6812044e00/0x2aac941e5f4a7720 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a7727 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541175.492135:0:15407:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788541175.492140:0:15407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75ea00/0x2aac941e5f4a75ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a75f3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541175.492148:0:15407:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75ea00/0x2aac941e5f4a75ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a75f3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541175.492154:0:15407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75ea00/0x2aac941e5f4a75ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a75f3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541175.492160:0:15407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.156@tcp lock: ffff9a682e75ea00/0x2aac941e5f4a75ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a75f3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541175.492175:0:15407:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788541175.492181:0:15407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68354db400/0x2aac941e5f4a7988 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a798f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541175.492200:0:15407:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68354db400/0x2aac941e5f4a7988 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a798f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541175.492206:0:15407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68354db400/0x2aac941e5f4a7988 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a798f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541175.492212:0:15407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.156@tcp lock: ffff9a68354db400/0x2aac941e5f4a7988 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a798f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541175.492218:0:15407:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1788541175.492222:0:15407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6842172400/0x2aac941e5f4a72d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a72dc expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541175.492228:0:15407:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6842172400/0x2aac941e5f4a72d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a72dc expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541175.492234:0:15407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6842172400/0x2aac941e5f4a72d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a72dc expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541175.492241:0:15407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.156@tcp lock: ffff9a6842172400/0x2aac941e5f4a72d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a72dc expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541175.492247:0:15407:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 10000000:01000000:2.0:1788541175.492250:0:15407:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:2.0:1788541175.492272:0:15407:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1788541175.492276:0:15407:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1788541175.492280:0:15407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788541175.492286:0:15407:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1788541175.492293:0:15407:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9a6705ae9000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788541175.492303:0:15407:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9a6705aee000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788541175.492309:0:15407:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9a683f36b380) has exports, disconnecting them 00000020:00080000:2.0:1788541175.492315:0:15407:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9a6705ae9000), last request at 1788541174 00000020:00000080:2.0:1788541175.492322:0:15407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a75b4 00000100:00080000:2.0:1788541175.492338:0:15407:0:(import.c:65:import_set_state_nolock()) ffff9a6705aec000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788541175.492379:0:15407:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a6705ae9000): rc 0 00000020:00000080:2.0:1788541175.492382:0:15407:0:(genops.c:885:class_export_put()) final put ffff9a6705ae9000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:2.0:1788541175.492394:0:15407:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9a6705aee000), last request at 1788541174 00000020:00000080:2.0:1788541175.492397:0:15407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a748e 00000100:00080000:2.0:1788541175.492402:0:15407:0:(import.c:65:import_set_state_nolock()) ffff9a6705aeb800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788541175.492408:0:15407:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a6705aee000): rc 0 00000020:00000080:2.0:1788541175.492409:0:15407:0:(genops.c:885:class_export_put()) final put ffff9a6705aee000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1788541175.492416:0:15407:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb5cdc14fbae0 00000100:00080000:2.0:1788541175.492437:0:15407:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788541175.492447:0:15407:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9a670835c000 x1875420981138048/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788541189 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541175.492462:0:15407:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00100000:2.0:1788541175.493348:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981138048:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1788541175.493384:0:15407:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788541175.493389:0:15407:0:(import.c:65:import_set_state_nolock()) ffff9a6808b0f000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000020:00000080:0.0:1788541175.493479:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6705ae9000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1788541175.493543:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6705aee000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1788541175.493565:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a6705aec000 for lustre-MDT0001 00000020:00000080:0.0:1788541175.493570:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a6705aeb800 for lustre-MDT0001 00010000:00010000:3.0:1788541175.493648:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788541175.493648:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788541175.493655:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a6812044e00/0x2aac941e5f4a7720 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a7727 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541175.493656:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a6812044200/0x2aac941e5f4a7712 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a7719 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541175.493665:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6812044e00 already unused, calling callback (ffffffffc150fc20) 00010000:00010000:3.0:1788541175.493666:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6812044200 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:3.0:1788541175.493670:0:8446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a6812044200/0x2aac941e5f4a7712 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a7719 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788541175.493670:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a6812044e00/0x2aac941e5f4a7720 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a7727 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541175.493682:0:8446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a6812044200/0x2aac941e5f4a7712 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x2aac941e5f4a7719 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541175.493682:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a6812044e00/0x2aac941e5f4a7720 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x2aac941e5f4a7727 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788541175.493691:0:8446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a6812044200/0x2aac941e5f4a7712 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x2aac941e5f4a7719 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788541175.493691:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a6812044e00/0x2aac941e5f4a7720 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x2aac941e5f4a7727 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541175.493698:0:8446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788541175.493698:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788541175.493701:0:8446:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788541175.493701:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:0.0:1788541175.493703:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:3.0:1788541175.493704:0:8446:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788541175.493790:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788541175.500724:0:8446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a6812044200/0x2aac941e5f4a7712 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a7719 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541175.500748:0:8446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788541175.500749:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a6812044e00/0x2aac941e5f4a7720 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a7727 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541175.500757:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788541175.500790:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a6812044e00/0x2aac941e5f4a7720 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a7727 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541175.500797:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a6812044e00/0x2aac941e5f4a7720 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a7727 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541175.500838:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788541175.500843:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a68354db400/0x2aac941e5f4a7988 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a798f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541175.500850:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68354db400 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:0.0:1788541175.500854:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a68354db400/0x2aac941e5f4a7988 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a798f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541175.500864:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a68354db400/0x2aac941e5f4a7988 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2aac941e5f4a798f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788541175.500887:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a68354db400/0x2aac941e5f4a7988 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2aac941e5f4a798f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788541175.500893:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788541175.500896:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788541175.500900:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788541175.500902:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a6812044200/0x2aac941e5f4a7712 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a7719 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541175.500909:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a6812044200/0x2aac941e5f4a7712 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a7719 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541175.500914:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a68354db400/0x2aac941e5f4a7988 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a798f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541175.500920:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541175.500920:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788541175.500924:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a6842172400/0x2aac941e5f4a72d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a72dc expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541175.500926:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a68354db400/0x2aac941e5f4a7988 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a798f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541175.500932:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a68354db400/0x2aac941e5f4a7988 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a798f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541175.500936:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842172400 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:3.0:1788541175.500939:0:8446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a6842172400/0x2aac941e5f4a72d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a72dc expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541175.500942:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541175.500953:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541175.500956:0:8446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a6842172400/0x2aac941e5f4a72d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2aac941e5f4a72dc expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541175.500960:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:3.0:1788541175.500962:0:8446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a6842172400/0x2aac941e5f4a72d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2aac941e5f4a72dc expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541175.500967:0:8446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788541175.500969:0:8446:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788541175.500971:0:8446:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788541175.500984:0:8446:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a6842172400/0x2aac941e5f4a72d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a72dc expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541175.500989:0:8446:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788541175.500995:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a6842172400/0x2aac941e5f4a72d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a72dc expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541175.501001:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a6842172400/0x2aac941e5f4a72d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a72dc expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541175.501015:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541175.501017:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541175.501019:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541175.501084:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420981140096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788541175.501160:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541175.501234:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788541175.501240:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420981140224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788541175.501262:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541175.501286:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706832a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420981139968:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788541175.501306:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541175.501323:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788541175.501328:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706831500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420981140352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788541175.501346:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541175.501381:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981140096 00000100:00100000:0.0:1788541175.501391:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981140096 00000100:00100000:0.0:1788541175.501430:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981140224 00000100:00100000:0.0:1788541175.501434:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981140224 00000100:00100000:0.0:1788541175.501442:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981139968 00000100:00100000:0.0:1788541175.501444:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981139968 00000100:00100000:0.0:1788541175.501451:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981140352 00000100:00100000:0.0:1788541175.501453:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981140352 00000100:00100000:0.0:1788541175.501464:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788541175.501471:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3643:x1875420981140096:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788541175.501477:0:6503:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788541175 with bad export cookie 3074995503755850194 00000100:00100000:3.0:1788541175.501733:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788541175.501739:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68076e9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3643:x1875420981140224:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788541175.501745:0:6502:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788541175 with bad export cookie 3074995503755850194 00000100:00100000:3.0:1788541175.501815:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68076e9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3643:x1875420981140224:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (550us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788541175.501823:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788541175.501844:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788541175.501848:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3642:x1875420981139968:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788541175.501853:0:6502:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788541175 with bad export cookie 3074995503755850194 00000100:00100000:3.0:1788541175.501907:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3642:x1875420981139968:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (598us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788541175.501913:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788541175.501924:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788541175.501928:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3642:x1875420981140352:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788541175.501932:0:6502:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788541175 with bad export cookie 3074995503755850194 00000100:00100000:3.0:1788541175.501966:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3642:x1875420981140352:12345-0@lo:103:ldlm_bl.0 Request processed in 35us (618us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788541175.501971:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1788541175.505013:0:15407:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788541175.505022:0:15407:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:3.0:1788541175.505042:0:15407:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788541175.505103:0:15407:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788541175.505135:0:15407:0:(import.c:65:import_set_state_nolock()) ffff9a683f196000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788541175.505154:0:15407:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788541175.505157:0:15407:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:3.0:1788541175.505168:0:15407:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788541175.505224:0:15407:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788541175.505233:0:15407:0:(import.c:65:import_set_state_nolock()) ffff9a68379b3000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788541175.505258:0:15407:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9a683f36b380) has no exports 00010000:00010000:1.0:1788541175.505308:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541175.505312:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541175.505314:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541175.505425:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a682e75ea00/0x2aac941e5f4a75ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a75f3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541175.505454:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75ea00 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:3.0:1788541175.505458:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a682e75ea00/0x2aac941e5f4a75ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a75f3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541175.505469:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a682e75ea00/0x2aac941e5f4a75ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2aac941e5f4a75f3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788541175.505476:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a682e75ea00/0x2aac941e5f4a75ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2aac941e5f4a75f3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541175.505482:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788541175.505484:0:6506:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788541175.505488:0:6506:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788541175.505525:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a682e75ea00/0x2aac941e5f4a75ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a75f3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541175.505532:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788541175.505548:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a682e75ea00/0x2aac941e5f4a75ec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a75f3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541175.505556:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a682e75ea00/0x2aac941e5f4a75ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2aac941e5f4a75f3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541175.505571:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541175.505573:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541175.505574:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541175.508450:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981140480:0@lo:9:umount.0 00000100:00100000:2.0:1788541175.508542:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541175.508581:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981140608:0@lo:9:umount.0 00000100:00100000:2.0:1788541175.508602:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541175.508651:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981140480 00000100:00100000:2.0:1788541175.508659:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981140480 00000100:00100000:2.0:1788541175.508727:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981140608 00000100:00100000:2.0:1788541175.508731:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981140608 00000100:00100000:2.0:1788541175.508754:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788541175.508762:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1875420981140480:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788541175.508792:0:8431:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a74db 00000100:00080000:2.0:1788541175.508804:0:8431:0:(import.c:65:import_set_state_nolock()) ffff9a683f355000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788541175.508850:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1788541175.508891:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788541175.508901:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1875420981140608:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788541175.508914:0:8432:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a761d 00000100:00080000:3.0:1788541175.508924:0:8432:0:(import.c:65:import_set_state_nolock()) ffff9a67078db800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788541175.508963:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1788541175.509019:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3640:x1875420981140480:12345-0@lo:9:umount.0 Request processed in 257us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541175.509027:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788541175.509041:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3640:x1875420981140608:12345-0@lo:9:umount.0 Request processed in 142us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541175.509047:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00010000:3.0:1788541175.509063:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788541175.509069:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a683f196000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788541175.509077:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788541175.509079:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788541175.509083:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981140480:0@lo:9:umount.0 00000100:00080000:2.0:1788541175.509095:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a68379b3000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788541175.509113:0:3640:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788541175.509115:0:3640:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788541175.509118:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981140608:0@lo:9:umount.0 00000100:00100000:2.0:1788541175.514781:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420981140736:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788541175.514884:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788541175.514965:0:3642:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.156@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:3.0:1788541175.514967:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981140736 00000100:00080000:2.0:1788541175.514970:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9a682e801000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788541175.514973:0:3642:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.156@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:3.0:1788541175.514975:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981140736 00000100:00100000:3.0:1788541175.515014:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788541175.515021:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3642:x1875420981140736:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788541175.515028:0:6502:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788541175 with bad export cookie 3074995503755850194 00000100:00100000:3.0:1788541175.515072:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3642:x1875420981140736:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (203us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788541175.515078:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:1.0:1788541175.519962:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788541175.521824:0:3643:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.156@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:0.0:1788541175.532486:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3643:x1875420981140096:12345-0@lo:103:ldlm_bl.0 Request processed in 31008us (31320us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788541175.532511:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1788541175.545424:0:3642:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.156@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788541175.545430:0:3642:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788541175.545439:0:3642:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a6707a72d80 x1875420981138304/t0(0) o400->MGC192.168.202.156@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788541190 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541175.545494:0:3642:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a670831c700 x1875420981140096/t0(0) o103->MGC192.168.202.156@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788541191 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541175.545588:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707a72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:425687b6-1d99-41d2-88d8-2fb230997596:3641:1875420981138304:0@lo:400:kworker.0 00000100:00100000:2.0:1788541175.545829:0:3642:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a670831d880 x1875420981140224/t0(0) o103->MGC192.168.202.156@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788541191 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541175.545840:0:3642:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a6706832a00 x1875420981139968/t0(0) o103->MGC192.168.202.156@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788541191 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541175.545850:0:3642:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a6706831500 x1875420981140352/t0(0) o103->MGC192.168.202.156@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788541191 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541175.545859:0:3642:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a6706832680 x1875420981140736/t0(0) o103->MGC192.168.202.156@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788541191 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788541175.545895:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788541175.545898:0:3642:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788541175.545900:0:3642:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788541175.546334:0:3643:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9a682e801000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1788541175.546408:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420981140096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788541175.546436:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:425687b6-1d99-41d2-88d8-2fb230997596:3643:1875420981140224:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788541175.551439:0:3642:0:(import.c:65:import_set_state_nolock()) ffff9a682e801000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788541175.551452:0:3642:0:(import.c:545:import_select_connection()) MGC192.168.202.156@tcp: connect to NID 0@lo last attempt 181 00000100:00080000:2.0:1788541175.551461:0:3642:0:(import.c:665:import_select_connection()) MGC192.168.202.156@tcp: import ffff9a682e801000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:2.0:1788541175.551500:0:3642:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a67080d5500 x1875420981140864/t0(0) o250->MGC192.168.202.156@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788541175.551559:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706832a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420981139968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788541175.551581:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420981140736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788541175.551581:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:425687b6-1d99-41d2-88d8-2fb230997596:3640:1875420981140864:0@lo:250:ptlrpcd_00_01.0 00000100:00100000:2.0:1788541175.551587:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706831500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:425687b6-1d99-41d2-88d8-2fb230997596:3642:1875420981140352:0@lo:103:ldlm_bl.0 00000400:00000100:0.0:1788541175.551742:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875420981140864 offset 0 length 520: 4 00000020:00080000:2.0:1788541175.557518:0:15407:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9a683f36b380) has no exports 00000020:01000000:3.0:1788541175.630043:0:15407:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a6707801a80 - data ffff9a6839f0ce58/ffff9a670690fc00 00000020:01000000:3.0:1788541175.630208:0:15407:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a683508ea20 - data ffff9a6839e3c510/ffff9a683f123800 00000001:00000004:3.0:1788541175.652390:0:15407:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:2.0:1788541175.711039:0:15407:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788541175.711048:0:15407:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1788541175.711056:0:15407:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788541175.712696:0:15407:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788541175.712702:0:15407:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:2.0:1788541175.712726:0:15407:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788541175.712729:0:15407:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788541175.713186:0:8966:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788541175.713194:0:8966:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:3.0:1788541175.713219:0:8966:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788541175.713970:0:15407:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788541175.713976:0:15407:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:2.0:1788541175.713990:0:15407:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788541175.713992:0:15407:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788541175.714257:0:9835:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788541175.714262:0:9835:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:1.0:1788541175.714271:0:9835:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1788541175.716256:0:15407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a72f8 00000020:00000080:2.0:1788541175.716267:0:15407:0:(genops.c:885:class_export_put()) final put ffff9a683f35c800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788541175.717083:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a683f35c800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788541175.718555:0:15407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a730d 00000020:00000080:2.0:1788541175.718571:0:15407:0:(genops.c:885:class_export_put()) final put ffff9a683f37f800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788541175.718626:0:15407:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1788541175.718633:0:15407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788541175.718641:0:15407:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788541175.718645:0:15407:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9a6831d43380) has no exports 00000004:01000000:2.0:1788541175.718823:0:15407:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788541175.718832:0:15407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a7616 00000020:00000080:2.0:1788541175.718837:0:15407:0:(genops.c:885:class_export_put()) final put ffff9a68379b2800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788541175.722369:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a683f37f800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1788541175.722772:0:15407:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1788541175.722783:0:15407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788541175.722796:0:15407:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788541175.722800:0:15407:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff9a6707910000) has no exports 00000020:00000080:2.0:1788541175.722810:0:15407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a760f 00000020:00000080:2.0:1788541175.722818:0:15407:0:(genops.c:885:class_export_put()) final put ffff9a68379b0800/lustre-MDT0001-osd_UUID 00010000:01000000:2.0:1788541175.723233:0:15407:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1788541175.723238:0:15407:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788541175.723242:0:15407:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:2.0:1788541175.723247:0:15407:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788541175.723250:0:15407:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788541175.723284:0:15407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788541175.723290:0:15407:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788541175.723296:0:15407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a74d4 00000020:00000080:2.0:1788541175.723320:0:15407:0:(genops.c:885:class_export_put()) final put ffff9a683f197000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788541175.723326:0:15407:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1788541175.723329:0:15407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788541175.723332:0:15407:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788541175.723334:0:15407:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9a68353119c0) has no exports 00000020:00000080:2.0:1788541175.723338:0:15407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a74cd 00000020:00000080:2.0:1788541175.723341:0:15407:0:(genops.c:885:class_export_put()) final put ffff9a6705aec800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788541175.723863:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68379b2800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1788541175.723899:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68379b0800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788541175.723904:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a68379b3000 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1788541175.723910:0:8:0:(genops.c:885:class_export_put()) final put ffff9a68379b4800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788541175.723912:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68379b4800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1788541175.723916:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788541175.724016:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a683f197000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1788541175.724020:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6705aec800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1788541175.724717:0:15407:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1788541175.724723:0:15407:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788541175.724727:0:15407:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:2.0:1788541175.724733:0:15407:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788541175.724735:0:15407:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788541175.724864:0:15407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788541175.724936:0:15407:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1788541175.724960:0:15407:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1788541175.724968:0:15407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a7330 00000020:00000080:2.0:1788541175.724974:0:15407:0:(genops.c:885:class_export_put()) final put ffff9a6835182000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788541175.724980:0:15407:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1788541175.724985:0:15407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788541175.724990:0:15407:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788541175.724993:0:15407:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9a682e7499c0) has no exports 00000020:00000080:2.0:1788541175.725000:0:15407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a7329 00000020:00000080:2.0:1788541175.725003:0:15407:0:(genops.c:885:class_export_put()) final put ffff9a6831d4d800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788541175.725913:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a683f196000 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1788541175.725923:0:8:0:(genops.c:885:class_export_put()) final put ffff9a6705ae8800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788541175.725926:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6705ae8800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1788541175.725932:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788541175.726012:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6835182000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788541175.726017:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6831d4d800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1788541175.738988:0:15407:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:3.0:1788541175.738996:0:15407:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788541175.739001:0:15407:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:3.0:1788541175.739009:0:15407:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788541175.739066:0:15407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788541175.739077:0:15407:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788541175.739107:0:15407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788541175.739110:0:15407:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788541175.739115:0:15407:0:(genops.c:885:class_export_put()) final put ffff9a683f358000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788541175.739130:0:15407:0:(genops.c:844:class_export_destroy()) destroying export ffff9a683f358000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1788541175.739139:0:15407:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788541175.739291:0:15407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a7314 00000020:00000080:3.0:1788541175.739298:0:15407:0:(genops.c:885:class_export_put()) final put ffff9a683f37c800/lustre-MDD0001_UUID 00000020:01000000:3.0:1788541175.739303:0:15407:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:3.0:1788541175.739306:0:15407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788541175.739310:0:15407:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788541175.739314:0:15407:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9a683f368000) has no exports 00000020:00000080:3.0:1788541175.739340:0:15407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788541175.739343:0:15407:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:3.0:1788541175.739347:0:15407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a731b 00000020:00000080:3.0:1788541175.739351:0:15407:0:(genops.c:885:class_export_put()) final put ffff9a683f37e800/lustre-MDT0001-osd_UUID 00000020:01000004:3.0:1788541175.739358:0:15407:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a6839117000 from lustre-MDT0001, refs=2 00000020:01000004:3.0:1788541175.739361:0:15407:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a6839117000 2 00000020:01000004:3.0:1788541175.739364:0:15407:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a6839117000 from lustre-MDT0001 00000020:00000080:3.0:1788541175.739392:0:15407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788541175.739395:0:15407:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:3.0:1788541175.739397:0:15407:0:(genops.c:885:class_export_put()) final put ffff9a683f35e800/lustre-MDT0001_UUID 00000020:00000080:3.0:1788541175.739399:0:15407:0:(genops.c:844:class_export_destroy()) destroying export ffff9a683f35e800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:3.0:1788541175.739405:0:15407:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:3.0:1788541175.739437:0:15407:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:3.0:1788541175.739441:0:15407:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:3.0:1788541175.739443:0:15407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788541175.739446:0:15407:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788541175.739452:0:15407:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9a6835182800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788541175.739457:0:15407:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9a68045fb380) has exports, disconnecting them 00000020:00080000:3.0:1788541175.739462:0:15407:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9a6835182800), last request at 1788540921 00000020:00000080:3.0:1788541175.739465:0:15407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a736f 00000020:00080000:3.0:1788541175.739483:0:15407:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a6835182800): rc 0 00000020:00000080:3.0:1788541175.739486:0:15407:0:(genops.c:885:class_export_put()) final put ffff9a6835182800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788541175.740243:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a6808b0f000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788541175.740254:0:8:0:(genops.c:885:class_export_put()) final put ffff9a682ff9c800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788541175.740256:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a682ff9c800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1788541175.740268:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788541175.740366:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a683f37c800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1788541175.740370:0:8:0:(genops.c:885:class_export_put()) final put ffff9a683f35a000/lustre-MDD0001_UUID 00000020:00000080:1.0:1788541175.740371:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a683f35a000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1788541175.740375:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1788541175.740534:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a683f37e800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788541175.740540:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6835182800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:2.0:1788541175.765964:0:15407:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:2.0:1788541175.765972:0:15407:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788541175.765977:0:15407:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788541175.765985:0:15407:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788541175.766156:0:15407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788541175.766165:0:15407:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:2.0:1788541175.766171:0:15407:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a6839117000 1 00000020:00000080:2.0:1788541175.766178:0:15407:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a72ab 00000020:00000080:2.0:1788541175.766186:0:15407:0:(genops.c:885:class_export_put()) final put ffff9a682b4e4000/lustre-MDT0001-osd_UUID 00000020:01000000:2.0:1788541175.766204:0:15407:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:2.0:1788541175.766209:0:15407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788541175.766214:0:15407:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788541175.766218:0:15407:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9a6831d419c0) has no exports 00000020:00000080:1.0:1788541175.767772:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a682ff98000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788541175.767787:0:8:0:(genops.c:885:class_export_put()) final put ffff9a6835181800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1788541175.767791:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6835181800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1788541175.767815:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1788541175.767909:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a682b4e4000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788541175.807582:0:15407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788541175.807598:0:15407:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1788541175.807604:0:15407:0:(genops.c:885:class_export_put()) final put ffff9a6839114000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788541175.807609:0:15407:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6839114000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1788541175.807615:0:15407:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1788541175.807750:0:15407:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a6839110000 00000020:01000000:1.0:1788541175.807775:0:15407:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1788541175.807781:0:15407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788541175.807786:0:15407:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788541175.807790:0:15407:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9a682e748000) has no exports 00000100:00100000:2.0:1788541175.808008:0:6518:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9a6831cfbe00:6518] 1 exiting: rc = 0 00000100:00100000:3.0:1788541175.808985:0:12149:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9a67078f2e00:12149] 4 exiting: rc = 0 00000100:00100000:3.0:1788541175.809063:0:6519:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9a682e740a00:6519] 2 exiting: rc = 0 00000100:00100000:0.0:1788541175.813821:0:6517:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9a6831cfba00:6517] 0 exiting: rc = 1 00000100:00100000:0.0:1788541175.814150:0:9339:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9a6705af0a00:9339] 3 exiting: rc = 0 00000100:00100000:1.0:1788541175.814753:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.814762:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.814778:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.814784:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.814787:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.814791:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.814794:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.814798:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.814810:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.814814:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.814818:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.814822:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.814825:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.814829:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.814833:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.814837:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.814840:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.814844:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.814847:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.814852:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.814855:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.815003:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.815010:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.815014:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.815019:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.815034:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.815040:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.815047:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.815053:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.815058:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.815064:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.815069:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.815074:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.815079:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.815085:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.815091:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.815096:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.815102:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.815111:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.815117:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.815123:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.815130:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.815137:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.815142:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.815148:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.815153:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.815159:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.815164:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.815169:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.815173:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.815179:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.815184:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.815189:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.815194:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.815199:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.815204:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.815218:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.815224:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.815230:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.815236:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.815242:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.815248:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.815256:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.815262:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541175.818747:0:14972:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff9a68103ab400:14972] 2 exiting: rc = 0 00000100:00100000:2.0:1788541175.818918:0:6520:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9a6802db8800:6520] 0 exiting: rc = 1 00000100:00100000:3.0:1788541175.819211:0:6521:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9a6809c2e600:6521] 1 exiting: rc = 0 00000100:00100000:1.0:1788541175.819314:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819323:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819330:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819336:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819343:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819348:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819355:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819360:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819366:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819372:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819377:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819383:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819390:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819395:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819400:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819406:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819421:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819428:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819433:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819438:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819443:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819448:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819454:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819459:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819465:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819470:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819475:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819494:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819498:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819504:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819509:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819514:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819519:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819524:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819529:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819534:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819541:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819546:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819551:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819556:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819563:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819569:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819575:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819581:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819587:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819591:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819596:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819601:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819606:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819611:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819616:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819622:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819628:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819632:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819638:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819643:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819648:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819653:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819658:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819663:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819668:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819673:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819685:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.819691:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.820181:0:10866:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9a67075a1200:10866] 2 exiting: rc = 0 00000100:00100000:1.0:1788541175.820262:0:6523:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9a682e733600:6523] 1 exiting: rc = 0 00000100:00100000:3.0:1788541175.820547:0:6522:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9a682e733c00:6522] 0 exiting: rc = 1 00000100:00100000:1.0:1788541175.820641:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.820648:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.820656:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.820661:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.820667:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.820673:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.820679:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.820685:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.820691:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.820696:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.820702:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.820708:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.820713:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.820719:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.820739:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.820745:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.820751:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.820757:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.820820:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.820828:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.820833:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.820839:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.820845:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.820851:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.820857:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.820861:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.820950:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.820958:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.820964:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.820970:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.820976:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.820993:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.820999:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.821005:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.821011:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.821016:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.821021:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.821027:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.821046:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.821052:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.821058:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.821064:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.821070:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.821075:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.821081:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.821099:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.821105:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.821110:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.821116:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.821121:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.821140:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.821147:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.821153:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.821158:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.821164:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.821170:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.821176:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.821182:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.821188:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.821193:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.821199:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.821205:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.821210:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.821216:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541175.832548:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9a6831d3e800:6524] 0 exiting: rc = 1 00000100:00100000:3.0:1788541175.832668:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9a6831d3f600:6525] 1 exiting: rc = 0 00000100:00100000:1.0:1788541175.832760:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.832834:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.832850:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.832855:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.832860:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.832866:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.832989:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.832994:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.832999:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833004:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833009:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833014:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833019:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833024:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833029:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833036:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833041:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833045:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833050:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833055:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833060:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833065:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833069:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833074:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833079:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833083:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833088:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833092:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833097:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833102:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833108:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833113:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833118:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833122:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833127:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833132:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833137:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833149:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833154:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833159:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833164:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833168:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833173:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833177:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833183:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833187:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833192:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833197:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833202:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833207:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833212:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833217:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833222:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833228:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833232:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833237:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833242:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833246:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833251:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833257:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833262:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833266:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833270:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.833275:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541175.834478:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9a6831d3fc00:6526] 0 exiting: rc = 1 00000100:00100000:3.0:1788541175.834594:0:6527:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9a6831d3f400:6527] 1 exiting: rc = 0 00000100:00100000:1.0:1788541175.835247:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835254:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835260:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835267:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835272:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835277:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835283:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835288:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835306:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835311:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835317:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835323:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835327:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835332:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835337:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835341:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835346:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835350:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835355:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835360:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835366:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835371:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835376:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835381:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835387:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835392:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835397:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835402:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835407:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835476:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835482:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835486:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835492:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835497:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835502:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835507:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835512:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835516:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835521:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835526:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835531:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835535:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835539:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835550:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835555:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835560:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835565:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835571:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835576:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835580:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835585:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835590:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835594:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835599:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835605:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835609:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835613:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835618:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835623:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835628:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835632:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835637:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835642:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.835647:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541175.836525:0:6528:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9a6831d3f800:6528] 0 exiting: rc = 1 00000100:00100000:2.0:1788541175.836645:0:6529:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9a6808966c00:6529] 1 exiting: rc = 0 00000100:00100000:1.0:1788541175.836738:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.836745:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.836750:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.836756:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.836761:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.836773:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.836779:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.836784:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.836789:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.836794:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.836800:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.836805:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.836809:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.836814:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.836828:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.836833:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.836837:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.836843:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.836848:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.836853:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.836858:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.836863:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.836893:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.836901:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.836906:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.836911:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.836917:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.836922:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.836926:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.836931:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.836935:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.836940:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.836955:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.836961:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.836966:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.836971:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.836977:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.836983:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.836988:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.836993:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.836998:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.837003:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.837009:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.837013:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.837019:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.837024:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.837029:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.837034:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.837039:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.837051:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.837057:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.837062:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.837067:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.837072:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.837077:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.837082:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.837087:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.837092:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.837097:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.837102:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.837107:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.837112:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.837116:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.837121:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541175.837938:0:6530:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9a682e764c00:6530] 0 exiting: rc = 1 00000100:00100000:2.0:1788541175.838219:0:6531:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9a682e765800:6531] 1 exiting: rc = 0 00000100:00100000:0.0:1788541175.838516:0:6532:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9a682e765e00:6532] 2 exiting: rc = 0 00000100:00100000:1.0:1788541175.838759:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.838776:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.838783:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.838788:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.838801:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.838808:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.838814:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.838821:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.838826:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.838832:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.838838:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.838844:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.838850:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.838885:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.838894:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.838899:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.838904:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.838910:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.838916:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.838921:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.838936:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.838950:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.838956:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.838962:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.838967:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.838973:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.838978:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.838982:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.838988:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.838995:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.839000:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.839005:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.839011:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.839016:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.839022:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.839028:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.839034:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.839053:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.839061:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.839066:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.839071:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.839081:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.839087:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.839095:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.839100:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.839113:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.839125:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.839136:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.839145:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.839154:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.839166:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.839173:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.839178:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.839190:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.839204:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.839221:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.839232:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.839243:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.839252:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.839261:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.839272:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.839277:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.839282:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788541175.839293:0:15407:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788541175.845254:0:15407:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788541175.845267:0:15407:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1788541175.845272:0:15407:0:(genops.c:885:class_export_put()) final put ffff9a682e801800/MDS_uuid 00000020:00000080:1.0:1788541175.845277:0:15407:0:(genops.c:844:class_export_destroy()) destroying export ffff9a682e801800/MDS_uuid for MDS 00000020:01000000:1.0:1788541175.845283:0:15407:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1788541175.845903:0:15407:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:3.0:1788541176.394204:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541177.424094:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541178.442000:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788541179.338986:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 425687b6-1d99-41d2-88d8-2fb230997596->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788541179.338998:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 425687b6-1d99-41d2-88d8-2fb230997596->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788541179.339001:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788541179.339004:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788541179.339008:0:8:0:(import.c:65:import_set_state_nolock()) ffff9a6705afc800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788541179.339018:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 455 00000100:00080000:0.0:1788541179.339024:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788541179.339031:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a6705afc800 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:0.0:1788541179.339067:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a670831df80 x1875420981140992/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788541179.339110:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788541179.339114:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788541179.339115:0:8:0:(import.c:65:import_set_state_nolock()) ffff9a6705ae9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788541179.339118:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 455 00000100:00080000:0.0:1788541179.339120:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788541179.339124:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a6705ae9800 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:0.0:1788541179.339132:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a670831ce00 x1875420981141248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788541179.339169:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875420981140992:0@lo:38:kworker.0 00000400:00000100:0.0:1788541179.339232:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875420981140992 offset 0 length 520: 4 00000100:00100000:0.0:1788541179.339278:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875420981141248:0@lo:38:kworker.0 00000400:00000100:0.0:1788541179.339293:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875420981141248 offset 0 length 520: 4 00000100:00100000:0.0:1788541179.339322:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875420981141120:0@lo:400:kworker.0 00000400:00000100:0.0:1788541179.339337:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875420981141120 offset 0 length 224: 4 00000100:00100000:0.0:1788541179.339350:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788541179.339355:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875420981141376:0@lo:400:kworker.0 00000400:00000100:0.0:1788541179.339367:0:3643:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875420981141376 offset 0 length 224: 4 00010000:00010000:0.0:1788541179.466632:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788541179.916176:0:15608:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788541179.931333:0:15608:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788541179.931390:0:15608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551ae00/0x2aac941e5f4a76f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a76fd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541179.931405:0:15608:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551ae00/0x2aac941e5f4a76f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a76fd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541179.931412:0:15608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551ae00/0x2aac941e5f4a76f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a76fd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541179.931419:0:15608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.156@tcp lock: ffff9a683551ae00/0x2aac941e5f4a76f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a76fd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541179.931446:0:15608:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788541179.931459:0:15608:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788541179.931485:0:15608:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788541179.931495:0:15608:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a670831df80 x1875420981140992/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788541194 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541179.931520:0:15608:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788541179.931526:0:15608:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788541179.931532:0:15608:0:(import.c:65:import_set_state_nolock()) ffff9a6705afc800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788541179.931552:0:15608:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788541179.931557:0:15608:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a670831df80 x1875420981140992/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788541194 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541179.931564:0:15608:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788541179.931566:0:15608:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788541179.931667:0:15408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788541179.931675:0:15408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a683551ae00/0x2aac941e5f4a76f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a76fd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541179.931683:0:15408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551ae00 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:1.0:1788541179.931686:0:15408:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a683551ae00/0x2aac941e5f4a76f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a76fd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541179.931694:0:15408:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a683551ae00/0x2aac941e5f4a76f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x2aac941e5f4a76fd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788541179.931703:0:15408:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a683551ae00/0x2aac941e5f4a76f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x2aac941e5f4a76fd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788541179.931709:0:15408:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788541179.931712:0:15408:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788541179.931714:0:15408:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788541179.931738:0:15408:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a682e801000 00010000:00010000:1.0:1788541179.931750:0:15408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a683551ae00/0x2aac941e5f4a76f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x2aac941e5f4a76fd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541179.931758:0:15408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a683551ae00/0x2aac941e5f4a76f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x2aac941e5f4a76fd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541179.931769:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541179.931771:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541179.931772:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541179.931980:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875420981140992:0@lo:38:kworker.0 00000100:00080000:3.0:1788541179.932846:0:15608:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788541179.932855:0:15608:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a670831f800 x1875420981141120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541195 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541179.932920:0:15608:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788541179.932925:0:15608:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788541179.932947:0:15608:0:(import.c:65:import_set_state_nolock()) ffff9a6705afd800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788541179.933216:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875420981141120:0@lo:400:kworker.0 00000100:00100000:2.0:1788541179.933644:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875420981141504:0@lo:39:umount.0 00000400:00000100:2.0:1788541179.933708:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875420981141504 offset 0 length 224: 4 00000100:00080000:2.0:1788541180.363851:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 425687b6-1d99-41d2-88d8-2fb230997596->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788541180.363861:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 425687b6-1d99-41d2-88d8-2fb230997596->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788541180.363864:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788541180.363881:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788541180.364028:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875420981141632:0@lo:400:kworker.0 00000400:00000100:0.0:1788541180.364086:0:3641:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875420981141632 offset 0 length 224: 4 00010000:00010000:0.0:1788541180.495930:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788541180.885840:0:9510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788541180.885852:0:9510:0:(genops.c:885:class_export_put()) final put ffff9a67078de000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788541180.886145:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9a67078de000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788541180.886197:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a67078db800 for lustre-OST0001 00000001:00100000:0.0:1788541180.886976:0:8426:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788541180.886980:0:8426:0:(genops.c:885:class_export_put()) final put ffff9a683f352800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788541180.887077:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a683f352800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788541180.887110:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a683f355000 for lustre-OST0000 00010000:00010000:3.0:1788541181.515230:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541182.540437:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541183.563075:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788541184.394044:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 425687b6-1d99-41d2-88d8-2fb230997596->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788541184.394055:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 425687b6-1d99-41d2-88d8-2fb230997596->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788541184.394059:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788541184.394064:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788541184.394253:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875420981141760:0@lo:400:kworker.0 00000400:00000100:3.0:1788541184.394319:0:3642:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875420981141760 offset 0 length 224: 4 00010000:00010000:0.0:1788541184.586909:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541185.034673:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788541175/real 1788541175] req@ffff9a67080d5500 x1875420981140864/t0(0) o250->MGC192.168.202.156@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788541185 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541185.034709:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a67080d5500 x1875420981140864/t0(0) o250->MGC192.168.202.156@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788541185 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788541185.034731:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a682e801000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788541185.034777:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788541185.034781:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:425687b6-1d99-41d2-88d8-2fb230997596:3640:1875420981140864:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:0.0:1788541185.035113:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 425687b6-1d99-41d2-88d8-2fb230997596->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788541185.035118:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788541185.035121:0:38:0:(import.c:65:import_set_state_nolock()) ffff9a682e801000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788541185.035132:0:38:0:(import.c:545:import_select_connection()) MGC192.168.202.156@tcp: connect to NID 0@lo last attempt 456 00000100:00080000:0.0:1788541185.035147:0:38:0:(import.c:630:import_select_connection()) MGC192.168.202.156@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788541185.035154:0:38:0:(import.c:665:import_select_connection()) MGC192.168.202.156@tcp: import ffff9a682e801000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:0.0:1788541185.035183:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a670831dc00 x1875420981141888/t0(0) o250->MGC192.168.202.156@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788541185.035215:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788541185.035220:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788541185.035446:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:425687b6-1d99-41d2-88d8-2fb230997596:3640:1875420981141888:0@lo:250:kworker.0 00000400:00000100:2.0:1788541185.035494:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875420981141888 offset 0 length 520: 4 00010000:00010000:3.0:1788541185.611028:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541186.634342:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541187.658082:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541188.687855:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541189.130433:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788541179/real 1788541179] req@ffff9a6706833100 x1875420981141504/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788541189 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541189.130464:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a6706833100 x1875420981141504/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788541189 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788541189.130483:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a6705afd800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788541189.130506:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875420981141504:0@lo:39:umount.0 00000100:00080000:3.0:1788541189.131977:0:15608:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788541189.131983:0:15608:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788541189.131998:0:15608:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788541189.133037:0:15608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6812045600/0x2aac941e5f4a7704 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a770b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541189.133053:0:15608:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6812045600/0x2aac941e5f4a7704 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a770b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541189.133079:0:15608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6812045600/0x2aac941e5f4a7704 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a770b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541189.133086:0:15608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.156@tcp lock: ffff9a6812045600/0x2aac941e5f4a7704 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a770b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541189.133124:0:15608:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788541189.133133:0:15608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a797a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7981 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541189.133140:0:15608:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a797a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a7981 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541189.133146:0:15608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a797a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a7981 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541189.133152:0:15608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a797a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a7981 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541189.133171:0:15608:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788541189.133175:0:15608:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1788541189.133199:0:15608:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1788541189.133203:0:15608:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1788541189.133207:0:15608:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788541189.133212:0:15608:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788541189.133216:0:15608:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9a6835580000) has no exports 00000020:00080000:3.0:1788541189.133238:0:15608:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9a6835580000) has no exports 00010000:00010000:1.0:1788541189.133465:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788541189.133472:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a6812045600/0x2aac941e5f4a7704 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a770b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541189.133480:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6812045600 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:1.0:1788541189.133484:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a6812045600/0x2aac941e5f4a7704 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a770b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541189.133493:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a6812045600/0x2aac941e5f4a7704 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x2aac941e5f4a770b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788541189.133500:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a6812045600/0x2aac941e5f4a7704 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x2aac941e5f4a770b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788541189.133506:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788541189.133508:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1788541189.133511:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1788541189.133535:0:6505:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a682e801000 00010000:00010000:1.0:1788541189.133546:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a6812045600/0x2aac941e5f4a7704 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x2aac941e5f4a770b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541189.133553:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a6812045600/0x2aac941e5f4a7704 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x2aac941e5f4a770b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541189.133567:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788541189.133571:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a797a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a7981 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541189.133577:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75e200 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:1.0:1788541189.133581:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a797a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a7981 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541189.133588:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a797a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2aac941e5f4a7981 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788541189.133594:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a797a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2aac941e5f4a7981 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788541189.133599:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788541189.133601:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788541189.133603:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788541189.133609:0:6505:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a682e801000 00010000:00010000:1.0:1788541189.133612:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a797a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2aac941e5f4a7981 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541189.133618:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a797a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2aac941e5f4a7981 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541189.133626:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541189.133634:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541189.133636:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541189.133786:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788541189.142562:0:15608:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a67074ea1e0 - data ffff9a6705ca5bd0/ffff9a67075d1400 00000020:01000000:3.0:1788541189.142730:0:15608:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a6701093840 - data ffff9a6839e75d80/ffff9a6701941400 00100000:10000000:3.0:1788541189.151703:0:15608:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788541189.170756:0:15608:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a7448 00000020:00000080:1.0:1788541189.170767:0:15608:0:(genops.c:885:class_export_put()) final put ffff9a6705afa000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1788541189.170786:0:15608:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a683533b800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1788541189.170790:0:15608:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a683533b800 2 00000020:01000004:1.0:1788541189.170793:0:15608:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a683533b800 from lustre-OST0000 00000020:00000080:1.0:1788541189.170815:0:15608:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788541189.170831:0:15608:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1788541189.170834:0:15608:0:(genops.c:885:class_export_put()) final put ffff9a6705afe800/lustre-OST0000_UUID 00000020:00000080:1.0:1788541189.170837:0:15608:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6705afe800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1788541189.170843:0:15608:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:00000080:3.0:1788541189.171578:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6705afa000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:1.0:1788541189.172535:0:15608:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1788541189.172541:0:15608:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788541189.172547:0:15608:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788541189.172554:0:15608:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788541189.172560:0:15608:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9a6835522000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788541189.172567:0:15608:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9a6835584d40) has exports, disconnecting them 00000020:00080000:1.0:1788541189.172665:0:15608:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9a6835522000), last request at 1788540941 00000020:00000080:1.0:1788541189.172669:0:15608:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a7472 00000020:00080000:1.0:1788541189.172683:0:15608:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a6835522000): rc 0 00000020:00000080:1.0:1788541189.172688:0:15608:0:(genops.c:885:class_export_put()) final put ffff9a6835522000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788541189.172829:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6835522000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788541189.184987:0:15608:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788541189.184995:0:15608:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788541189.185056:0:15608:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788541189.185064:0:15608:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788541189.185437:0:15608:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788541189.185446:0:15608:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1788541189.185452:0:15608:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788541189.185455:0:15608:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788541189.185459:0:15608:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788541189.185466:0:15608:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9a6835525800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788541189.185472:0:15608:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff9a68355819c0) has exports, disconnecting them 00000020:00080000:2.0:1788541189.185476:0:15608:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9a6835525800), last request at 1788540941 00000020:00000080:2.0:1788541189.185480:0:15608:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a7487 00000020:00080000:2.0:1788541189.185494:0:15608:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a6835525800): rc 0 00000020:00000080:2.0:1788541189.185500:0:15608:0:(genops.c:885:class_export_put()) final put ffff9a6835525800/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788541189.185613:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a6705afc800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788541189.185620:0:38:0:(genops.c:885:class_export_put()) final put ffff9a6705af8000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788541189.185623:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6705af8000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788541189.185629:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788541189.187026:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6835525800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1788541189.189042:0:15608:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788541189.189062:0:15608:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788541189.189067:0:15608:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788541189.189074:0:15608:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788541189.189110:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a6705afd800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788541189.189288:0:15608:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788541189.189309:0:15608:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1788541189.189314:0:15608:0:(genops.c:885:class_export_put()) final put ffff9a6835522800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1788541189.189318:0:15608:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6835522800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1788541189.189324:0:15608:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1788541189.189386:0:15608:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a683533b800 1 00000020:00000080:3.0:1788541189.189392:0:15608:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a7410 00000020:00000080:3.0:1788541189.189398:0:15608:0:(genops.c:885:class_export_put()) final put ffff9a683f350800/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1788541189.189406:0:15608:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1788541189.189414:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a683f350800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788541189.189423:0:15608:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788541189.189427:0:15608:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788541189.189431:0:15608:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9a6835583380) has no exports 00000020:00000080:2.0:1788541189.271071:0:15608:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788541189.271087:0:15608:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1788541189.271093:0:15608:0:(genops.c:885:class_export_put()) final put ffff9a683533e000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788541189.271098:0:15608:0:(genops.c:844:class_export_destroy()) destroying export ffff9a683533e000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1788541189.271110:0:15608:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1788541189.271242:0:15608:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a683533c800 00000020:02000400:2.0:1788541189.271285:0:15608:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1788541189.708558:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788541190.093538:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 425687b6-1d99-41d2-88d8-2fb230997596->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788541190.093549:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 425687b6-1d99-41d2-88d8-2fb230997596->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788541190.093552:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788541190.093556:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788541190.094191:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788541190.094212:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875420981142016:0@lo:400:kworker.0 00000400:00000100:2.0:1788541190.094265:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875420981142016 offset 0 length 224: 4 00010000:00010000:2.0:1788541190.731119:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541191.754836:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541192.779710:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788541193.532272:0:15811:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788541193.546270:0:15811:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788541193.546423:0:15811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551a400/0x2aac941e5f4a76da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a76e1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541193.546454:0:15811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551a400/0x2aac941e5f4a76da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a76e1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541193.546463:0:15811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551a400/0x2aac941e5f4a76da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a76e1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541193.546471:0:15811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.156@tcp lock: ffff9a683551a400/0x2aac941e5f4a76da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a76e1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541193.546494:0:15811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788541193.546501:0:15811:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788541193.546527:0:15811:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788541193.546538:0:15811:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a670831ce00 x1875420981141248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788541194 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541193.546597:0:15811:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788541193.546614:0:15811:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788541193.546622:0:15811:0:(import.c:65:import_set_state_nolock()) ffff9a6705ae9800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788541193.546629:0:15811:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788541193.546634:0:15811:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a670831ce00 x1875420981141248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788541194 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788541193.546679:0:15408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788541193.546688:0:15408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a683551a400/0x2aac941e5f4a76da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a76e1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541193.546695:0:15408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551a400 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:1.0:1788541193.546699:0:15408:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a683551a400/0x2aac941e5f4a76da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a76e1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541193.546714:0:15408:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a683551a400/0x2aac941e5f4a76da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2aac941e5f4a76e1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788541193.546721:0:15408:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a683551a400/0x2aac941e5f4a76da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2aac941e5f4a76e1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788541193.546727:0:15408:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788541193.546729:0:15408:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788541193.546731:0:15408:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788541193.546745:0:15408:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a682e801000 00010000:00010000:1.0:1788541193.546749:0:15408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a683551a400/0x2aac941e5f4a76da lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2aac941e5f4a76e1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541193.546754:0:15408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a683551a400/0x2aac941e5f4a76da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2aac941e5f4a76e1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541193.546764:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541193.546766:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541193.546767:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541193.554737:0:15811:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788541193.557238:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875420981141248:0@lo:38:kworker.0 00000100:00100000:3.0:1788541193.560053:0:15811:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788541193.566270:0:15811:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788541193.566289:0:15811:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a670831c000 x1875420981141376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541195 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541193.566420:0:15811:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a67080d4700 x1875420981141632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541196 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541193.566443:0:15811:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a670831e300 x1875420981141760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541200 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541193.566458:0:15811:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a67080d5500 x1875420981142016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541206 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541193.566470:0:15811:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788541193.566476:0:15811:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788541193.566500:0:15811:0:(import.c:65:import_set_state_nolock()) ffff9a6705aff000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788541193.566528:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875420981142144:0@lo:39:umount.0 00000400:00000100:0.0:1788541193.566578:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875420981142144 offset 0 length 224: 4 00000100:00100000:3.0:1788541193.566728:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3642:1875420981141760:0@lo:400:kworker.0 00000100:00100000:2.0:1788541193.567025:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875420981141632:0@lo:400:kworker.0 00000100:00100000:1.0:1788541193.567103:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875420981141376:0@lo:400:kworker.0 00000100:00100000:1.0:1788541193.567130:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875420981142016:0@lo:400:kworker.0 00010000:00010000:0.0:1788541193.802249:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541194.828908:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788541195.209997:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 425687b6-1d99-41d2-88d8-2fb230997596->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788541195.210008:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 425687b6-1d99-41d2-88d8-2fb230997596->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788541195.850024:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541196.876349:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541197.898175:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541198.923891:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541199.946023:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788541200.329972:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 425687b6-1d99-41d2-88d8-2fb230997596->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788541200.329990:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 425687b6-1d99-41d2-88d8-2fb230997596->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788541200.714353:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788541185/real 1788541185] req@ffff9a670831dc00 x1875420981141888/t0(0) o250->MGC192.168.202.156@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788541200 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541200.714403:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a670831dc00 x1875420981141888/t0(0) o250->MGC192.168.202.156@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788541200 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788541200.714445:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a682e801000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788541200.714475:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788541200.714481:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:425687b6-1d99-41d2-88d8-2fb230997596:3640:1875420981141888:0@lo:250:kworker.0 00000100:00080000:2.0:1788541200.714688:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 425687b6-1d99-41d2-88d8-2fb230997596->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788541200.714694:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788541200.714704:0:8:0:(import.c:65:import_set_state_nolock()) ffff9a682e801000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788541200.714710:0:8:0:(import.c:545:import_select_connection()) MGC192.168.202.156@tcp: connect to NID 0@lo last attempt 465 00000100:00080000:2.0:1788541200.714725:0:8:0:(import.c:630:import_select_connection()) MGC192.168.202.156@tcp: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788541200.714732:0:8:0:(import.c:665:import_select_connection()) MGC192.168.202.156@tcp: import ffff9a682e801000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:2.0:1788541200.714767:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a67080d4700 x1875420981142272/t0(0) o250->MGC192.168.202.156@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788541200.715281:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:425687b6-1d99-41d2-88d8-2fb230997596:3640:1875420981142272:0@lo:250:kworker.0 00000400:00000100:1.0:1788541200.715346:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875420981142272 offset 0 length 520: 4 00010000:00010000:1.0:1788541200.971603:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541202.001413:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541203.020139:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541203.793300:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788541193/real 1788541193] req@ffff9a670831ce00 x1875420981142144/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788541203 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541203.793358:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a670831ce00 x1875420981142144/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788541203 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788541203.793388:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a6705aff000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788541203.793413:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875420981142144:0@lo:39:umount.0 00000100:00080000:0.0:1788541203.793511:0:15811:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788541203.793517:0:15811:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788541203.793522:0:15811:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788541203.794464:0:15811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75e400/0x2aac941e5f4a76e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a76ef expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.794477:0:15811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75e400/0x2aac941e5f4a76e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a76ef expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.794483:0:15811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75e400/0x2aac941e5f4a76e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a76ef expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.794490:0:15811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.156@tcp lock: ffff9a682e75e400/0x2aac941e5f4a76e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a76ef expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.794516:0:15811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788541203.794522:0:15811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551a600/0x2aac941e5f4a796c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a7973 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.794529:0:15811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551a600/0x2aac941e5f4a796c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a7973 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.794534:0:15811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551a600/0x2aac941e5f4a796c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a7973 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.794540:0:15811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.156@tcp lock: ffff9a683551a600/0x2aac941e5f4a796c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2aac941e5f4a7973 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.794576:0:15811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788541203.794582:0:15811:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1788541203.794604:0:15811:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1788541203.794608:0:15811:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1788541203.794612:0:15811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788541203.794617:0:15811:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788541203.794621:0:15811:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9a683f3699c0) has no exports 00000020:00080000:0.0:1788541203.794645:0:15811:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9a683f3699c0) has no exports 00000020:01000000:0.0:1788541203.796344:0:15811:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a683f3001e0 - data ffff9a6705ce2d80/ffff9a6707977c00 00000020:01000000:0.0:1788541203.796466:0:15811:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9a6707801840 - data ffff9a6839eae510/ffff9a6706a33800 00010000:00010000:2.0:1788541203.796832:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788541203.796841:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a682e75e400/0x2aac941e5f4a76e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a76ef expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.796851:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75e400 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:2.0:1788541203.796856:0:8446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a682e75e400/0x2aac941e5f4a76e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a76ef expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.796867:0:8446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a682e75e400/0x2aac941e5f4a76e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2aac941e5f4a76ef expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788541203.796914:0:8446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a682e75e400/0x2aac941e5f4a76e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2aac941e5f4a76ef expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788541203.796920:0:8446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788541203.796923:0:8446:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1788541203.796926:0:8446:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1788541203.796942:0:8446:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a682e801000 00010000:00010000:2.0:1788541203.796957:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a682e75e400/0x2aac941e5f4a76e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2aac941e5f4a76ef expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.796964:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a682e75e400/0x2aac941e5f4a76e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2aac941e5f4a76ef expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.796992:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541203.796996:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a683551a600/0x2aac941e5f4a796c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a7973 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.797001:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551a600 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:2.0:1788541203.797005:0:8446:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a683551a600/0x2aac941e5f4a796c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2aac941e5f4a7973 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.797011:0:8446:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a683551a600/0x2aac941e5f4a796c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2aac941e5f4a7973 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788541203.797017:0:8446:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a683551a600/0x2aac941e5f4a796c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2aac941e5f4a7973 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788541203.797022:0:8446:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788541203.797024:0:8446:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788541203.797026:0:8446:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788541203.797032:0:8446:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a682e801000 00010000:00010000:2.0:1788541203.797035:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a683551a600/0x2aac941e5f4a796c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x2aac941e5f4a7973 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.797041:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a683551a600/0x2aac941e5f4a796c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x2aac941e5f4a7973 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541203.797051:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541203.797053:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541203.797055:0:8446:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541203.797540:0:15408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1788541203.819298:0:15811:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788541203.828453:0:15811:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a756e 00000020:00000080:0.0:1788541203.828466:0:15811:0:(genops.c:885:class_export_put()) final put ffff9a68379b2000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1788541203.829796:0:15811:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a67067e3800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1788541203.829803:0:15811:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a67067e3800 2 00000020:01000004:0.0:1788541203.829807:0:15811:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a67067e3800 from lustre-OST0001 00000020:00000080:0.0:1788541203.829836:0:15811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788541203.829845:0:15811:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788541203.829849:0:15811:0:(genops.c:885:class_export_put()) final put ffff9a68379b6800/lustre-OST0001_UUID 00000020:00000080:0.0:1788541203.829853:0:15811:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68379b6800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1788541203.829862:0:15811:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1788541203.829990:0:15811:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 425687b6-1d99-41d2-88d8-2fb230997596->MGS 00010000:00010000:0.0:1788541203.830006:0:15811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a6842173c00/0x2aac941e5f4a72c7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2aac941e5f4a72ce expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788541203.830020:0:15811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a6842173c00/0x2aac941e5f4a72c7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2aac941e5f4a72ce expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788541203.830027:0:15811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1788541203.830039:0:15811:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1788541203.830042:0:15811:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1788541203.830059:0:15811:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a682e801000 00010000:00010000:0.0:1788541203.830063:0:15811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a6842173c00/0x2aac941e5f4a72c7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2aac941e5f4a72ce expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541203.830082:0:15811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a6842173400/0x2aac941e5f4a774a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2aac941e5f4a7751 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788541203.830088:0:15811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a6842173400/0x2aac941e5f4a774a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2aac941e5f4a7751 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788541203.830094:0:15811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788541203.830096:0:15811:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1788541203.830097:0:15811:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788541203.830106:0:15811:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a682e801000 00010000:00010000:0.0:1788541203.830108:0:15811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a6842173400/0x2aac941e5f4a774a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2aac941e5f4a7751 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788541203.830123:0:15811:0:(import.c:65:import_set_state_nolock()) ffff9a682e801000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1788541203.830127:0:15811:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788541203.830130:0:15811:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788541203.830131:0:15811:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788541203.830135:0:15811:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788541203.830145:0:15811:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a67080d4700 x1875420981142272/t0(0) o250->MGC192.168.202.156@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788541220 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788541203.830167:0:15811:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788541203.830170:0:15811:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00000100:00100000:2.0:1788541203.830382:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:425687b6-1d99-41d2-88d8-2fb230997596:3640:1875420981142272:0@lo:250:kworker.0 10000000:01000000:0.0:1788541203.830728:0:15811:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788541203.830736:0:15811:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a71c4 00000020:00000080:0.0:1788541203.830743:0:15811:0:(genops.c:885:class_export_put()) final put ffff9a682e802000/425687b6-1d99-41d2-88d8-2fb230997596 00000020:00000080:3.0:1788541203.834030:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a68379b2000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788541203.834313:0:15811:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.156@tcp (flags='') 00000020:00000080:0.0:1788541203.834337:0:15811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788541203.834345:0:15811:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.156@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788541203.834350:0:15811:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9a682e74b380) has no exports 10000000:01000000:2.0:1788541203.834423:0:6514:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:3.0:1788541203.834533:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a682e802000/425687b6-1d99-41d2-88d8-2fb230997596 for MGC192.168.202.156@tcp 10000000:01000000:0.0:1788541203.834971:0:15811:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.156@tcp: client import never connected 00000100:00080000:0.0:1788541203.834976:0:15811:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1788541203.834979:0:15811:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788541203.834983:0:15811:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1788541203.834986:0:15811:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788541203.835032:0:15811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788541203.835039:0:15811:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.156@tcp (uuid 425687b6-1d99-41d2-88d8-2fb230997596) 00000020:01000000:0.0:1788541203.835046:0:15811:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788541203.835050:0:15811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788541203.835053:0:15811:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788541203.835059:0:15811:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9a683f194800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788541203.835064:0:15811:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff9a6835310000) has exports, disconnecting them 00000020:00080000:0.0:1788541203.835068:0:15811:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9a683f194800), last request at 1788540966 00000020:00000080:0.0:1788541203.835072:0:15811:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a7598 00000020:00080000:0.0:1788541203.835097:0:15811:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a683f194800): rc 0 00000020:00000080:0.0:1788541203.835101:0:15811:0:(genops.c:885:class_export_put()) final put ffff9a683f194800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788541203.837136:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a682e801000 for MGC192.168.202.156@tcp 00000020:00000080:3.0:1788541203.837164:0:38:0:(genops.c:885:class_export_put()) final put ffff9a682e806800/425687b6-1d99-41d2-88d8-2fb230997596 00000020:00000080:3.0:1788541203.837168:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a682e806800/425687b6-1d99-41d2-88d8-2fb230997596 for MGC192.168.202.156@tcp 00000020:01000000:3.0:1788541203.837175:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.156@tcp (425687b6-1d99-41d2-88d8-2fb230997596) 00000020:00000080:3.0:1788541203.837479:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a683f194800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788541203.843795:0:15811:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788541203.843807:0:15811:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788541203.843811:0:15811:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788541203.843820:0:15811:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788541203.844075:0:15811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788541203.844084:0:15811:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1788541203.844091:0:15811:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788541203.844098:0:15811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788541203.844103:0:15811:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788541203.844110:0:15811:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9a6705af8800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788541203.844117:0:15811:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff9a6706958000) has exports, disconnecting them 00000020:00080000:2.0:1788541203.844122:0:15811:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9a6705af8800), last request at 1788540966 00000020:00000080:2.0:1788541203.844126:0:15811:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a75ad 00000020:00080000:2.0:1788541203.844140:0:15811:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a6705af8800): rc 0 00000020:00000080:2.0:1788541203.844144:0:15811:0:(genops.c:885:class_export_put()) final put ffff9a6705af8800/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1788541203.845053:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a6705ae9800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788541203.845061:0:38:0:(genops.c:885:class_export_put()) final put ffff9a683f197800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788541203.845064:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a683f197800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788541203.845071:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788541203.845132:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6705af8800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1788541203.846975:0:15811:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788541203.846983:0:15811:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788541203.846987:0:15811:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788541203.846993:0:15811:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788541203.847026:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9a6705aff000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:0.0:1788541203.847380:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1788541203.930575:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1788541203.950938:0:8446:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:1.0:1788541203.952348:0:15408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:3.0:1788541203.952662:0:6500:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9a6814d54600:6500] 0 exiting: rc = 1 00000100:00100000:1.0:1788541203.955984:0:6501:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9a680cee0e00:6501] 1 exiting: rc = 0 00000100:00100000:3.0:1788541203.956194:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.956456:0:6502:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9a680cee0000:6502] 0 exiting: rc = 1 00000100:00100000:0.0:1788541203.957944:0:6503:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9a680cee1000:6503] 1 exiting: rc = 0 00000100:00100000:1.0:1788541203.961469:0:9520:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9a6706a6b800:9520] 3 exiting: rc = 0 00000100:00100000:1.0:1788541203.963838:0:6504:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9a680cee1600:6504] 2 exiting: rc = 0 00000100:00100000:3.0:1788541203.965308:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965320:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965326:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965331:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965337:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965344:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965350:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965357:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965363:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965369:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965374:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965379:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965400:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965407:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965413:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965419:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965424:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965430:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965438:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965446:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965454:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965461:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965466:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965472:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965476:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965481:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965487:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965492:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965496:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965502:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965521:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965526:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965532:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965538:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965543:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965548:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965554:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965559:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965564:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965571:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965576:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965582:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965587:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965592:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965596:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965601:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965607:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965620:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965625:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965631:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965636:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965641:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965646:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965651:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965657:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965662:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965667:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965672:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965678:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965683:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965747:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965753:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965759:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541203.965764:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788541203.968178:0:15811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788541203.968191:0:15811:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1788541203.968198:0:15811:0:(genops.c:885:class_export_put()) final put ffff9a6705aff800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1788541203.968203:0:15811:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6705aff800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1788541203.968208:0:15811:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1788541203.968255:0:15811:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a67067e3800 1 00000020:00000080:3.0:1788541203.968262:0:15811:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2aac941e5f4a753d 00000020:00000080:3.0:1788541203.968268:0:15811:0:(genops.c:885:class_export_put()) final put ffff9a6835527800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788541203.968280:0:15811:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788541203.968291:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9a6835527800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788541203.968302:0:15811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788541203.968308:0:15811:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788541203.968311:0:15811:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff9a670695b380) has no exports 00000020:00000080:3.0:1788541204.101045:0:15811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788541204.101059:0:15811:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1788541204.101065:0:15811:0:(genops.c:885:class_export_put()) final put ffff9a67067e2800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788541204.101079:0:15811:0:(genops.c:844:class_export_destroy()) destroying export ffff9a67067e2800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788541204.101086:0:15811:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1788541204.101416:0:15811:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a67067e1800 00000020:01000000:3.0:1788541204.101450:0:15811:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1788541204.101454:0:15811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788541204.101458:0:15811:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788541204.101462:0:15811:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9a682fe08000) has no exports 00000020:00000080:3.0:1788541204.101488:0:15811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788541204.101495:0:15811:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1788541204.101498:0:15811:0:(genops.c:885:class_export_put()) final put ffff9a683f351800/OSS_uuid 00000020:00000080:3.0:1788541204.101500:0:15811:0:(genops.c:844:class_export_destroy()) destroying export ffff9a683f351800/OSS_uuid for OSS 00000020:01000000:3.0:1788541204.101503:0:15811:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1788541204.105883:0:6513:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1788541204.106229:0:8432:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9a682e7fea00:8432] 2 exiting: rc = 0 00000100:00100000:3.0:1788541204.106353:0:8431:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9a68350fea00:8431] 1 exiting: rc = 0 00000100:00100000:0.0:1788541204.106959:0:8430:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9a682fee0a00:8430] 0 exiting: rc = 1 00000100:00100000:2.0:1788541204.107080:0:8973:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9a682e765200:8973] 3 exiting: rc = 0 00000100:00100000:3.0:1788541204.107194:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107204:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107211:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107222:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107229:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107234:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107238:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107243:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107248:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107253:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107257:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107262:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107266:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107272:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107276:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107281:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107286:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107291:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107313:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107320:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107325:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107345:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107351:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107356:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107362:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107367:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107372:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107377:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107382:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107387:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107392:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107396:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107402:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107407:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107413:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107418:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107423:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107428:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107433:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107438:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107443:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107448:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107453:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107459:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107464:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107470:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107476:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107481:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107486:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107491:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107497:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107503:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107575:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107584:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107589:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107594:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107606:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107612:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107616:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107621:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107626:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107631:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107637:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788541204.107642:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541204.112026:0:8434:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9a68350ff000:8434] 1 exiting: rc = 0 00000100:00100000:0.0:1788541204.112155:0:14072:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9a6815a3ca00:14072] 2 exiting: rc = 0 00000100:00100000:3.0:1788541204.113982:0:8433:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9a68350fe800:8433] 0 exiting: rc = 1 00000100:00100000:2.0:1788541204.121222:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121240:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121250:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121255:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121261:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121266:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121272:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121278:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121283:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121289:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121294:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121299:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121304:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121309:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121327:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121332:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121337:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121342:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121347:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121353:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121358:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121363:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121367:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121372:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121377:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121381:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121386:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121392:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121397:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121402:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121407:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121412:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121418:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121423:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121429:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121433:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121438:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121443:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121448:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121452:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121457:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121462:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121466:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121471:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121475:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121479:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121484:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121489:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121493:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121504:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121523:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121528:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121534:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121539:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121544:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121549:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121554:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121558:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121563:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121568:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121572:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121577:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121581:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.121590:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.122486:0:8437:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9a683f331800:8437] 2 exiting: rc = 0 00000100:00100000:0.0:1788541204.122780:0:8435:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9a683f331600:8435] 0 exiting: rc = 1 00000100:00100000:0.0:1788541204.122962:0:8436:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9a683f331c00:8436] 1 exiting: rc = 0 00000100:00100000:2.0:1788541204.124332:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124342:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124347:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124354:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124360:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124366:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124381:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124388:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124394:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124399:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124406:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124411:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124418:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124423:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124429:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124435:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124440:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124446:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124451:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124470:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124475:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124480:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124485:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124500:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124506:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124524:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124529:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124534:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124540:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124546:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124552:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124558:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124564:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124569:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124575:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124581:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124587:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124593:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124599:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124604:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124610:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124615:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124620:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124626:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124631:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124636:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124641:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124660:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124667:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124673:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124677:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124682:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124700:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124706:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124719:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124725:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124732:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124738:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124745:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124750:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124756:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124761:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124766:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.124779:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.135951:0:8438:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9a6839103a00:8438] 0 exiting: rc = 1 00000100:00100000:0.0:1788541204.137701:0:8439:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9a6835103200:8439] 1 exiting: rc = 0 00000100:00100000:2.0:1788541204.137927:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.137936:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.137941:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.137946:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.137952:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.137957:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.137968:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.137975:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.137980:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.137986:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.137996:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138004:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138010:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138015:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138020:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138024:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138030:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138036:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138041:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138047:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138053:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138058:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138063:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138069:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138091:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138097:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138102:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138106:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138111:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138116:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138121:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138127:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138138:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138144:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138149:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138153:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138157:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138162:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138167:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138172:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138177:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138182:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138187:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138192:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138203:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138209:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138215:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138220:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138225:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138231:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138236:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138241:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138246:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138251:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138256:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138261:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138266:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138271:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138276:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138286:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138295:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138301:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138306:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.138311:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788541204.139630:0:8440:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9a682e732400:8440] 0 exiting: rc = 1 00000100:00100000:0.0:1788541204.139722:0:8441:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9a682e733400:8441] 1 exiting: rc = 0 00000100:00100000:2.0:1788541204.140070:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140079:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140090:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140097:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140103:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140108:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140114:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140135:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140142:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140148:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140154:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140160:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140166:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140173:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140178:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140184:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140190:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140197:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140204:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140224:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140232:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140238:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140246:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140252:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140258:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140265:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140270:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140276:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140282:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140287:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140300:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140319:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140327:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140333:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140340:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140346:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140353:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140359:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140365:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140372:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140378:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140384:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140390:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140410:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140417:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140422:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140428:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140434:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140440:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140446:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140452:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140458:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140463:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140469:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140475:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.140493:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.141615:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.141624:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.141631:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.141637:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.141643:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.141650:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.141657:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788541204.141674:0:15811:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1788541204.165141:0:15811:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788541229.341500:0:16576:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg256-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788541239.972062:0:17177:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788541239.972068:0:17177:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788541239.972070:0:17177:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788541239.972198:0:17177:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a67082f3800 00000020:01000004:3.0:1788541239.972217:0:17177:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788541239.972225:0:17177:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788541239.972246:0:17177:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9a682fe08000) 00000020:00000080:3.0:1788541239.972853:0:17177:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788541240.080999:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788541240.086739:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788541240.090586:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1788541240.091523:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1788541240.091837:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1788541240.092133:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788541240.092459:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1788541240.092726:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788541240.093163:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788541240.093533:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788541240.093784:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788541240.094053:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1788541240.094331:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788541240.094706:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1788541240.094999:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788541240.095349:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1788541240.095597:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788541240.095992:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788541240.096353:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788541240.096544:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788541240.097121:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1788541240.097589:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788541240.097844:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788541240.098445:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1788541240.098799:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1788541240.099333:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1788541240.099736:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788541240.100383:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788541240.100682:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788541240.101055:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788541240.101433:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788541240.101728:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1788541240.102682:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788541240.103391:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788541240.106431:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1788541240.106765:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788541240.107728:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1788541240.108054:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1788541240.110897:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1788541240.111399:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788541240.111803:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1788541240.112619:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788541240.112859:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788541240.113149:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1788541240.114149:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788541240.114672:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788541240.119521:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1788541240.122430:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1788541240.123373:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1788541240.124091:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1788541240.129034:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1788541240.130423:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1788541240.130743:0:17177:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:2.0:1788541240.131612:0:17177:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788541240.131829:0:17177:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788541240.131839:0:17177:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788541240.131851:0:17177:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2aac941e5f4a8781 00000020:01000004:2.0:1788541240.131857:0:17177:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1788541240.131862:0:17177:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788541240.131867:0:17177:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a67082f3800 from MGS 00000020:01000004:2.0:1788541240.133325:0:17177:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788541240.133342:0:17177:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9a6707914d40) 00000020:00000080:2.0:1788541240.133369:0:17177:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788541240.133442:0:17177:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a67082f3800 from MGS, refs=2 00080000:01000000:2.0:1788541240.133449:0:17177:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788541240.133455:0:17177:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2aac941e5f4a878f 00000100:00100000:2.0:1788541240.133587:0:17177:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788541240.133720:0:17177:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788541240.133726:0:17177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788541240.138824:0:17177:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788541240.138841:0:17177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788541240.140130:0:17177:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788541240.140679:0:17177:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788541240.140685:0:17177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788541240.149155:0:17177:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788541240.151128:0:17177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788541240.152147:0:17177:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788541240.152156:0:17177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788541240.155230:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541240.155237:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541240.155239:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541240.155743:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541240.155745:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541240.155753:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541240.156387:0:17177:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788541240.159015:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788541240.183480:0:17177:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1788541240.187396:0:17189:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788541240.187742:0:17177:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788541240.187805:0:17177:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788541240.192428:0:17177:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788541240.193656:0:17177:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788541240.193841:0:17177:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788541240.193848:0:17177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788541240.200647:0:17177:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788541240.200665:0:17177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788541240.203115:0:17177:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788541240.203130:0:17177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788541240.220968:0:17177:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788541240.220997:0:17177:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.156@tcp' 00000020:01000004:2.0:1788541240.221015:0:17177:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788541240.221049:0:17177:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.156@tcp (typ=mgc) 00000020:00000080:2.0:1788541240.221065:0:17177:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.156@tcp (ffff9a67079119c0) 00000020:00000080:2.0:1788541240.221081:0:17177:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788541240.221169:0:17177:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a67082db000@MGC192.168.202.156@tcp: add connection 192.168.202.156@tcp at head 00010000:00010000:2.0:1788541240.221582:0:17177:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.156@tcp-0 is initialized 00000040:01000000:2.0:1788541240.221590:0:17177:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.156@tcp ctxt 1 is initialized 00000100:00080000:0.0:1788541240.224013:0:17194:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1788541240.231726:0:17196:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788541240.231828:0:17177:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.156@tcp (uuid 4746c063-6c88-4476-b99b-02bb8e8d54f7) 00000020:00000080:3.0:1788541240.231853:0:17177:0:(genops.c:1385:class_connect()) connect: client 4746c063-6c88-4476-b99b-02bb8e8d54f7, cookie 0x2aac941e5f4a879d 00000100:00080000:3.0:1788541240.231865:0:17177:0:(import.c:545:import_select_connection()) MGC192.168.202.156@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788541240.231901:0:17177:0:(import.c:665:import_select_connection()) MGC192.168.202.156@tcp: import ffff9a67082db000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:3.0:1788541240.231935:0:17177:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6706831f80 x1875420981142400/t0(0) o250->MGC192.168.202.156@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788541240.231957:0:17177:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 4746c063-6c88-4476-b99b-02bb8e8d54f7->MGS 00000020:01000004:3.0:1788541240.231974:0:17177:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788541240.231979:0:17177:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788541240.231993:0:17177:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9a682fe0cd40) 00000020:00000080:3.0:1788541240.232005:0:17177:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788541240.232502:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4746c063-6c88-4476-b99b-02bb8e8d54f7:3640:1875420981142400:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788541240.232629:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541240.238562:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981142400 00000100:00100000:3.0:1788541240.238578:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981142400 00000100:00100000:3.0:1788541240.238622:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788541240.238630:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3640:x1875420981142400:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1788541240.238659:0:17191:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 4746c063-6c88-4476-b99b-02bb8e8d54f7@0@lo t0 exp 0000000000000000 cur 521 last 0 00000020:00000080:3.0:1788541240.238688:0:17191:0:(genops.c:1385:class_connect()) connect: client 4746c063-6c88-4476-b99b-02bb8e8d54f7, cookie 0x2aac941e5f4a87ab 00000100:00080000:3.0:1788541240.238826:0:17191:0:(import.c:65:import_set_state_nolock()) ffff9a6835526000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788541240.238931:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+5:3640:x1875420981142400:12345-0@lo:250:mount.lustre.0 Request processed in 300us (6302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541240.238939:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788541240.239060:0:3640:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.156@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788541240.239069:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.202.156@tcp: connect to target with instance 0 00000100:00080000:1.0:1788541240.239075:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.202.156@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788541240.239080:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788541240.239083:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a67082db000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788541240.239085:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788541240.239094:0:3640:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788541240.239099:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4746c063-6c88-4476-b99b-02bb8e8d54f7:3640:1875420981142400:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788541240.257777:0:17177:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788541240.259595:0:17177:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788541240.259605:0:17177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788541240.263530:0:17177:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788541240.263550:0:17177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788541240.265522:0:17177:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788541240.265535:0:17177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788541240.266809:0:17177:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788541240.273148:0:17177:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788541240.273158:0:17177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788541240.274295:0:17177:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788541240.274305:0:17177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788541240.340251:0:17177:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788541240.340926:0:17177:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788541240.340934:0:17177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788541240.342471:0:17177:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788541240.342481:0:17177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788541240.343115:0:17177:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788541240.343272:0:17177:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788541240.343278:0:17177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788541240.344397:0:17177:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788541240.344406:0:17177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788541240.347227:0:17177:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788541240.347656:0:17177:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788541240.347663:0:17177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788541240.348744:0:17177:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788541240.348753:0:17177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788541240.350015:0:17177:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788541240.350198:0:17177:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788541240.350204:0:17177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788541240.351165:0:17177:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788541240.351174:0:17177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788541240.375214:0:17177:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788541240.375580:0:17177:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788541240.375588:0:17177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788541240.377560:0:17177:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788541240.377573:0:17177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788541240.379230:0:17177:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788541240.379241:0:17177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788541240.380534:0:17177:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788541240.380565:0:17177:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1788541240.380573:0:17177:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.156@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788541240.380770:0:17177:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.156@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788541240.380810:0:17177:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.156@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788541240.380815:0:17177:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788541240.380816:0:17177:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788541240.380818:0:17177:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788541240.380819:0:17177:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788541240.380820:0:17177:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788541240.380822:0:17177:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788541240.380823:0:17177:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788541240.380824:0:17177:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788541240.380826:0:17177:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788541240.380828:0:17177:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788541240.380830:0:17177:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788541240.380833:0:17177:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788541240.380834:0:17177:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788541240.381118:0:17177:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788541240.381121:0:17177:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788541240.381122:0:17177:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788541240.381124:0:17177:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788541240.381125:0:17177:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788541240.381126:0:17177:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788541240.381127:0:17177:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788541240.381128:0:17177:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788541240.381157:0:17177:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788541240.381177:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17177:1875420981142528:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788541240.381251:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541240.381346:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68083db180 going to sleep for 11 seconds 00000100:00100000:3.0:1788541240.381567:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981142528 00000100:00100000:3.0:1788541240.381575:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981142528 00000100:00100000:3.0:1788541240.381660:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788541240.381670:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+5:17177:x1875420981142528:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788541240.381732:0:17193:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788541240.381735:0:17193:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788541240.381738:0:17193:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1788541240.382134:0:17214:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788541240.382907:0:17193:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:1.0:1788541240.385676:0:17215:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1788541240.385751:0:17215:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1788541240.385754:0:17215:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1788541240.385757:0:17215:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1788541240.386109:0:17215:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1788541240.386555:0:17193:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788541240.386566:0:17193:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788541240.388811:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+5:17177:x1875420981142528:12345-0@lo:253:mount.lustre.0 Request processed in 7134us (7552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541240.388830:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788541240.389067:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17177:1875420981142528:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788541240.389085:0:17177:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788541240.389088:0:17177:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788541240.389090:0:17177:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788541240.389091:0:17177:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788541240.389093:0:17177:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788541240.389094:0:17177:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788541240.389095:0:17177:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788541240.389096:0:17177:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788541240.389098:0:17177:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788541240.389100:0:17177:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788541240.389101:0:17177:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788541240.389120:0:17177:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a67082f3800 from lustre-MDT0000 10000000:01000000:3.0:1788541240.389171:0:17177:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788541240.389245:0:17177:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788541240.389250:0:17177:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9a67079119c0 10000000:01000000:3.0:1788541240.389256:0:17177:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788541240.389264:0:17177:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9a67079119c0 from 1 10000000:01000000:3.0:1788541240.389267:0:17177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788541240.389436:0:17177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a67075acc00/0x2aac941e5f4a87b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541240.389512:0:17177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a67075acc00/0x2aac941e5f4a87b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541240.389522:0:17177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a67075acc00/0x2aac941e5f4a87b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541240.389543:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706832300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17177:1875420981142656:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788541240.389582:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541240.389652:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707871cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788541240.389750:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981142656 00000100:00100000:1.0:1788541240.389757:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981142656 00000100:00100000:1.0:1788541240.389848:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788541240.389858:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+5:17177:x1875420981142656:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788541240.389893:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541240.389908:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6706956800/0x2aac941e5f4a87b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a87b2 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541240.389932:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6706956800/0x2aac941e5f4a87b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a87b2 expref: 6 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541240.389943:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6706956800/0x2aac941e5f4a87b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a87b2 expref: 6 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541240.389952:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6706956800, rc 0) 00000100:00100000:1.0:1788541240.389995:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+6:17177:x1875420981142656:12345-0@lo:101:mount.lustre.0 Request processed in 139us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541240.390002:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788541240.390091:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706832300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17177:1875420981142656:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788541240.390103:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a67075acc00/0x2aac941e5f4a87b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a87b9 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541240.390112:0:17177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a67075acc00/0x2aac941e5f4a87b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a87b9 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541240.390160:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706832300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17177:1875420981142784:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788541240.390196:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541240.390613:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707871cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788541240.390763:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981142784 00000100:00100000:0.0:1788541240.390769:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981142784 00000100:00100000:0.0:1788541240.390795:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788541240.390802:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+6:17177:x1875420981142784:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788541240.390919:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+6:17177:x1875420981142784:12345-0@lo:501:mount.lustre.0 Request processed in 116us (721us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788541240.390926:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788541240.391059:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706832300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17177:1875420981142784:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788541240.391089:0:17177:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788541240.391110:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a67075acc00/0x2aac941e5f4a87b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a87b9 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541240.391120:0:17177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a67075acc00/0x2aac941e5f4a87b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a87b9 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541240.391128:0:17177:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a67082f3800 10000000:01000000:3.0:1788541240.391133:0:17177:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788541240.391137:0:17177:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9a67082f3800 10000000:01000000:3.0:1788541240.391139:0:17177:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788541240.391142:0:17177:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9a67082f3800 from 1 10000000:01000000:3.0:1788541240.391144:0:17177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788541240.391164:0:17177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a67075ac400/0x2aac941e5f4a87c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541240.391171:0:17177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a67075ac400/0x2aac941e5f4a87c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541240.391193:0:17177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a67075ac400/0x2aac941e5f4a87c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541240.391210:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706832300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17177:1875420981142912:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788541240.391240:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541240.391268:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707871cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788541240.391564:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981142912 00000100:00100000:0.0:1788541240.391569:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981142912 00000100:00100000:0.0:1788541240.391594:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788541240.391600:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708146c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+6:17177:x1875420981142912:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788541240.391609:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541240.391621:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6800031c00/0x2aac941e5f4a87c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a87c0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541240.391640:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6800031c00/0x2aac941e5f4a87c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a87c0 expref: 7 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541240.391659:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6800031c00/0x2aac941e5f4a87c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a87c0 expref: 7 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541240.391666:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6800031c00, rc 0) 00000100:00100000:0.0:1788541240.391718:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708146c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+7:17177:x1875420981142912:12345-0@lo:101:mount.lustre.0 Request processed in 117us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541240.391725:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788541240.391901:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706832300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17177:1875420981142912:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788541240.391913:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a67075ac400/0x2aac941e5f4a87c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a87c7 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541240.391921:0:17177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a67075ac400/0x2aac941e5f4a87c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a87c7 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541240.391940:0:17177:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788541240.391944:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a67075ac400/0x2aac941e5f4a87c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a87c7 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541240.391951:0:17177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a67075ac400/0x2aac941e5f4a87c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a87c7 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541240.391958:0:17177:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788541240.391962:0:17177:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788541240.391966:0:17177:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9a67082f3800 10000000:01000000:3.0:1788541240.391969:0:17177:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788541240.391972:0:17177:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788541240.391975:0:17177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788541240.391991:0:17177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a67075ad000/0x2aac941e5f4a87ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541240.391998:0:17177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a67075ad000/0x2aac941e5f4a87ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541240.392006:0:17177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a67075ad000/0x2aac941e5f4a87ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541240.392021:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706832300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17177:1875420981143040:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788541240.392048:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541240.392061:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707871cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788541240.392195:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981143040 00000100:00100000:0.0:1788541240.392200:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981143040 00000100:00100000:0.0:1788541240.392220:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788541240.392226:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708144c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+7:17177:x1875420981143040:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788541240.392234:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541240.392241:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6800031000/0x2aac941e5f4a87d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a87ce expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541240.392256:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6800031000/0x2aac941e5f4a87d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a87ce expref: 8 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541240.392265:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6800031000/0x2aac941e5f4a87d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a87ce expref: 8 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541240.392271:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6800031000, rc 0) 00000100:00100000:0.0:1788541240.392320:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708144c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+8:17177:x1875420981143040:12345-0@lo:101:mount.lustre.0 Request processed in 93us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541240.392326:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788541240.392585:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706832300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17177:1875420981143040:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788541240.392597:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a67075ad000/0x2aac941e5f4a87ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a87d5 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541240.392612:0:17177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a67075ad000/0x2aac941e5f4a87ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a87d5 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541240.392663:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706832300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17177:1875420981143168:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788541240.392703:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541240.392732:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707871cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788541240.392944:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981143168 00000100:00100000:0.0:1788541240.392949:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981143168 00000100:00100000:0.0:1788541240.392976:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788541240.392981:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708145450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+8:17177:x1875420981143168:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788541240.393111:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708145450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+9:17177:x1875420981143168:12345-0@lo:501:mount.lustre.0 Request processed in 129us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541240.393118:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788541240.393252:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706832300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17177:1875420981143168:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788541240.393295:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706832300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17177:1875420981143296:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788541240.393342:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541240.393368:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707871cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788541240.393530:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981143296 00000100:00100000:0.0:1788541240.393535:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981143296 00000100:00100000:0.0:1788541240.393553:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788541240.393559:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708147450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+9:17177:x1875420981143296:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788541240.394705:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708147450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+9:17177:x1875420981143296:12345-0@lo:503:mount.lustre.0 Request processed in 1141us (1357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541240.394714:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788541240.394911:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706832300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17177:1875420981143296:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788541240.395618:0:17216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706832300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4746c063-6c88-4476-b99b-02bb8e8d54f7:17216:1875420981143424:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788541240.395661:0:17216:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541240.395762:0:17216:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67078716c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788541240.395819:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981143424 00000100:00100000:0.0:1788541240.395824:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981143424 00000100:00100000:0.0:1788541240.395942:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788541240.395950:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708147c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+9:17216:x1875420981143424:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788541240.396817:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708147c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+9:17216:x1875420981143424:12345-0@lo:502:llog_process_th.0 Request processed in 866us (1154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541240.396826:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788541240.396998:0:17216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706832300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4746c063-6c88-4476-b99b-02bb8e8d54f7:17216:1875420981143424:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788541240.397036:0:17216:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788541240.397050:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541240.397053:0:17216:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788541240.397059:0:17216:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788541240.397062:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788541240.397080:0:17216:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9a682fe099c0) 00000020:00000080:3.0:1788541240.397096:0:17216:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788541240.397101:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788541240.397198:0:17216:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788541240.397206:0:17216:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2aac941e5f4a87e3 00000020:00000080:3.0:1788541240.397654:0:17216:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788541240.397659:0:17216:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788541240.397663:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541240.397665:0:17216:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788541240.397667:0:17216:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788541240.397671:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541240.397672:0:17216:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788541240.397675:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788541240.397693:0:17216:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9a682fe0b380) 00000020:00000080:3.0:1788541240.397702:0:17216:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788541240.397706:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788541240.397708:0:17216:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788541240.397711:0:17216:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788541240.397716:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788541240.397760:0:17216:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a67082f3800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788541240.397779:0:17216:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9a683ec119c0) 00000020:00000080:3.0:1788541240.397789:0:17216:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788541240.397851:0:17216:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788541240.397856:0:17216:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2aac941e5f4a87f8 00000020:00000080:3.0:1788541240.397966:0:17216:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788541240.397972:0:17216:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788541240.397976:0:17216:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x2aac941e5f4a87ff 00080000:01000000:3.0:1788541240.397981:0:17216:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788541240.397985:0:17216:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2aac941e5f4a8806 00010000:00010000:0.0:1788541240.479165:0:17216:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1788541240.480110:0:17216:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:0.0:1788541240.480660:0:17216:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788541240.481461:0:17216:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9a6835313380) 00000020:00000080:0.0:1788541240.481480:0:17216:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788541240.481543:0:17216:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788541240.481549:0:17216:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2aac941e5f4a8814 00000020:00000080:0.0:1788541240.482655:0:17216:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788541240.491548:0:17216:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x2aac941e5f4a881b 00000020:00000080:1.0:1788541240.493119:0:17216:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788541240.493132:0:17216:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788541240.493140:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541240.493142:0:17216:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788541240.493145:0:17216:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788541240.493148:0:17216:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1788541240.493150:0:17216:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788541240.493151:0:17216:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788541240.493154:0:17216:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788541240.493157:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541240.493158:0:17216:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788541240.493161:0:17216:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788541240.493166:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541240.493167:0:17216:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788541240.493172:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788541240.493386:0:17216:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788541240.493405:0:17216:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788541240.493408:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541240.493410:0:17216:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788541240.493413:0:17216:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788541240.493416:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541240.493417:0:17216:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1788541240.493420:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788541240.493426:0:17216:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.156@tcp to nid 0x20000c0a8ca9c (192.168.202.156@tcp) 00000020:00000080:1.0:1788541240.493576:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788541240.493594:0:17216:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9a670695cd40) 00000020:00000080:1.0:1788541240.493611:0:17216:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1788541240.493617:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788541240.493678:0:17216:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1788541240.493684:0:17216:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788541240.493701:0:17216:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2aac941e5f4a8829 00010000:00080000:1.0:1788541240.493736:0:17216:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a670774b000@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.156@tcp at head 00010000:00010000:1.0:1788541240.497738:0:17216:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1788541240.499660:0:17216:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788541240.499676:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788541240.499711:0:17216:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788541240.499730:0:17216:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2aac941e5f4a8830 00000100:00080000:3.0:1788541240.499741:0:17216:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788541240.499748:0:17216:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a670774b000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:3.0:1788541240.499785:0:17216:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6706832300 x1875420981143552/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788541240.499828:0:17216:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1788541240.499937:0:17216:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788541240.499941:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541240.499943:0:17216:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1788541240.499946:0:17216:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788541240.499949:0:17216:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1788541240.499951:0:17216:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788541240.499953:0:17216:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788541240.499954:0:17216:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788541240.499957:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541240.499958:0:17216:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788541240.499961:0:17216:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788541240.499967:0:17216:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788541240.499970:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541240.499972:0:17216:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788541240.499975:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788541240.499979:0:17216:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.156@tcp to nid 0x20000c0a8ca9c (192.168.202.156@tcp) 00000020:01000000:3.0:1788541240.500002:0:17216:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788541240.500005:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788541240.500018:0:17216:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9a683ec13380) 00000020:00000080:3.0:1788541240.500029:0:17216:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788541240.500035:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788541240.500107:0:17216:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788541240.500114:0:17216:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788541240.500120:0:17216:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2aac941e5f4a883e 00010000:00080000:3.0:1788541240.500152:0:17216:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a682ff81800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.156@tcp at head 00010000:00010000:3.0:1788541240.500401:0:17216:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:2.0:1788541240.501121:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706832300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981143552:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788541240.501205:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541240.502058:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981143552 00000100:00100000:3.0:1788541240.502069:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981143552 00000100:00100000:3.0:1788541240.502346:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788541240.502365:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875420981143552:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1788541240.502403:0:17203:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:2.0:1788541240.508623:0:17216:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788541240.509120:0:17216:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788541240.515684:0:17216:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788541240.516171:0:17216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788541240.526584:0:17216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000100:00100000:3.0:1788541240.531290:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875420981143552:12345-0@lo:38:llog_process_th.0 Request processed in 28925us (30075us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788541240.531305:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788541240.532049:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a670774b000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788541240.532056:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788541240.532060:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706832300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981143552:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788541240.533092:0:17222:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788541240.533098:0:17222:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788541240.533591:0:17216:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788541240.533605:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788541240.533644:0:17216:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788541240.533664:0:17216:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2aac941e5f4a8845 00000100:00080000:0.0:1788541240.533673:0:17216:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788541240.533679:0:17216:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a682ff81800 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:0.0:1788541240.533713:0:17216:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a670831ed80 x1875420981143680/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788541240.533744:0:17216:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788541240.533803:0:17216:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788541240.533807:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788541240.533809:0:17216:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788541240.533812:0:17216:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788541240.533815:0:17216:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1788541240.533817:0:17216:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788541240.533818:0:17216:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788541240.533820:0:17216:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788541240.533822:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788541240.533823:0:17216:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788541240.533826:0:17216:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788541240.533829:0:17216:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788541240.533832:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788541240.533834:0:17216:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000100:00100000:2.0:1788541240.533987:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981143680:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788541240.534037:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875420981143680 offset 0 length 520: 4 00000020:00000080:0.0:1788541240.534129:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788541240.534133:0:17216:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.156@tcp to nid 0x20000c0a8ca9c (192.168.202.156@tcp) 00000020:01000000:0.0:1788541240.534155:0:17216:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788541240.534168:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788541240.534248:0:17216:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9a6835314d40) 00000020:00000080:0.0:1788541240.534261:0:17216:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1788541240.534267:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788541240.534329:0:17216:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788541240.534334:0:17216:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:0.0:1788541240.534340:0:17216:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2aac941e5f4a8853 00010000:00080000:0.0:1788541240.534558:0:17216:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a682ff82000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.156@tcp at head 00010000:00010000:0.0:1788541240.534773:0:17216:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1788541240.535247:0:17216:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788541240.535267:0:17216:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788541240.537666:0:17216:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788541240.538054:0:17216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1788541240.538225:0:17216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1788541240.538809:0:17224:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788541240.538814:0:17224:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788541240.539757:0:17216:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788541240.539769:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788541240.539804:0:17216:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788541240.539822:0:17216:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2aac941e5f4a885a 00000100:00080000:1.0:1788541240.539832:0:17216:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788541240.540959:0:17216:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a682ff82000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:1.0:1788541240.541001:0:17216:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a670835ca80 x1875420981143808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788541240.541032:0:17216:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788541240.541121:0:17216:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788541240.541127:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541240.541129:0:17216:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788541240.541132:0:17216:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788541240.541136:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541240.541137:0:17216:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788541240.541140:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788541240.541142:0:17216:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788541240.541145:0:17216:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788541240.541147:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541240.541148:0:17216:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788541240.541151:0:17216:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788541240.541153:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541240.541154:0:17216:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788541240.541158:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788541240.541537:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981143808:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788541240.541593:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875420981143808 offset 0 length 520: 4 00000100:00100000:1.0:1788541240.542133:0:17216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4746c063-6c88-4476-b99b-02bb8e8d54f7:17216:1875420981143936:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788541240.542198:0:17216:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541240.542232:0:17216:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6835493e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788541240.542343:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981143936 00000100:00100000:3.0:1788541240.542350:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981143936 00000100:00100000:3.0:1788541240.542421:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788541240.542431:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708144450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+9:17216:x1875420981143936:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788541240.542739:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708144450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+9:17216:x1875420981143936:12345-0@lo:502:llog_process_th.0 Request processed in 309us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541240.542746:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788541240.542848:0:17216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4746c063-6c88-4476-b99b-02bb8e8d54f7:17216:1875420981143936:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788541240.542896:0:17216:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788541240.542902:0:17216:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541240.542904:0:17216:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788541240.542907:0:17216:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1788541240.543064:0:17177:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1788541240.543085:0:17177:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788541240.543107:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a67075ad000/0x2aac941e5f4a87ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a87d5 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541240.543117:0:17177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a67075ad000/0x2aac941e5f4a87ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a87d5 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788541240.543125:0:17177:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a67082f3800 from 1 10000000:01000000:0.0:1788541240.543128:0:17177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788541240.543156:0:17177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6800030200/0x2aac941e5f4a8861 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541240.543164:0:17177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a6800030200/0x2aac941e5f4a8861 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541240.543190:0:17177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a6800030200/0x2aac941e5f4a8861 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541240.543205:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17177:1875420981144064:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788541240.543234:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541240.543260:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a682ff91900 going to sleep for 11 seconds 00000100:00100000:3.0:1788541240.543576:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981144064 00000100:00100000:3.0:1788541240.543582:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981144064 00000100:00100000:3.0:1788541240.543618:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788541240.543628:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708147850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+9:17177:x1875420981144064:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788541240.543638:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541240.543652:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a67075ad200/0x2aac941e5f4a8868 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a8861 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541240.543674:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a67075ad200/0x2aac941e5f4a8868 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a8861 expref: 10 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541240.543684:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a67075ad200/0x2aac941e5f4a8868 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a8861 expref: 10 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541240.543692:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075ad200, rc 0) 00000100:00100000:3.0:1788541240.543769:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708147850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+10:17177:x1875420981144064:12345-0@lo:101:mount.lustre.0 Request processed in 142us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541240.543783:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788541240.544258:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17177:1875420981144064:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788541240.544273:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a6800030200/0x2aac941e5f4a8861 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8868 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541240.544283:0:17177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a6800030200/0x2aac941e5f4a8861 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a8868 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541240.545562:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17177:1875420981144192:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788541240.545622:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541240.545664:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a682ff91d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788541240.545726:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981144192 00000100:00100000:1.0:1788541240.545733:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981144192 00000100:00100000:1.0:1788541240.545775:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788541240.545782:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708144850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+10:17177:x1875420981144192:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788541240.545798:0:17192:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788541240.545804:0:17192:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788541240.545916:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708144850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+10:17177:x1875420981144192:12345-0@lo:256:mount.lustre.0 Request processed in 133us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541240.545923:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788541240.546116:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17177:1875420981144192:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788541240.547056:0:17177:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788541240.547077:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6800030200/0x2aac941e5f4a8861 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8868 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541240.547088:0:17177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a6800030200/0x2aac941e5f4a8861 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8868 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788541240.547098:0:17177:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a67082f3800 from 1 10000000:01000000:2.0:1788541240.547100:0:17177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788541240.547136:0:17177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551ae00/0x2aac941e5f4a886f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541240.547145:0:17177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a683551ae00/0x2aac941e5f4a886f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541240.547162:0:17177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a683551ae00/0x2aac941e5f4a886f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541240.547322:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17177:1875420981144320:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788541240.547529:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541240.547606:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6805325180 going to sleep for 11 seconds 00000100:00100000:0.0:1788541240.547708:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981144320 00000100:00100000:0.0:1788541240.547715:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981144320 00000100:00100000:0.0:1788541240.547789:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788541240.547798:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+10:17177:x1875420981144320:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788541240.547810:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541240.547824:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6800030a00/0x2aac941e5f4a8876 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a886f expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541240.547864:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6800030a00/0x2aac941e5f4a8876 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a886f expref: 11 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541240.547896:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6800030a00/0x2aac941e5f4a8876 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a886f expref: 11 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541240.547905:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6800030a00, rc 0) 00000100:00100000:0.0:1788541240.547946:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+11:17177:x1875420981144320:12345-0@lo:101:mount.lustre.0 Request processed in 149us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541240.547953:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788541240.548048:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17177:1875420981144320:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788541240.548063:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a683551ae00/0x2aac941e5f4a886f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8876 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541240.548071:0:17177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a683551ae00/0x2aac941e5f4a886f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a8876 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541240.548140:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17177:1875420981144448:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788541240.548164:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541240.548592:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6805325180 going to sleep for 11 seconds 00000100:00100000:1.0:1788541240.548660:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981144448 00000100:00100000:1.0:1788541240.548665:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981144448 00000100:00100000:1.0:1788541240.548689:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788541240.548695:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708146850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+11:17177:x1875420981144448:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788541240.549003:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708146850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+11:17177:x1875420981144448:12345-0@lo:501:mount.lustre.0 Request processed in 307us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541240.549011:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788541240.549138:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17177:1875420981144448:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788541240.549170:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17177:1875420981144576:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788541240.549220:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541240.549245:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6805325180 going to sleep for 11 seconds 00000100:00100000:1.0:1788541240.549334:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981144576 00000100:00100000:1.0:1788541240.549338:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981144576 00000100:00100000:1.0:1788541240.549383:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788541240.549390:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708146050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+11:17177:x1875420981144576:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788541240.549629:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708146050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+11:17177:x1875420981144576:12345-0@lo:503:mount.lustre.0 Request processed in 239us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541240.549636:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788541240.549703:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17177:1875420981144576:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788541240.550542:0:17226:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4746c063-6c88-4476-b99b-02bb8e8d54f7:17226:1875420981144704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788541240.550588:0:17226:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541240.550653:0:17226:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6835493cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788541240.550686:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981144704 00000100:00100000:0.0:1788541240.550691:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981144704 00000100:00100000:0.0:1788541240.550752:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788541240.550759:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708145050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+11:17226:x1875420981144704:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788541240.551383:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708145050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+11:17226:x1875420981144704:12345-0@lo:502:llog_process_th.0 Request processed in 615us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541240.551391:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788541240.551484:0:17226:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4746c063-6c88-4476-b99b-02bb8e8d54f7:17226:1875420981144704:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788541240.551510:0:17226:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788541240.551520:0:17226:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788541240.551528:0:17226:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788541240.551536:0:17226:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a67082f3800 00000020:00000080:2.0:1788541240.551539:0:17226:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788541240.551546:0:17226:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788541240.551549:0:17226:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788541240.551550:0:17226:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788541240.551553:0:17226:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788541240.551556:0:17226:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788541240.551557:0:17226:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788541240.551560:0:17226:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a67082f3800 00000020:00000080:2.0:1788541240.551562:0:17226:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788541240.551623:0:17226:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788541240.551627:0:17226:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788541240.551629:0:17226:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788541240.551631:0:17226:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788541240.551634:0:17226:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788541240.551635:0:17226:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788541240.551638:0:17226:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a67082f3800 00000020:00000080:2.0:1788541240.551640:0:17226:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788541240.551658:0:17226:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788541240.551661:0:17226:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788541240.551662:0:17226:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788541240.551665:0:17226:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788541240.551667:0:17226:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788541240.551668:0:17226:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788541240.551672:0:17226:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a67082f3800 00000020:00000080:2.0:1788541240.551673:0:17226:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788541240.551711:0:17226:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4746c063-6c88-4476-b99b-02bb8e8d54f7:17226:1875420981144832:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788541240.551747:0:17226:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541240.555916:0:17226:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6805325180 going to sleep for 11 seconds 00000100:00100000:1.0:1788541240.556140:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981144832 00000100:00100000:1.0:1788541240.556150:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981144832 00000100:00100000:1.0:1788541240.556211:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788541240.556221:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708145c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+11:17226:x1875420981144832:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788541240.556559:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708145c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+11:17226:x1875420981144832:12345-0@lo:502:llog_process_th.0 Request processed in 339us (4810us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541240.556568:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788541240.556680:0:17226:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4746c063-6c88-4476-b99b-02bb8e8d54f7:17226:1875420981144832:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788541240.556715:0:17226:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788541240.556727:0:17226:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788541240.556729:0:17226:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788541240.556735:0:17226:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788541240.556809:0:17177:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788541240.556830:0:17177:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788541240.560009:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551ae00/0x2aac941e5f4a886f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8876 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541240.560028:0:17177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a683551ae00/0x2aac941e5f4a886f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8876 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788541240.560100:0:17177:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788541240.560103:0:17177:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a67082f3800 10000000:01000000:2.0:1788541240.560106:0:17177:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a67082f3800 10000000:01000000:2.0:1788541240.560110:0:17177:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788541240.560116:0:17177:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a67082f3800 from 1 10000000:01000000:2.0:1788541240.560119:0:17177:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788541240.560155:0:17177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551a200/0x2aac941e5f4a887d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541240.560165:0:17177:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a683551a200/0x2aac941e5f4a887d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541240.560188:0:17177:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a683551a200/0x2aac941e5f4a887d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541240.560216:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17177:1875420981144960:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788541240.560283:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541240.560330:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6805325a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788541240.560819:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981144960 00000100:00100000:0.0:1788541240.560827:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981144960 00000100:00100000:0.0:1788541240.561278:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788541240.561287:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708145850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+11:17177:x1875420981144960:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788541240.561300:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541240.561314:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6800031e00/0x2aac941e5f4a8884 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a887d expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541240.561337:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6800031e00/0x2aac941e5f4a8884 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a887d expref: 12 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541240.561347:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6800031e00/0x2aac941e5f4a8884 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a887d expref: 12 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541240.561367:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6800031e00, rc 0) 00000100:00100000:0.0:1788541240.562048:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708145850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+12:17177:x1875420981144960:12345-0@lo:101:mount.lustre.0 Request processed in 759us (1762us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541240.562055:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788541240.562162:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17177:1875420981144960:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788541240.562199:0:17177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a683551a200/0x2aac941e5f4a887d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8884 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541240.562209:0:17177:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a683551a200/0x2aac941e5f4a887d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a8884 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541240.562281:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17177:1875420981145088:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788541240.562313:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541240.562351:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6805325a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788541240.562648:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981145088 00000100:00100000:0.0:1788541240.562654:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981145088 00000100:00100000:0.0:1788541240.562695:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788541240.562703:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835708c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+12:17177:x1875420981145088:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788541240.562849:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835708c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+12:17177:x1875420981145088:12345-0@lo:501:mount.lustre.0 Request processed in 147us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541240.563009:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17177:1875420981145088:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788541240.563041:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17177:1875420981145216:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788541240.563080:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541240.563100:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6805325a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788541240.563113:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981145216 00000100:00100000:2.0:1788541240.563117:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981145216 00000100:00100000:0.0:1788541240.563165:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788541240.581560:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788541240.581582:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683570b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+12:17177:x1875420981145216:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788541240.584043:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683570b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+12:17177:x1875420981145216:12345-0@lo:503:mount.lustre.0 Request processed in 2459us (20951us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541240.584058:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788541240.590417:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17177:1875420981145216:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788541240.590714:0:17232:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4746c063-6c88-4476-b99b-02bb8e8d54f7:17232:1875420981145344:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788541240.590784:0:17232:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541240.590819:0:17232:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6802daecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788541240.591080:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981145344 00000100:00100000:2.0:1788541240.591087:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981145344 00000100:00100000:2.0:1788541240.591136:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788541240.591146:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683570b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+12:17232:x1875420981145344:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788541240.591280:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683570b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+12:17232:x1875420981145344:12345-0@lo:502:llog_process_th.0 Request processed in 135us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541240.591297:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788541240.591344:0:17232:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4746c063-6c88-4476-b99b-02bb8e8d54f7:17232:1875420981145344:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788541240.591421:0:17232:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788541240.591438:0:17232:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9a6707913380) 00000020:00000080:2.0:1788541240.591621:0:17232:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1788541240.591706:0:17232:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a67082f3800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788541240.591711:0:17232:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a67082f3800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788541240.591714:0:17232:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a67082f3800 4 00010000:00080000:2.0:1788541240.591745:0:17232:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a6835181000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.156@tcp at head 00010000:00010000:2.0:1788541240.596579:0:17232:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1788541240.596797:0:17232:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788541240.596841:0:17232:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788541240.596895:0:17232:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x2aac941e5f4a8892 00000100:00080000:2.0:1788541240.596907:0:17232:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788541240.596913:0:17232:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9a6835181000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:2.0:1788541240.596949:0:17232:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a67080d4000 x1875420981145472/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788541240.596972:0:17232:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788541240.597635:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875420981145472:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788541240.597715:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541240.599311:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981145472 00000100:00100000:3.0:1788541240.599323:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981145472 00000100:00100000:3.0:1788541240.599380:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788541240.599389:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875420981145472:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788541240.599587:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3640:x1875420981145472:12345-0@lo:38:llog_process_th.0 Request processed in 197us (1871us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788541240.599595:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788541240.599639:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788541240.599647:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a6835181000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788541240.599651:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788541240.599655:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875420981145472:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788541240.606058:0:17232:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706830e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4746c063-6c88-4476-b99b-02bb8e8d54f7:17232:1875420981145600:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788541240.606140:0:17232:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541240.606277:0:17232:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683549a240 going to sleep for 11 seconds 00000100:00100000:2.0:1788541240.606711:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981145600 00000100:00100000:2.0:1788541240.606719:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981145600 00000100:00100000:2.0:1788541240.606775:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788541240.606785:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683570a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+12:17232:x1875420981145600:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788541240.607192:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683570a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+12:17232:x1875420981145600:12345-0@lo:502:llog_process_th.0 Request processed in 407us (1051us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541240.607201:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788541240.611733:0:17232:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706830e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4746c063-6c88-4476-b99b-02bb8e8d54f7:17232:1875420981145600:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788541240.611827:0:17232:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4746c063-6c88-4476-b99b-02bb8e8d54f7:17232:1875420981145728:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788541240.611950:0:17232:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541240.611992:0:17232:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683f089f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788541240.612317:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981145728 00000100:00100000:1.0:1788541240.612325:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981145728 00000100:00100000:1.0:1788541240.612440:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788541240.612462:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835709450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+12:17232:x1875420981145728:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788541240.612597:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835709450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+12:17232:x1875420981145728:12345-0@lo:502:llog_process_th.0 Request processed in 138us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541240.612612:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788541240.612687:0:17232:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4746c063-6c88-4476-b99b-02bb8e8d54f7:17232:1875420981145728:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788541240.612714:0:17232:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788541240.616307:0:17177:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788541240.616343:0:17177:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788541240.616544:0:17177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551a200/0x2aac941e5f4a887d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8884 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541240.616558:0:17177:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a683551a200/0x2aac941e5f4a887d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8884 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788541240.616613:0:17177:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788541240.616621:0:17177:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788541240.616622:0:17177:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788541240.616623:0:17177:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788541240.616624:0:17177:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788541240.616626:0:17177:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788541240.616627:0:17177:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788541240.616628:0:17177:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788541240.616630:0:17177:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788541240.616631:0:17177:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788541240.616635:0:17177:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788541240.616637:0:17177:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788541240.616638:0:17177:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788541240.616639:0:17177:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788541240.616640:0:17177:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788541240.616641:0:17177:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788541240.616642:0:17177:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788541240.616643:0:17177:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788541240.616644:0:17177:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788541240.616645:0:17177:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788541240.616646:0:17177:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788541240.616673:0:17177:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788541240.616695:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17177:1875420981145856:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788541240.616765:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541240.616808:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683f089f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788541240.617088:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981145856 00000100:00100000:2.0:1788541240.617102:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981145856 00000100:00100000:2.0:1788541240.617158:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788541240.617167:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683570ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+12:17177:x1875420981145856:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788541240.617312:0:17193:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788541240.617325:0:17193:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788541240.620782:0:17193:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788541240.620798:0:17193:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788541240.621531:0:17214:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788541240.621537:0:17214:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788541240.621559:0:17214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a6706956a00/0x2aac941e5f4a8899 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541240.621579:0:17214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a67075ad200/0x2aac941e5f4a8868 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a8861 expref: 12 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541240.621588:0:17214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a6706956a00/0x2aac941e5f4a8899 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541240.621632:0:17214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a67075ad200/0x2aac941e5f4a8868 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a8861 expref: 12 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541240.621646:0:17214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a67075ad200/0x2aac941e5f4a8868 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a8861 expref: 12 pid: 17191 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541240.621661:0:17214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835fb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17214:1875420981145984:0@lo:104: 00000100:00100000:1.0:1788541240.621730:0:17214:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541240.622063:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981145984 00000100:00100000:0.0:1788541240.622072:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981145984 00000100:00100000:0.0:1788541240.622114:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788541240.622124:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4746c063-6c88-4476-b99b-02bb8e8d54f7+3:17214:x1875420981145984:12345-0@lo:104: 00010000:00010000:0.0:1788541240.622138:0:17181:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a6800030200/0x2aac941e5f4a8861 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a8868 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541240.622736:0:17181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788541240.622745:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4746c063-6c88-4476-b99b-02bb8e8d54f7+3:17214:x1875420981145984:12345-0@lo:104: Request processed in 622us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541240.622752:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788541240.622866:0:17214:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a682e76f540 going to sleep for 11 seconds 00000100:00100000:1.0:1788541240.622906:0:17214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835fb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17214:1875420981145984:0@lo:104: 00010000:00010000:1.0:1788541240.622927:0:17214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a6706956a00/0x2aac941e5f4a8899 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541240.622949:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788541240.622956:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a6800030200/0x2aac941e5f4a8861 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a8868 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541240.622974:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6800030200 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:1.0:1788541240.622979:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a6800030200/0x2aac941e5f4a8861 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a8868 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541240.622987:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a6800030200/0x2aac941e5f4a8861 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a8868 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788541240.622994:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a6800030200/0x2aac941e5f4a8861 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a8868 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788541240.623001:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788541240.623039:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a6800030200/0x2aac941e5f4a8861 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a8868 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541240.623046:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788541240.623065:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a6800030200/0x2aac941e5f4a8861 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a8868 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541240.623072:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a6800030200/0x2aac941e5f4a8861 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a8868 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541240.623091:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541240.623093:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541240.623094:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541240.623135:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4746c063-6c88-4476-b99b-02bb8e8d54f7:3644:1875420981146112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788541240.623184:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541240.623278:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683570ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+12:17177:x1875420981145856:12345-0@lo:253:mount.lustre.0 Request processed in 6111us (6512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541240.623294:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788541240.623761:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17177:1875420981145856:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788541240.623774:0:17177:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788541240.623776:0:17177:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788541240.623778:0:17177:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788541240.623780:0:17177:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788541240.623781:0:17177:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788541240.623782:0:17177:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788541240.623784:0:17177:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788541240.623785:0:17177:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788541240.623786:0:17177:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788541240.623789:0:17177:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788541240.623790:0:17177:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788541240.623805:0:17177:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788541240.625020:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981146112 00000100:00100000:3.0:1788541240.625030:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981146112 00010000:00010000:3.0:1788541240.625060:0:17183:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a67075ad200/0x2aac941e5f4a8868 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a8861 expref: 12 pid: 17191 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541240.625101:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788541240.625109:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4746c063-6c88-4476-b99b-02bb8e8d54f7+12:3644:x1875420981146112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788541240.625121:0:17183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541240.625126:0:17183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a67075ad200/0x2aac941e5f4a8868 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a8861 expref: 12 pid: 17191 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541240.625149:0:17183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a67075ad200/0x2aac941e5f4a8868 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a8861 expref: 12 pid: 17191 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541240.625165:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a67075ad200/0x2aac941e5f4a8868 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a8861 expref: 12 pid: 17191 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541240.625264:0:17183:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a6706956a00/0x2aac941e5f4a8899 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541240.625273:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6706956a00/0x2aac941e5f4a8899 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788541240.625289:0:17183:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003752559s 00010000:00010000:3.0:1788541240.625293:0:17183:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6706956a00/0x2aac941e5f4a8899 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541240.625301:0:17183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6706956a00/0x2aac941e5f4a8899 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541240.625307:0:17183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a6706956a00/0x2aac941e5f4a8899 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541240.625313:0:17183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a6706956a00/0x2aac941e5f4a8899 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541240.625319:0:17183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706956a00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:3.0:1788541240.625324:0:17183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a6706956a00/0x2aac941e5f4a8899 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541240.625332:0:17183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a6706956a00/0x2aac941e5f4a8899 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541240.625368:0:17183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a6706956a00/0x2aac941e5f4a8899 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541240.625512:0:17183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541240.625580:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4746c063-6c88-4476-b99b-02bb8e8d54f7+11:3644:x1875420981146112:12345-0@lo:103:ldlm_bl.0 Request processed in 471us (2408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541240.625588:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788541240.625632:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4746c063-6c88-4476-b99b-02bb8e8d54f7:3644:1875420981146112:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788541240.627310:0:17214:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a6706956a00/0x2aac941e5f4a8899 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541240.627324:0:17214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a6706956a00/0x2aac941e5f4a8899 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541240.627331:0:17214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6706956a00/0x2aac941e5f4a8899 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788541240.653524:0:17177:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1788541240.653912:0:17177:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788541240.654156:0:17237:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1788541240.654161:0:17237:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1788541240.654459:0:17238:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788541240.654897:0:17177:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:3.0:1788541240.655614:0:17239:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9a6706830700 x1875420981146240/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541240.655626:0:17239:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683549ae40 going to sleep for 0 seconds 00000040:00080000:0.0:1788541240.655705:0:17238:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1788541240.657566:0:17177:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788541240.657609:0:17177:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788541240.658706:0:17177:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788541240.658722:0:17177:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788541240.658781:0:17177:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788541240.662399:0:17238:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788541240.662740:0:17238:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:3.0:1788541240.664798:0:17177:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788541240.665826:0:17177:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788541240.666107:0:17177:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1788541240.668587:0:17177:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:3.0:1788541240.671826:0:17177:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1788541240.675036:0:17177:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788541240.675080:0:17177:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb5cdc1c73988 00100000:10000000:2.0:1788541240.675089:0:17177:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788541240.675936:0:17177:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788541240.675953:0:17177:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.156@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788541240.675975:0:17177:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788541240.675992:0:17177:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1788541240.686734:0:17177:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788541240.687011:0:17177:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788541241.163243:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788541241.611612:0:17231:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788541241.674138:0:17239:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683549ae40 going to sleep for 0 seconds 10000000:01000000:1.0:1788541241.801985:0:17196:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788541241.801993:0:17196:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a67082f3800 from 7 10000000:01000000:1.0:1788541241.801998:0:17196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788541241.802067:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6706956e00/0x2aac941e5f4a88a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541241.802086:0:17196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a6706956e00/0x2aac941e5f4a88a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541241.802100:0:17196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a6706956e00/0x2aac941e5f4a88a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541241.802138:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981146368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788541241.802311:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541241.802468:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a682e76f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788541241.802634:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981146368 00000100:00100000:0.0:1788541241.802646:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981146368 00000100:00100000:0.0:1788541241.802719:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788541241.802729:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835709850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+11:17196:x1875420981146368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788541241.802743:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541241.802757:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6800030200/0x2aac941e5f4a88a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a88a0 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541241.802793:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6800030200/0x2aac941e5f4a88a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a88a0 expref: 12 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541241.802815:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6800030200/0x2aac941e5f4a88a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a88a0 expref: 12 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541241.802827:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6800030200, rc 0) 00000100:00100000:1.0:1788541241.803006:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981146368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788541241.803024:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a6706956e00/0x2aac941e5f4a88a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a88a7 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541241.804058:0:17196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a6706956e00/0x2aac941e5f4a88a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a88a7 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541241.804430:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981146496:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788541241.804672:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835709850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+12:17196:x1875420981146368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1941us (2358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541241.804688:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788541241.805404:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541241.805450:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a682e76f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788541241.805551:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981146496 00000100:00100000:2.0:1788541241.805559:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981146496 00000100:00100000:2.0:1788541241.805607:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788541241.805615:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683570b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+12:17196:x1875420981146496:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788541241.805634:0:17193:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788541241.805650:0:17193:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788541241.805653:0:17193:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788541241.805754:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683570b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+12:17196:x1875420981146496:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 139us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541241.805761:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788541241.805788:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981146496:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788541241.805848:0:17196:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788541241.805857:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6706956e00/0x2aac941e5f4a88a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a88a7 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541241.805867:0:17196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a6706956e00/0x2aac941e5f4a88a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a88a7 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541242.189066:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788541242.634703:0:17231:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788541242.703758:0:17239:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683549ae40 going to sleep for 0 seconds 00010000:00010000:2.0:1788541243.219607:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541243.740304:0:17239:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683549ae40 going to sleep for 0 seconds 00010000:00010000:1.0:1788541244.242242:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541244.750510:0:17239:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683549ae40 going to sleep for 0 seconds 00010000:00010000:1.0:1788541245.270752:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541245.772684:0:17239:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683549ae40 going to sleep for 0 seconds 00000001:02000400:0.0:1788541245.891845:0:17481:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg256-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1788541245.899168:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788541245.899176:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788541245.899179:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a670774b000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788541245.899188:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 521 00000100:00080000:1.0:1788541245.899194:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788541245.899201:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a670774b000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:1.0:1788541245.899226:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a670835ea00 x1875420981146752/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788541245.899249:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788541245.899268:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788541245.899271:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788541245.899274:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788541245.899276:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788541245.899279:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788541245.899281:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a6835181000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788541245.899287:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9a6835181000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:1.0:1788541245.899301:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a670835f800 x1875420981146880/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788541245.899339:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981146752:0@lo:38:kworker.0 00000100:00100000:1.0:1788541245.899453:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541245.899504:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875420981146880:0@lo:38:kworker.0 00000100:00100000:1.0:1788541245.899534:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541245.899580:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981146752 00000100:00100000:1.0:1788541245.899588:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981146752 00000100:00100000:1.0:1788541245.899636:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788541245.899644:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875420981146752:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788541245.899663:0:17204:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788541245.899756:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4746c063-6c88-4476-b99b-02bb8e8d54f7:3641:1875420981146624:0@lo:400:kworker.0 00000100:00100000:2.0:1788541245.899808:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541245.899845:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981146624 00000100:00100000:2.0:1788541245.899849:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981146624 00000100:00100000:2.0:1788541245.899910:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788541245.899917:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683570a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+12:3641:x1875420981146624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541245.899963:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683570a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+12:3641:x1875420981146624:12345-0@lo:400:kworker.0 Request processed in 47us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541245.899970:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788541245.900026:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4746c063-6c88-4476-b99b-02bb8e8d54f7:3641:1875420981146624:0@lo:400:kworker.0 00000100:00100000:2.0:1788541245.902280:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981146880 00000100:00100000:2.0:1788541245.902293:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981146880 00000100:00100000:2.0:1788541245.902350:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788541245.902358:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875420981146880:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788541245.902431:0:17200:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 526 last 0 00000020:00000080:2.0:1788541245.902470:0:17200:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x2aac941e5f4a88ae 00000004:00100000:2.0:1788541245.902487:0:17200:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788541245.902619:0:17200:0:(import.c:65:import_set_state_nolock()) ffff9a6837915800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788541245.902706:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1875420981146880:12345-0@lo:38:kworker.0 Request processed in 348us (3170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541245.902714:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788541245.906375:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a670835f800 x1875420981146880/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788541255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788541245.906401:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788541245.906419:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788541245.906425:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788541245.906428:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a6835181000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788541245.906437:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3640:1875420981146880:0@lo:38:kworker.0 00000100:00100000:0.0:1788541245.952214:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875420981146752:12345-0@lo:38:kworker.0 Request processed in 52560us (52752us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788541245.952233:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788541245.955476:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a670774b000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788541245.955489:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788541245.955495:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981146752:0@lo:38:kworker.0 00010000:00010000:1.0:1788541246.283201:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541246.795931:0:17239:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683549ae40 going to sleep for 0 seconds 00000020:00000004:1.0:1788541246.828362:0:17534:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788541246.828712:0:17534:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788541247.312672:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788541247.704506:0:17584:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788541247.704842:0:17584:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788541247.824608:0:17239:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683549ae40 going to sleep for 0 seconds 00010000:00010000:1.0:1788541248.331955:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541248.841993:0:17239:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683549ae40 going to sleep for 0 seconds 00010000:00010000:1.0:1788541249.354018:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541249.868279:0:17239:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683549ae40 going to sleep for 0 seconds 00010000:00010000:2.0:1788541250.378303:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541250.890929:0:17239:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683549ae40 going to sleep for 0 seconds 00000100:00100000:0.0:1788541251.019254:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788541240/real 1788541240] req@ffff9a670835ca80 x1875420981143808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788541250 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541251.019307:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a670835ca80 x1875420981143808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788541250 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541251.019319:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788541240/real 1788541240] req@ffff9a670831ed80 x1875420981143680/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788541250 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541251.019331:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a670831ed80 x1875420981143680/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788541250 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788541251.019350:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a682ff82000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788541251.022383:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788541251.022389:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788541251.022393:0:38:0:(import.c:65:import_set_state_nolock()) ffff9a670774b000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788541251.022401:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 526 00000100:00080000:3.0:1788541251.022407:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788541251.022413:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a670774b000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:3.0:1788541251.022436:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6706832300 x1875420981147136/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788541251.022447:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788541251.022450:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788541251.022452:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788541251.022455:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788541251.022457:0:38:0:(import.c:65:import_set_state_nolock()) ffff9a682ff82000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788541251.022460:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 521 00000100:00080000:3.0:1788541251.022463:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788541251.022466:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a682ff82000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:1.0:1788541251.022607:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4746c063-6c88-4476-b99b-02bb8e8d54f7:3642:1875420981147008:0@lo:400:kworker.0 00000100:00100000:1.0:1788541251.022700:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541251.022779:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981147008 00000100:00100000:1.0:1788541251.022787:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981147008 00000100:00100000:1.0:1788541251.022928:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788541251.022938:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835709050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+12:3642:x1875420981147008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541251.022991:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835709050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+12:3642:x1875420981147008:12345-0@lo:400:kworker.0 Request processed in 54us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541251.022999:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788541251.023048:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4746c063-6c88-4476-b99b-02bb8e8d54f7:3642:1875420981147008:0@lo:400:kworker.0 00000100:00100000:3.0:1788541251.023369:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6706831f80 x1875420981147264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788541251.023450:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788541251.023462:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875420981147392:0@lo:400:kworker.0 00000100:00100000:3.0:1788541251.023584:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541251.023631:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981147392 00000100:00100000:3.0:1788541251.023648:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981147392 00000100:00100000:3.0:1788541251.023747:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788541251.023755:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875420981147392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541251.023796:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875420981147392:12345-0@lo:400:kworker.0 Request processed in 42us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541251.024586:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788541251.024640:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a6706833100 x1875420981147392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541251.024653:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875420981147392:0@lo:400:kworker.0 00000100:00080000:0.0:1788541251.025443:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788541251.025450:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981143808:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788541251.025461:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a682ff81800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788541251.025682:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788541251.025687:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788541251.025690:0:38:0:(import.c:65:import_set_state_nolock()) ffff9a682ff81800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788541251.025694:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 521 00000100:00080000:3.0:1788541251.025699:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788541251.025705:0:38:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a682ff81800 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:3.0:1788541251.025737:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6706833100 x1875420981147520/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788541251.025983:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788541251.025988:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981143680:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788541251.026022:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706832300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981147136:0@lo:38:kworker.0 00000100:00100000:0.0:1788541251.026080:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541251.026119:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981147264:0@lo:8:kworker.0 00000400:00000100:0.0:1788541251.026136:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875420981147264 offset 0 length 520: 4 00000100:00100000:0.0:1788541251.026154:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981147520:0@lo:8:kworker.0 00000400:00000100:0.0:1788541251.026169:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875420981147520 offset 0 length 520: 4 00000100:00100000:2.0:1788541251.026736:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981147136 00000100:00100000:2.0:1788541251.026746:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981147136 00000100:00100000:2.0:1788541251.026788:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788541251.026796:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875420981147136:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788541251.027754:0:17203:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788541251.065758:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875420981147136:12345-0@lo:38:kworker.0 Request processed in 38952us (39668us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788541251.065772:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788541251.068237:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a670774b000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788541251.068250:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788541251.068255:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706832300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981147136:0@lo:38:kworker.0 00010000:00010000:1.0:1788541251.402172:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541251.913938:0:17239:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683549ae40 going to sleep for 0 seconds 00010000:00010000:2.0:1788541252.443323:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788541252.879652:0:17231:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788541252.940048:0:17239:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683549ae40 going to sleep for 0 seconds 00010000:00010000:1.0:1788541253.450188:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541253.966695:0:17239:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683549ae40 going to sleep for 0 seconds 00010000:00010000:0.0:1788541254.480057:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788541254.813852:0:17929:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788541254.813857:0:17929:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788541254.813859:0:17929:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788541254.814592:0:17929:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a683f356800 00000020:01000004:2.0:1788541254.814611:0:17929:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1788541254.814624:0:17929:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788541254.814641:0:17929:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9a6707910000) 00000020:00000080:2.0:1788541254.814658:0:17929:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788541254.881840:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788541254.882162:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:1.0:1788541254.883188:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1788541254.883501:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1788541254.883715:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788541254.884190:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788541254.884358:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788541254.884517:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1788541254.884671:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1788541254.884946:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1788541254.885110:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1788541254.895639:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788541254.897141:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788541254.897987:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1788541254.900164:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1788541254.901466:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788541254.905627:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1788541254.906540:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788541254.906793:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788541254.906997:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788541254.907257:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788541254.907455:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788541254.907828:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788541254.908270:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1788541254.908526:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1788541254.908840:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788541254.909127:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1788541254.909383:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788541254.909634:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1788541254.909942:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1788541254.910211:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1788541254.910472:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1788541254.910747:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788541254.911133:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788541254.911404:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788541254.911829:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1788541254.912183:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1788541254.912505:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788541254.912808:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788541254.913085:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788541254.913357:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788541254.913713:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788541254.914026:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788541254.914360:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788541254.914601:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788541254.914951:0:17929:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00080000:01000000:3.0:1788541254.918777:0:17929:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788541254.919164:0:17929:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1788541254.919174:0:17929:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788541254.919189:0:17929:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2aac941e5f4a88bc 00000020:01000004:3.0:1788541254.919195:0:17929:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788541254.919215:0:17929:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.156@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788541254.919218:0:17929:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.156@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788541254.919231:0:17929:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1788541254.919267:0:17929:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1788541254.919273:0:17929:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.156@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1788541254.924774:0:17929:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.156@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788541254.924819:0:17929:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.156@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1788541254.924823:0:17929:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788541254.924825:0:17929:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788541254.924826:0:17929:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788541254.924828:0:17929:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788541254.924829:0:17929:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788541254.924831:0:17929:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788541254.924832:0:17929:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788541254.924834:0:17929:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788541254.924835:0:17929:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788541254.924838:0:17929:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1788541254.924840:0:17929:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788541254.924842:0:17929:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788541254.924843:0:17929:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788541254.924844:0:17929:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788541254.924845:0:17929:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788541254.924846:0:17929:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788541254.924847:0:17929:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788541254.924848:0:17929:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788541254.924848:0:17929:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788541254.925036:0:17929:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788541254.925308:0:17929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706833b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17929:1875420981147648:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788541254.925776:0:17929:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541254.925929:0:17929:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68042ddcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788541254.926309:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981147648 00000100:00100000:2.0:1788541254.926320:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981147648 00000100:00100000:2.0:1788541254.926507:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788541254.926520:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835708450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+12:17929:x1875420981147648:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788541254.926561:0:17191:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788541254.926565:0:17191:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1788541254.926574:0:17191:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1788541254.926995:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835708450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+12:17929:x1875420981147648:12345-0@lo:253:mount.lustre.0 Request processed in 476us (1219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541254.927005:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788541254.927124:0:17929:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706833b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17929:1875420981147648:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788541254.927136:0:17929:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788541254.927150:0:17929:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788541254.927152:0:17929:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788541254.927154:0:17929:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788541254.927155:0:17929:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788541254.927156:0:17929:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788541254.927157:0:17929:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788541254.927158:0:17929:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788541254.927160:0:17929:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788541254.927161:0:17929:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788541254.927182:0:17929:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a683f356800 from lustre-MDT0001 10000000:01000000:3.0:1788541254.927209:0:17929:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1788541254.927212:0:17929:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788541254.927218:0:17929:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a67079119c0 local copy 00010000:00010000:3.0:1788541254.927239:0:17929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a67075acc00/0x2aac941e5f4a87b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a87b9 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541254.927365:0:17929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706833b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17929:1875420981147776:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788541254.927396:0:17929:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541254.927696:0:17929:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68042ddb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788541254.927773:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981147776 00000100:00100000:1.0:1788541254.927779:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981147776 00000100:00100000:1.0:1788541254.927811:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788541254.927819:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835709c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+12:17929:x1875420981147776:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788541254.927923:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835709c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+12:17929:x1875420981147776:12345-0@lo:501:mount.lustre.0 Request processed in 103us (525us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788541254.927931:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788541254.928077:0:17929:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706833b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17929:1875420981147776:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788541254.928092:0:17929:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.156@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788541254.928110:0:17929:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.156@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788541254.928117:0:17929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a67075acc00/0x2aac941e5f4a87b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a87b9 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541254.928126:0:17929:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a67075acc00/0x2aac941e5f4a87b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a87b9 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541254.928148:0:17929:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a683f356800 10000000:01000000:3.0:1788541254.928152:0:17929:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788541254.928157:0:17929:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9a67079119c0 10000000:01000000:3.0:1788541254.928167:0:17929:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788541254.928171:0:17929:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9a67079119c0 from 1 10000000:01000000:3.0:1788541254.928174:0:17929:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788541254.928199:0:17929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a67075ad200/0x2aac941e5f4a88c3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541254.928207:0:17929:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a67075ad200/0x2aac941e5f4a88c3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541254.928216:0:17929:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a67075ad200/0x2aac941e5f4a88c3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541254.928245:0:17929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706833b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17929:1875420981147904:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788541254.928270:0:17929:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541254.928299:0:17929:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68042ddb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788541254.928441:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981147904 00000100:00100000:1.0:1788541254.928445:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981147904 00000100:00100000:1.0:1788541254.928466:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788541254.928472:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683570bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+12:17929:x1875420981147904:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788541254.928481:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541254.928494:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6706957000/0x2aac941e5f4a88ca lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a88c3 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541254.928515:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6706957000/0x2aac941e5f4a88ca lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a88c3 expref: 13 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541254.928523:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6706957000/0x2aac941e5f4a88ca lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a88c3 expref: 13 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541254.928531:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6706957000, rc 0) 00000100:00100000:1.0:1788541254.928566:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683570bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+13:17929:x1875420981147904:12345-0@lo:101:mount.lustre.0 Request processed in 94us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541254.928572:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788541254.928634:0:17929:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706833b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17929:1875420981147904:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788541254.928712:0:17929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a67075ad200/0x2aac941e5f4a88c3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a88ca expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541254.928723:0:17929:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a67075ad200/0x2aac941e5f4a88c3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a88ca expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541254.928739:0:17929:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788541254.928757:0:17929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a67075ad200/0x2aac941e5f4a88c3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a88ca expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541254.928764:0:17929:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a67075ad200/0x2aac941e5f4a88c3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a88ca expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541254.928771:0:17929:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9a683f356800 10000000:01000000:3.0:1788541254.928781:0:17929:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788541254.928784:0:17929:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9a683f356800 from 1 10000000:01000000:3.0:1788541254.928786:0:17929:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788541254.928802:0:17929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a67075ade00/0x2aac941e5f4a88d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541254.928808:0:17929:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a67075ade00/0x2aac941e5f4a88d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541254.928815:0:17929:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a67075ade00/0x2aac941e5f4a88d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541254.928827:0:17929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706833b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17929:1875420981148032:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788541254.928853:0:17929:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541254.928866:0:17929:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68042ddb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788541254.928964:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981148032 00000100:00100000:1.0:1788541254.928969:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981148032 00000100:00100000:1.0:1788541254.928995:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788541254.929002:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683570a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+13:17929:x1875420981148032:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788541254.929009:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541254.929018:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6706956400/0x2aac941e5f4a88d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a88d1 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541254.929033:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6706956400/0x2aac941e5f4a88d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a88d1 expref: 14 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541254.929042:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6706956400/0x2aac941e5f4a88d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a88d1 expref: 14 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541254.929060:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6706956400, rc 0) 00000100:00100000:1.0:1788541254.929088:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683570a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+14:17929:x1875420981148032:12345-0@lo:101:mount.lustre.0 Request processed in 87us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541254.929094:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788541254.929232:0:17929:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706833b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17929:1875420981148032:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788541254.929244:0:17929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a67075ade00/0x2aac941e5f4a88d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a88d8 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541254.929251:0:17929:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a67075ade00/0x2aac941e5f4a88d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a88d8 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541254.929262:0:17929:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788541254.929277:0:17929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a67075ade00/0x2aac941e5f4a88d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a88d8 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541254.929284:0:17929:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a67075ade00/0x2aac941e5f4a88d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a88d8 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541254.929289:0:17929:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788541254.929298:0:17929:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788541254.929302:0:17929:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9a683f356800 10000000:01000000:3.0:1788541254.929305:0:17929:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788541254.929308:0:17929:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1788541254.929310:0:17929:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788541254.929325:0:17929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a67075aca00/0x2aac941e5f4a88df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541254.929331:0:17929:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a67075aca00/0x2aac941e5f4a88df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541254.929418:0:17929:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a67075aca00/0x2aac941e5f4a88df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541254.929431:0:17929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706833b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17929:1875420981148160:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788541254.929459:0:17929:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541254.929477:0:17929:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68042ddb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788541254.929568:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981148160 00000100:00100000:1.0:1788541254.929572:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981148160 00000100:00100000:1.0:1788541254.929589:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788541254.929596:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+14:17929:x1875420981148160:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788541254.929603:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541254.929612:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6706956a00/0x2aac941e5f4a88e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a88df expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541254.929627:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6706956a00/0x2aac941e5f4a88e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a88df expref: 15 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541254.929635:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6706956a00/0x2aac941e5f4a88e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a88df expref: 15 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541254.929666:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6706956a00, rc 0) 00000100:00100000:1.0:1788541254.929705:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+15:17929:x1875420981148160:12345-0@lo:101:mount.lustre.0 Request processed in 109us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541254.929710:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788541254.929922:0:17929:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706833b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17929:1875420981148160:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788541254.929933:0:17929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a67075aca00/0x2aac941e5f4a88df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a88e6 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541254.929941:0:17929:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a67075aca00/0x2aac941e5f4a88df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a88e6 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788541254.932461:0:17929:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:3.0:1788541254.936887:0:17929:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788541254.942486:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788541254.942552:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1788541254.942569:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1788541254.942584:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1788541254.942616:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:3.0:1788541254.942631:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:3.0:1788541254.942773:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:3.0:1788541254.942793:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1788541254.942808:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1788541254.942823:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:3.0:1788541254.942835:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:3.0:1788541254.942848:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:3.0:1788541254.942860:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:3.0:1788541254.942946:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1788541254.942962:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1788541254.942976:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:3.0:1788541254.942989:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1788541254.943003:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1788541254.943016:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:3.0:1788541254.943031:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1788541254.943108:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1788541254.943130:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1788541254.943145:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1788541254.943172:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:3.0:1788541254.943179:0:17929:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:3.0:1788541254.943309:0:17929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706833b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17929:1875420981148288:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788541254.943378:0:17929:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541254.943426:0:17929:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68042dd480 going to sleep for 11 seconds 00000100:00100000:1.0:1788541254.943557:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981148288 00000100:00100000:1.0:1788541254.943565:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981148288 00000100:00100000:1.0:1788541254.943620:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788541254.943630:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+15:17929:x1875420981148288:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788541254.943789:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+15:17929:x1875420981148288:12345-0@lo:501:mount.lustre.0 Request processed in 160us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541254.943797:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788541254.944143:0:17929:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706833b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17929:1875420981148288:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788541254.944180:0:17929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706833b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17929:1875420981148416:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788541254.944242:0:17929:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541254.944316:0:17929:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68042dd480 going to sleep for 11 seconds 00000100:00100000:0.0:1788541254.945192:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981148416 00000100:00100000:0.0:1788541254.945201:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981148416 00000100:00100000:0.0:1788541254.945251:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788541254.945260:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+15:17929:x1875420981148416:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788541254.948832:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+15:17929:x1875420981148416:12345-0@lo:503:mount.lustre.0 Request processed in 3562us (4578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541254.948848:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788541254.949038:0:17929:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706833b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17929:1875420981148416:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788541254.949609:0:17929:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788541254.949834:0:17929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706833b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17929:1875420981148544:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788541254.949931:0:17929:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541254.949975:0:17929:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68042ddb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788541254.950343:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981148544 00000100:00100000:2.0:1788541254.950351:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981148544 00000100:00100000:2.0:1788541254.950453:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788541254.950464:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+15:17929:x1875420981148544:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788541254.951692:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+15:17929:x1875420981148544:12345-0@lo:502:mount.lustre.0 Request processed in 1225us (1756us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541254.951702:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788541254.951793:0:17929:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706833b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17929:1875420981148544:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788541254.952043:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788541254.952090:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:3.0:1788541254.952109:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:3.0:1788541254.952122:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:3.0:1788541254.952135:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:3.0:1788541254.952149:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:3.0:1788541254.952175:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:3.0:1788541254.952189:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:3.0:1788541254.952203:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:3.0:1788541254.952216:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:3.0:1788541254.952242:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:3.0:1788541254.952258:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:3.0:1788541254.952271:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:3.0:1788541254.952282:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:3.0:1788541254.952296:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:3.0:1788541254.952308:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:3.0:1788541254.952319:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:3.0:1788541254.952330:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:3.0:1788541254.952354:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:3.0:1788541254.952368:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:3.0:1788541254.952382:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:3.0:1788541254.952395:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:3.0:1788541254.952433:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:3.0:1788541254.952450:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:3.0:1788541254.952461:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:3.0:1788541254.952484:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:3.0:1788541254.952497:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:3.0:1788541254.952511:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:3.0:1788541254.952524:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:3.0:1788541254.952537:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:3.0:1788541254.952550:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:3.0:1788541254.952562:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:3.0:1788541254.952575:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:3.0:1788541254.952588:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:3.0:1788541254.952601:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:3.0:1788541254.952613:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:3.0:1788541254.952626:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:3.0:1788541254.952638:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:3.0:1788541254.952665:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:3.0:1788541254.952681:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:3.0:1788541254.952694:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:3.0:1788541254.952705:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:3.0:1788541254.952717:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:3.0:1788541254.952730:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:3.0:1788541254.952770:0:17929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706833b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17929:1875420981148672:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788541254.952828:0:17929:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541254.953811:0:17929:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68042ddb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788541254.953929:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981148672 00000100:00100000:1.0:1788541254.953938:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981148672 00000100:00100000:1.0:1788541254.953985:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788541254.953994:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+15:17929:x1875420981148672:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788541254.954138:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+15:17929:x1875420981148672:12345-0@lo:502:mount.lustre.0 Request processed in 144us (1309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541254.954145:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788541254.954252:0:17929:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706833b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17929:1875420981148672:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788541254.954316:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:3.0:1788541254.954327:0:17929:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1788541254.955383:0:17933:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788541254.955396:0:17933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541254.955399:0:17933:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788541254.955404:0:17933:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1788541254.955407:0:17933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788541254.955421:0:17933:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9a683ec10000) 00000020:00000080:3.0:1788541254.955454:0:17933:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1788541254.955461:0:17933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788541254.955554:0:17933:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788541254.955562:0:17933:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2aac941e5f4a88f4 00000020:00000080:3.0:1788541254.955787:0:17933:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788541254.955792:0:17933:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788541254.956018:0:17933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541254.956021:0:17933:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788541254.956026:0:17933:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788541254.956031:0:17933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541254.956032:0:17933:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1788541254.956036:0:17933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788541254.956055:0:17933:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9a683ec14d40) 00000020:00000080:3.0:1788541254.956068:0:17933:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1788541254.956073:0:17933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788541254.956075:0:17933:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1788541254.956078:0:17933:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1788541254.956084:0:17933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788541254.956131:0:17933:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a683f356800 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1788541254.956153:0:17933:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9a680599cd40) 00000020:00000080:3.0:1788541254.956163:0:17933:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1788541254.956238:0:17933:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788541254.956244:0:17933:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2aac941e5f4a8909 00000020:00000080:3.0:1788541254.956491:0:17933:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1788541254.956500:0:17933:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788541254.956507:0:17933:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x2aac941e5f4a8910 00080000:01000000:3.0:1788541254.956513:0:17933:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788541254.956517:0:17933:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2aac941e5f4a8917 00000100:00100000:1.0:1788541254.985956:0:17239:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683549ae40 going to sleep for 0 seconds 00010000:00010000:2.0:1788541255.052271:0:17933:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1788541255.053024:0:17933:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:2.0:1788541255.053541:0:17933:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788541255.058946:0:17933:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1788541255.058961:0:17933:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788541255.058969:0:17933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541255.058972:0:17933:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1788541255.058975:0:17933:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788541255.058995:0:17933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541255.058997:0:17933:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1788541255.059001:0:17933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788541255.059006:0:17933:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.156@tcp to nid 0x20000c0a8ca9c (192.168.202.156@tcp) 00000020:00000080:3.0:1788541255.059034:0:17933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788541255.059064:0:17933:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9a68059999c0) 00000020:00000080:3.0:1788541255.059087:0:17933:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1788541255.059092:0:17933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788541255.059172:0:17933:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1788541255.059177:0:17933:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788541255.059182:0:17933:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2aac941e5f4a8925 00010000:00080000:3.0:1788541255.059232:0:17933:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a6707aa2000@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.156@tcp at head 00010000:00010000:0.0:1788541255.075309:0:17933:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1788541255.078675:0:17933:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788541255.078693:0:17933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788541255.078735:0:17933:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788541255.078757:0:17933:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2aac941e5f4a892c 00000100:00080000:1.0:1788541255.078769:0:17933:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788541255.078775:0:17933:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9a6707aa2000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:1.0:1788541255.078830:0:17933:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a670835ea00 x1875420981148800/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788541255.079185:0:17933:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1788541255.079264:0:17933:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788541255.079268:0:17933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541255.079270:0:17933:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1788541255.079273:0:17933:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788541255.079276:0:17933:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788541255.079278:0:17933:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788541255.079280:0:17933:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788541255.079281:0:17933:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788541255.079283:0:17933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541255.079285:0:17933:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788541255.079287:0:17933:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788541255.079292:0:17933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541255.079293:0:17933:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1788541255.079297:0:17933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788541255.079332:0:17933:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788541255.079344:0:17933:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788541255.079348:0:17933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541255.079349:0:17933:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1788541255.079352:0:17933:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788541255.079353:0:17933:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:1.0:1788541255.079355:0:17933:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788541255.079356:0:17933:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788541255.079358:0:17933:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788541255.079360:0:17933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541255.079362:0:17933:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000100:00080000:3.0:1788541255.079452:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788541255.079458:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788541255.079461:0:38:0:(import.c:65:import_set_state_nolock()) ffff9a670774b000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788541255.079466:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 531 00000100:00080000:3.0:1788541255.079470:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788541255.079474:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a670774b000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:3.0:1788541255.079491:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6706833b80 x1875420981148928/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788541255.079503:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788541255.079506:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788541255.079509:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788541255.079511:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788541255.079555:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875420981149056:0@lo:400:kworker.0 00000100:00100000:3.0:1788541255.079621:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541255.079713:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981149056 00000100:00100000:3.0:1788541255.079720:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981149056 00000100:00100000:3.0:1788541255.079761:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788541255.079769:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875420981149056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541255.079831:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875420981149056:12345-0@lo:400:kworker.0 Request processed in 61us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541255.079837:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788541255.079892:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a6706830380 x1875420981149056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541255.079904:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875420981149056:0@lo:400:kworker.0 00000020:01000000:1.0:1788541255.080111:0:17933:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788541255.080117:0:17933:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788541255.080123:0:17933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541255.080125:0:17933:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788541255.080130:0:17933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788541255.080135:0:17933:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.156@tcp to nid 0x20000c0a8ca9c (192.168.202.156@tcp) 00000020:01000000:1.0:1788541255.080162:0:17933:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788541255.080166:0:17933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788541255.080181:0:17933:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9a67069599c0) 00000020:00000080:1.0:1788541255.080196:0:17933:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1788541255.080203:0:17933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788541255.080283:0:17933:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1788541255.080290:0:17933:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788541255.080297:0:17933:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2aac941e5f4a893a 00010000:00080000:1.0:1788541255.080326:0:17933:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a682fdc6000@lustre-OST0000-osc-MDT0001: add connection 192.168.202.156@tcp at head 00000100:00100000:0.0:1788541255.080752:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981148800:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788541255.080813:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541255.080855:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981148928:0@lo:38:kworker.0 00000100:00100000:0.0:1788541255.080909:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541255.080946:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981148800 00000100:00100000:0.0:1788541255.080951:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981148800 00000100:00100000:0.0:1788541255.080966:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981148928 00000100:00100000:0.0:1788541255.080968:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981148928 00000100:00100000:0.0:1788541255.080980:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788541255.080985:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875420981148800:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788541255.081015:0:17203:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 535 last 0 00000020:00000080:0.0:1788541255.081056:0:17203:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2aac941e5f4a8941 00000004:00100000:0.0:1788541255.081072:0:17203:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788541255.081078:0:17203:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:1.0:1788541255.081761:0:17933:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:1.0:1788541255.084314:0:17933:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788541255.084552:0:17933:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1788541255.087152:0:17933:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788541255.087378:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1788541255.087524:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000100:00080000:1.0:1788541255.088130:0:17203:0:(import.c:65:import_set_state_nolock()) ffff9a682fdc2800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788541255.088233:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1875420981148800:12345-0@lo:38:llog_process_th.0 Request processed in 7236us (7409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541255.088245:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788541255.088275:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788541255.088282:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875420981148928:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788541255.088338:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875420981148928:12345-0@lo:38:kworker.0 Request processed in 56us (7428us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788541255.088344:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788541255.088425:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788541255.088436:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1788541255.088444:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788541255.088449:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788541255.088452:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a6707aa2000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788541255.088470:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981148800:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788541255.088484:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788541255.088487:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a670774b000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788541255.088491:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788541255.088494:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981148928:0@lo:38:kworker.0 00000100:00100000:0.0:1788541255.088669:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000040:00080000:2.0:1788541255.089183:0:17938:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788541255.089188:0:17938:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788541255.089919:0:17933:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788541255.089932:0:17933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788541255.089971:0:17933:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788541255.089992:0:17933:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2aac941e5f4a8948 00000100:00080000:1.0:1788541255.090002:0:17933:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788541255.090009:0:17933:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9a682fdc6000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:1.0:1788541255.090057:0:17933:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a670835d500 x1875420981149312/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788541255.090084:0:17933:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788541255.090129:0:17933:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788541255.090133:0:17933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541255.090135:0:17933:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788541255.090138:0:17933:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788541255.090141:0:17933:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1788541255.090142:0:17933:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788541255.090143:0:17933:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788541255.090145:0:17933:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788541255.090147:0:17933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541255.090149:0:17933:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788541255.090151:0:17933:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788541255.090156:0:17933:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788541255.090159:0:17933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541255.090160:0:17933:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788541255.090163:0:17933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788541255.090166:0:17933:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.156@tcp to nid 0x20000c0a8ca9c (192.168.202.156@tcp) 00000020:01000000:1.0:1788541255.090188:0:17933:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788541255.090191:0:17933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788541255.090202:0:17933:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9a670695b380) 00000020:00000080:1.0:1788541255.090214:0:17933:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1788541255.090219:0:17933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788541255.090285:0:17933:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1788541255.090293:0:17933:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788541255.090298:0:17933:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x2aac941e5f4a8956 00010000:00080000:1.0:1788541255.090327:0:17933:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a68097af000@lustre-OST0001-osc-MDT0001: add connection 192.168.202.156@tcp at head 00010000:00010000:1.0:1788541255.090565:0:17933:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1788541255.090632:0:17933:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788541255.090649:0:17933:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:2.0:1788541255.091179:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981149312:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788541255.091252:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875420981149312 offset 0 length 520: 4 00000100:00100000:0.0:1788541255.092177:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4746c063-6c88-4476-b99b-02bb8e8d54f7:3642:1875420981149440:0@lo:400:kworker.0 00000100:00100000:0.0:1788541255.092238:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541255.092276:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981149184:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788541255.092300:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541255.092335:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981149184 00000100:00100000:0.0:1788541255.092342:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981149184 00000100:00100000:0.0:1788541255.092388:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788541255.092396:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1875420981149184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788541255.092431:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788541255.092514:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1875420981149184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541255.092528:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788541255.092577:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981149184:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788541255.092654:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981149440 00000100:00100000:2.0:1788541255.092659:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981149440 00000100:00100000:2.0:1788541255.092695:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788541255.092702:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+15:3642:x1875420981149440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541255.092740:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+15:3642:x1875420981149440:12345-0@lo:400:kworker.0 Request processed in 39us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541255.092746:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000040:00080000:2.0:1788541255.093766:0:17933:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788541255.094218:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1788541255.094415:0:17933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000100:00100000:0.0:1788541255.094658:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4746c063-6c88-4476-b99b-02bb8e8d54f7:3642:1875420981149440:0@lo:400:kworker.0 00000040:00080000:2.0:1788541255.095080:0:17940:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788541255.095085:0:17940:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788541255.095774:0:17933:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788541255.095786:0:17933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788541255.095966:0:17933:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788541255.095991:0:17933:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2aac941e5f4a895d 00000100:00080000:2.0:1788541255.096002:0:17933:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788541255.096009:0:17933:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a68097af000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:2.0:1788541255.096121:0:17933:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a67080d5c00 x1875420981149568/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788541255.096202:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981149568:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788541255.096279:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875420981149568 offset 0 length 520: 4 00000100:00080000:3.0:1788541255.096518:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788541255.096523:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788541255.096526:0:38:0:(import.c:65:import_set_state_nolock()) ffff9a670774b000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788541255.096532:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a670774b000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:3.0:1788541255.096549:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6706830000 x1875420981149696/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788541255.096560:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788541255.096564:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788541255.096566:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788541255.096569:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788541255.096604:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706831500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875420981149824:0@lo:400:kworker.0 00000100:00100000:3.0:1788541255.096638:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541255.096682:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981149824 00000100:00100000:3.0:1788541255.096688:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981149824 00000100:00100000:3.0:1788541255.096774:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788541255.096810:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875420981149824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541255.096902:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875420981149824:12345-0@lo:400:kworker.0 Request processed in 71us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541255.096924:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788541255.096998:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a6706831500 x1875420981149824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541255.097024:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706831500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875420981149824:0@lo:400:kworker.0 00000100:00100000:0.0:1788541255.097549:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981149696:0@lo:38:kworker.0 00000100:00100000:0.0:1788541255.097584:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541255.098618:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981149696 00000100:00100000:3.0:1788541255.098625:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981149696 00000100:00100000:3.0:1788541255.098685:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788541255.098700:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875420981149696:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788541255.099174:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3640:x1875420981149696:12345-0@lo:38:kworker.0 Request processed in 472us (1588us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788541255.099182:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788541255.099305:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a670774b000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788541255.099310:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788541255.099313:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981149696:0@lo:38:kworker.0 00000100:00080000:2.0:1788541255.099518:0:17933:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788541255.099658:0:17933:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788541255.099666:0:17933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788541255.099668:0:17933:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788541255.099671:0:17933:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788541255.099676:0:17933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788541255.099677:0:17933:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788541255.099697:0:17933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788541255.099699:0:17933:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788541255.099702:0:17933:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788541255.099704:0:17933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788541255.099705:0:17933:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788541255.099708:0:17933:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788541255.099710:0:17933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788541255.099711:0:17933:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788541255.099715:0:17933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788541255.099753:0:17933:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788541255.099757:0:17933:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788541255.099758:0:17933:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788541255.099762:0:17933:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:0.0:1788541255.100321:0:17929:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1788541255.100352:0:17929:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788541255.100375:0:17929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a67075aca00/0x2aac941e5f4a88df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a88e6 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541255.100387:0:17929:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a67075aca00/0x2aac941e5f4a88df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a88e6 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788541255.100395:0:17929:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a683f356800 from 1 10000000:01000000:0.0:1788541255.100398:0:17929:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788541255.100436:0:17929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6800031600/0x2aac941e5f4a8964 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541255.100444:0:17929:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a6800031600/0x2aac941e5f4a8964 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541255.100455:0:17929:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a6800031600/0x2aac941e5f4a8964 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541255.100479:0:17929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17929:1875420981149952:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788541255.100539:0:17929:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788541255.100608:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788541255.100613:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788541255.100615:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788541255.100618:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788541255.100734:0:17929:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68076fbf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788541255.106289:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981149952 00000100:00100000:2.0:1788541255.106307:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981149952 00000100:00100000:2.0:1788541255.106371:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788541255.106382:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+15:17929:x1875420981149952:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788541255.106399:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541255.106420:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a683551a000/0x2aac941e5f4a896b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a8964 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541255.106447:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a683551a000/0x2aac941e5f4a896b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a8964 expref: 16 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541255.106458:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a683551a000/0x2aac941e5f4a896b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a8964 expref: 16 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541255.106466:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a683551a000, rc 0) 00000100:00100000:2.0:1788541255.106540:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+16:17929:x1875420981149952:12345-0@lo:101:mount.lustre.0 Request processed in 161us (6001us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541255.106547:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788541255.106788:0:17929:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17929:1875420981149952:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788541255.106821:0:17929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a6800031600/0x2aac941e5f4a8964 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a896b expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541255.106831:0:17929:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a6800031600/0x2aac941e5f4a8964 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a896b expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541255.107597:0:17929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17929:1875420981150080:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788541255.107714:0:17929:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541255.107754:0:17929:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68076fbf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788541255.107950:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981150080 00000100:00100000:2.0:1788541255.107956:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981150080 00000100:00100000:2.0:1788541255.107989:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788541255.107996:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+16:17929:x1875420981150080:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788541255.108013:0:17191:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788541255.108030:0:17191:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788541255.108034:0:17191:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788541255.108455:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+16:17929:x1875420981150080:12345-0@lo:256:mount.lustre.0 Request processed in 458us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541255.108463:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788541255.115204:0:17929:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17929:1875420981150080:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788541255.115828:0:17929:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788541255.115848:0:17929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6800031600/0x2aac941e5f4a8964 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a896b expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541255.115859:0:17929:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a6800031600/0x2aac941e5f4a8964 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a896b expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788541255.115889:0:17929:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a683f356800 from 1 10000000:01000000:1.0:1788541255.115893:0:17929:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788541255.115929:0:17929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6706957600/0x2aac941e5f4a8972 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541255.115938:0:17929:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a6706957600/0x2aac941e5f4a8972 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541255.115948:0:17929:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a6706957600/0x2aac941e5f4a8972 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541255.115970:0:17929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17929:1875420981150208:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788541255.116035:0:17929:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541255.116478:0:17929:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707873840 going to sleep for 11 seconds 00000100:00100000:2.0:1788541255.121263:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981150208 00000100:00100000:2.0:1788541255.121277:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981150208 00000100:00100000:3.0:1788541255.121415:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788541255.121425:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+16:17929:x1875420981150208:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788541255.121442:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541255.121459:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a67075ac800/0x2aac941e5f4a8979 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a8972 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541255.121506:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a67075ac800/0x2aac941e5f4a8979 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a8972 expref: 17 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541255.121516:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a67075ac800/0x2aac941e5f4a8979 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a8972 expref: 17 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541255.121525:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075ac800, rc 0) 00000100:00100000:3.0:1788541255.121600:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+17:17929:x1875420981150208:12345-0@lo:101:mount.lustre.0 Request processed in 177us (5566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541255.121607:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788541255.121791:0:17929:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17929:1875420981150208:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788541255.121825:0:17929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a6706957600/0x2aac941e5f4a8972 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8979 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541255.121844:0:17929:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a6706957600/0x2aac941e5f4a8972 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a8979 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788541255.122010:0:17929:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788541255.122293:0:17929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17929:1875420981150336:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788541255.122338:0:17929:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541255.122376:0:17929:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67078736c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788541255.122434:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981150336 00000100:00100000:0.0:1788541255.122440:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981150336 00000100:00100000:0.0:1788541255.122479:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788541255.122486:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+17:17929:x1875420981150336:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788541255.122583:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+17:17929:x1875420981150336:12345-0@lo:501:mount.lustre.0 Request processed in 96us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541255.122590:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788541255.123762:0:17929:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17929:1875420981150336:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788541255.123819:0:17929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17929:1875420981150464:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788541255.123906:0:17929:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541255.123935:0:17929:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67078736c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788541255.124026:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981150464 00000100:00100000:2.0:1788541255.124032:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981150464 00000100:00100000:2.0:1788541255.124079:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788541255.124087:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+17:17929:x1875420981150464:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788541255.124187:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+17:17929:x1875420981150464:12345-0@lo:503:mount.lustre.0 Request processed in 100us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541255.124195:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788541255.124412:0:17929:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17929:1875420981150464:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788541255.125758:0:17929:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788541255.126608:0:17929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17929:1875420981150592:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788541255.126753:0:17929:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541255.126792:0:17929:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707873840 going to sleep for 11 seconds 00000100:00100000:3.0:1788541255.126912:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981150592 00000100:00100000:3.0:1788541255.126918:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981150592 00000100:00100000:3.0:1788541255.126967:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788541255.126977:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+17:17929:x1875420981150592:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788541255.127109:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+17:17929:x1875420981150592:12345-0@lo:502:mount.lustre.0 Request processed in 132us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541255.127117:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788541255.127571:0:17929:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17929:1875420981150592:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788541255.127833:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788541255.127864:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:0.0:1788541255.134915:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:0.0:1788541255.134952:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:0.0:1788541255.134968:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:0.0:1788541255.134984:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:0.0:1788541255.134998:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:0.0:1788541255.135013:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:0.0:1788541255.135028:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788541255.135040:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:0.0:1788541255.135272:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:0.0:1788541255.135343:0:17929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17929:1875420981150720:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788541255.135428:0:17929:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541255.135480:0:17929:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68076fbf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788541255.136595:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981150720 00000100:00100000:3.0:1788541255.136607:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981150720 00000100:00100000:3.0:1788541255.136683:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788541255.136693:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+17:17929:x1875420981150720:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788541255.136907:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+17:17929:x1875420981150720:12345-0@lo:502:mount.lustre.0 Request processed in 215us (1479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541255.136915:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788541255.137061:0:17929:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17929:1875420981150720:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788541255.137141:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:2.0:1788541255.137154:0:17929:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788541255.137710:0:17942:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788541255.137719:0:17942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788541255.137722:0:17942:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788541255.137729:0:17942:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a683f356800 00000020:00000080:2.0:1788541255.137732:0:17942:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788541255.137740:0:17942:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788541255.137743:0:17942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788541255.137750:0:17942:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788541255.137754:0:17942:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788541255.137757:0:17942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788541255.137758:0:17942:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788541255.137762:0:17942:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a683f356800 00000020:00000080:2.0:1788541255.137764:0:17942:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788541255.137830:0:17942:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788541255.137834:0:17942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788541255.137836:0:17942:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788541255.137838:0:17942:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788541255.137841:0:17942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788541255.137846:0:17942:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788541255.137850:0:17942:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a683f356800 00000020:00000080:2.0:1788541255.137852:0:17942:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788541255.137888:0:17942:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788541255.137891:0:17942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788541255.137893:0:17942:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788541255.137895:0:17942:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788541255.137897:0:17942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788541255.137898:0:17942:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788541255.137901:0:17942:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a683f356800 00000020:00000080:2.0:1788541255.137903:0:17942:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788541255.137926:0:17942:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788541255.137929:0:17942:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788541255.137931:0:17942:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788541255.137933:0:17942:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:3.0:1788541255.138071:0:17929:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788541255.138096:0:17929:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788541255.138123:0:17929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6706957600/0x2aac941e5f4a8972 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8979 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541255.138134:0:17929:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a6706957600/0x2aac941e5f4a8972 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8979 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541255.138181:0:17929:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788541255.138184:0:17929:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a683f356800 10000000:01000000:3.0:1788541255.138187:0:17929:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a683f356800 10000000:01000000:3.0:1788541255.138191:0:17929:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788541255.138196:0:17929:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a683f356800 from 1 10000000:01000000:3.0:1788541255.138199:0:17929:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788541255.138238:0:17929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a67075ad400/0x2aac941e5f4a8980 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541255.138247:0:17929:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a67075ad400/0x2aac941e5f4a8980 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541255.138257:0:17929:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a67075ad400/0x2aac941e5f4a8980 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541255.138281:0:17929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706831500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17929:1875420981150848:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788541255.138334:0:17929:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541255.138365:0:17929:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68042ddc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788541255.138463:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981150848 00000100:00100000:2.0:1788541255.138468:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981150848 00000100:00100000:2.0:1788541255.138507:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788541255.138514:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+17:17929:x1875420981150848:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788541255.138523:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541255.138535:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a683551a600/0x2aac941e5f4a8987 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a8980 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541255.138561:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a683551a600/0x2aac941e5f4a8987 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a8980 expref: 18 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541255.138572:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a683551a600/0x2aac941e5f4a8987 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a8980 expref: 18 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541255.138580:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a683551a600, rc 0) 00000100:00100000:2.0:1788541255.138611:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+18:17929:x1875420981150848:12345-0@lo:101:mount.lustre.0 Request processed in 97us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541255.138617:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788541255.138750:0:17929:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706831500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17929:1875420981150848:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788541255.138764:0:17929:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a67075ad400/0x2aac941e5f4a8980 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8987 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541255.138773:0:17929:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a67075ad400/0x2aac941e5f4a8980 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a8987 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788541255.141696:0:17929:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1788541255.142023:0:17929:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788541255.142356:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1788541255.142381:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:3.0:1788541255.142395:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:3.0:1788541255.142408:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:3.0:1788541255.142422:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:3.0:1788541255.142434:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:3.0:1788541255.142463:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:3.0:1788541255.142480:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:3.0:1788541255.142495:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:3.0:1788541255.142509:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:3.0:1788541255.142522:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:3.0:1788541255.142534:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:3.0:1788541255.142546:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:3.0:1788541255.142558:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:3.0:1788541255.142574:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:3.0:1788541255.142587:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:3.0:1788541255.142600:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:3.0:1788541255.142614:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:3.0:1788541255.142627:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:3.0:1788541255.142640:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:3.0:1788541255.142653:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:3.0:1788541255.142667:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:3.0:1788541255.142695:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:3.0:1788541255.142710:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:3.0:1788541255.142724:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:3.0:1788541255.142737:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:3.0:1788541255.142750:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:3.0:1788541255.142762:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:3.0:1788541255.142780:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:3.0:1788541255.144149:0:17929:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1788541255.144307:0:17929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706831500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17929:1875420981150976:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788541255.144376:0:17929:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541255.144419:0:17929:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68042dd780 going to sleep for 11 seconds 00000100:00100000:2.0:1788541255.144519:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981150976 00000100:00100000:2.0:1788541255.144526:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981150976 00000100:00100000:2.0:1788541255.144573:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788541255.144583:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+18:17929:x1875420981150976:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788541255.144719:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+18:17929:x1875420981150976:12345-0@lo:501:mount.lustre.0 Request processed in 137us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541255.144727:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788541255.149352:0:17929:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706831500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17929:1875420981150976:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788541255.149417:0:17929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706831500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17929:1875420981151104:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788541255.149488:0:17929:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541255.149528:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981151104 00000100:00100000:3.0:1788541255.149535:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981151104 00000100:00100000:3.0:1788541255.149581:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788541255.149590:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68378a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+18:17929:x1875420981151104:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788541255.149696:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68378a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+18:17929:x1875420981151104:12345-0@lo:503:mount.lustre.0 Request processed in 107us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541255.149705:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788541255.149760:0:17929:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68042dd780 going to sleep for 11 seconds 00000100:00100000:3.0:1788541255.149772:0:17929:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706831500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17929:1875420981151104:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788541255.150243:0:17929:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788541255.150312:0:17929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706831500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17929:1875420981151232:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788541255.150351:0:17929:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541255.150380:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981151232 00000100:00100000:3.0:1788541255.150384:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981151232 00000100:00100000:3.0:1788541255.150407:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788541255.150413:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68378a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+18:17929:x1875420981151232:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788541255.150490:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68378a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+18:17929:x1875420981151232:12345-0@lo:502:mount.lustre.0 Request processed in 75us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541255.150506:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788541255.150554:0:17929:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68042ddc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788541255.150568:0:17929:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706831500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17929:1875420981151232:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788541255.150727:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788541255.150751:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:3.0:1788541255.150765:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:3.0:1788541255.150778:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:3.0:1788541255.150788:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:3.0:1788541255.150801:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:3.0:1788541255.150814:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:3.0:1788541255.150840:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:3.0:1788541255.150855:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:3.0:1788541255.150895:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:3.0:1788541255.150914:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:3.0:1788541255.150926:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:3.0:1788541255.150937:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:3.0:1788541255.150949:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:3.0:1788541255.150961:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:3.0:1788541255.150975:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:3.0:1788541255.150988:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:3.0:1788541255.150999:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:3.0:1788541255.151010:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:3.0:1788541255.151022:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:3.0:1788541255.151033:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:3.0:1788541255.151046:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:3.0:1788541255.151058:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:3.0:1788541255.151083:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:3.0:1788541255.151099:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:3.0:1788541255.151110:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:3.0:1788541255.151123:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:3.0:1788541255.151145:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:3.0:1788541255.151157:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:3.0:1788541255.151168:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:3.0:1788541255.151180:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:3.0:1788541255.151191:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:3.0:1788541255.151204:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:3.0:1788541255.151214:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:3.0:1788541255.158102:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:3.0:1788541255.158150:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:3.0:1788541255.158167:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:3.0:1788541255.158181:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:3.0:1788541255.158194:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:3.0:1788541255.158237:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:3.0:1788541255.158253:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:3.0:1788541255.158362:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:3.0:1788541255.158379:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:3.0:1788541255.158392:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:3.0:1788541255.158405:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:3.0:1788541255.158419:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:3.0:1788541255.158431:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:3.0:1788541255.158442:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:3.0:1788541255.158505:0:17929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706831500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17929:1875420981151360:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788541255.158586:0:17929:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541255.158627:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981151360 00000100:00100000:3.0:1788541255.158634:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981151360 00000100:00100000:3.0:1788541255.158679:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788541255.158688:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68378a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+18:17929:x1875420981151360:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788541255.158790:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68378a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+18:17929:x1875420981151360:12345-0@lo:502:mount.lustre.0 Request processed in 102us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541255.161130:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788541255.161248:0:17929:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68042ddc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788541255.161282:0:17929:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706831500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17929:1875420981151360:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788541255.161509:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:3.0:1788541255.161538:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:3.0:1788541255.161581:0:17929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706831500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17929:1875420981151488:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788541255.161645:0:17929:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541255.162957:0:17929:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68042ddc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788541255.169098:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981151488 00000100:00100000:0.0:1788541255.169116:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981151488 00000100:00100000:0.0:1788541255.169216:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788541255.169238:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68378a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+18:17929:x1875420981151488:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788541255.169843:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68378a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+18:17929:x1875420981151488:12345-0@lo:502:mount.lustre.0 Request processed in 607us (8197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541255.170102:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788541255.170246:0:17929:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706831500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17929:1875420981151488:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788541255.170959:0:17929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:2.0:1788541255.170971:0:17929:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788541255.173765:0:17947:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1788541255.173782:0:17947:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9a682e74b380) 00000020:00000080:2.0:1788541255.173809:0:17947:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1788541255.176341:0:17947:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a683f356800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788541255.176350:0:17947:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a683f356800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788541255.176353:0:17947:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a683f356800 3 00010000:00080000:2.0:1788541255.176387:0:17947:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a682ff9a800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.156@tcp at head 00010000:00010000:2.0:1788541255.177542:0:17947:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1788541255.177701:0:17947:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1788541255.177727:0:17947:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788541255.177739:0:17947:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x2aac941e5f4a8995 00000100:00080000:2.0:1788541255.177747:0:17947:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788541255.177752:0:17947:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9a682ff9a800 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:2.0:1788541255.177780:0:17947:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a67080d5880 x1875420981151616/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788541255.177821:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875420981151616:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788541255.177914:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788541255.177971:0:17947:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788541255.183890:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788541255.183899:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788541255.183903:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788541255.183906:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1788541255.183910:0:17947:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000100:00100000:1.0:1788541255.183957:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981151616 00000100:00100000:1.0:1788541255.183968:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981151616 00000100:00100000:1.0:1788541255.184014:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788541255.184023:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3640:x1875420981151616:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788541255.184064:0:17199:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 536 last 0 00000020:00000080:1.0:1788541255.184098:0:17199:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x2aac941e5f4a899c 00000004:00100000:1.0:1788541255.184115:0:17199:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788541255.184147:0:17199:0:(import.c:65:import_set_state_nolock()) ffff9a680a574000 : changing import state from RECOVER to FULL 00000020:01000000:0.0:1788541255.184179:0:17929:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788541255.184210:0:17929:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788541255.184239:0:17929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a67075ad400/0x2aac941e5f4a8980 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8987 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541255.184250:0:17929:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a67075ad400/0x2aac941e5f4a8980 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8987 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541255.184254:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1875420981151616:12345-0@lo:38:llog_process_th.0 Request processed in 229us (6338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541255.184267:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000004:0.0:1788541255.184308:0:17929:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788541255.184310:0:17929:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788541255.184311:0:17929:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788541255.184312:0:17929:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788541255.184314:0:17929:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788541255.184316:0:17929:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788541255.184318:0:17929:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788541255.184321:0:17929:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00010000:00080000:1.0:1788541255.184322:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a67080d5880 x1875420981151616/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788541265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000020:01000004:0.0:1788541255.184323:0:17929:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788541255.184329:0:17929:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:0.0:1788541255.184333:0:17929:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788541255.184335:0:17929:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788541255.184337:0:17929:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788541255.184338:0:17929:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000100:00100000:1.0:1788541255.184339:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000020:01000004:0.0:1788541255.184344:0:17929:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788541255.184346:0:17929:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788541255.184346:0:17929:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788541255.184347:0:17929:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788541255.184348:0:17929:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00080000:1.0:1788541255.184350:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1788541255.184359:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788541255.184364:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 10000000:01000000:0.0:1788541255.184366:0:17929:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00080000:1.0:1788541255.184367:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a682ff9a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788541255.184374:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3640:1875420981151616:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788541255.184382:0:17929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17929:1875420981151744:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788541255.184419:0:17929:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541255.184442:0:17929:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683530a840 going to sleep for 11 seconds 00000100:00100000:3.0:1788541255.184780:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981151744 00000100:00100000:3.0:1788541255.184784:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981151744 00000100:00100000:3.0:1788541255.184813:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788541255.184825:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68378a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+18:17929:x1875420981151744:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788541255.184841:0:17192:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788541255.184860:0:17192:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1788541255.189452:0:17178:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1788541255.191713:0:17192:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788541255.191729:0:17192:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1788541255.191836:0:17214:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788541255.191841:0:17214:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788541255.196069:0:17214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a6800030400/0x2aac941e5f4a89a3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541255.196100:0:17214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6800030200/0x2aac941e5f4a88a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a88a0 expref: 18 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541255.196109:0:17214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a683551a000/0x2aac941e5f4a896b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a8964 expref: 18 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541255.196118:0:17214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a6800030400/0x2aac941e5f4a89a3 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541255.196172:0:17214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a683551a000/0x2aac941e5f4a896b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a8964 expref: 18 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541255.196188:0:17214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a683551a000/0x2aac941e5f4a896b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a8964 expref: 18 pid: 17192 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541255.196202:0:17214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17214:1875420981151872:0@lo:104: 00000100:00100000:0.0:1788541255.196285:0:17214:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788541255.196361:0:17214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6800030200/0x2aac941e5f4a88a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a88a0 expref: 18 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541255.196370:0:17214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6800030200/0x2aac941e5f4a88a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a88a0 expref: 18 pid: 17192 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541255.196380:0:17214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17214:1875420981152000:0@lo:104: 00000100:00100000:0.0:1788541255.196402:0:17214:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541255.196420:0:17214:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683530a780 going to sleep for 11 seconds 00000100:00100000:0.0:1788541255.196460:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981151872 00000100:00100000:0.0:1788541255.196467:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981151872 00000100:00100000:0.0:1788541255.196504:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981152000 00000100:00100000:0.0:1788541255.196507:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981152000 00000100:00100000:0.0:1788541255.196522:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788541255.196531:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4746c063-6c88-4476-b99b-02bb8e8d54f7+4:17214:x1875420981151872:12345-0@lo:104: 00010000:00010000:0.0:1788541255.196546:0:17182:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a6800031600/0x2aac941e5f4a8964 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a896b expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541255.196602:0:17182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788541255.196609:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4746c063-6c88-4476-b99b-02bb8e8d54f7+4:17214:x1875420981151872:12345-0@lo:104: Request processed in 79us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541255.196615:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788541255.196635:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788541255.196641:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4746c063-6c88-4476-b99b-02bb8e8d54f7+3:17214:x1875420981152000:12345-0@lo:104: 00010000:00010000:0.0:1788541255.196648:0:17182:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a6706956e00/0x2aac941e5f4a88a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a88a7 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541255.196679:0:17182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788541255.196684:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4746c063-6c88-4476-b99b-02bb8e8d54f7+3:17214:x1875420981152000:12345-0@lo:104: Request processed in 44us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541255.196695:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788541255.196713:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788541255.196720:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a6800031600/0x2aac941e5f4a8964 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a896b expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541255.196726:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6800031600 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:0.0:1788541255.196732:0:17186:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a6800031600/0x2aac941e5f4a8964 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a896b expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541255.196740:0:17186:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a6800031600/0x2aac941e5f4a8964 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a896b expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788541255.196749:0:17186:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a6800031600/0x2aac941e5f4a8964 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a896b expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788541255.196756:0:17186:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788541255.196785:0:17186:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a6800031600/0x2aac941e5f4a8964 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a896b expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541255.196792:0:17186:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788541255.196814:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a6800031600/0x2aac941e5f4a8964 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a896b expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541255.196820:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a6800031600/0x2aac941e5f4a8964 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a896b expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541255.196833:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541255.196836:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a6706956e00/0x2aac941e5f4a88a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a88a7 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541255.196850:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706956e00 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:0.0:1788541255.196854:0:17186:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a6706956e00/0x2aac941e5f4a88a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a88a7 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541255.196860:0:17186:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a6706956e00/0x2aac941e5f4a88a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a88a7 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788541255.196866:0:17186:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a6706956e00/0x2aac941e5f4a88a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a88a7 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788541255.196894:0:17186:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788541255.196908:0:17186:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a6706956e00/0x2aac941e5f4a88a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a88a7 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541255.196914:0:17186:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788541255.196930:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a6706956e00/0x2aac941e5f4a88a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a88a7 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541255.196936:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a6706956e00/0x2aac941e5f4a88a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a88a7 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541255.196948:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541255.196949:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541255.196951:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541255.196957:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541255.196973:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4746c063-6c88-4476-b99b-02bb8e8d54f7:3644:1875420981152128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788541255.197000:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541255.197030:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4746c063-6c88-4476-b99b-02bb8e8d54f7:3641:1875420981152256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788541255.197060:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541255.197093:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981152128 00000100:00100000:0.0:1788541255.197097:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981152128 00010000:00010000:0.0:1788541255.197113:0:17183:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a683551a000/0x2aac941e5f4a896b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a8964 expref: 19 pid: 17192 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541255.197132:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981152256 00000100:00100000:0.0:1788541255.197135:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981152256 00010000:00010000:0.0:1788541255.197145:0:17183:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6800030200/0x2aac941e5f4a88a7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a88a0 expref: 20 pid: 17192 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541255.197156:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788541255.197162:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4746c063-6c88-4476-b99b-02bb8e8d54f7+20:3644:x1875420981152128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788541255.197172:0:17183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541255.197176:0:17183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a683551a000/0x2aac941e5f4a896b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a8964 expref: 20 pid: 17192 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541255.197186:0:17183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a683551a000/0x2aac941e5f4a896b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a8964 expref: 20 pid: 17192 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541255.197200:0:17183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541255.197238:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4746c063-6c88-4476-b99b-02bb8e8d54f7+20:3644:x1875420981152128:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541255.197245:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788541255.198305:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788541255.198318:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4746c063-6c88-4476-b99b-02bb8e8d54f7+19:3641:x1875420981152256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788541255.198331:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541255.198338:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6800030200/0x2aac941e5f4a88a7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a88a0 expref: 19 pid: 17192 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541255.198351:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6800030200/0x2aac941e5f4a88a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a88a0 expref: 19 pid: 17192 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541255.198369:0:17185:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a6800030400/0x2aac941e5f4a89a3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541255.198377:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6800030400/0x2aac941e5f4a89a3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788541255.198393:0:17185:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006552442s 00010000:00010000:2.0:1788541255.198405:0:17185:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6800030400/0x2aac941e5f4a89a3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541255.198413:0:17185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6800030400/0x2aac941e5f4a89a3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541255.198421:0:17185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a6800030400/0x2aac941e5f4a89a3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541255.198428:0:17185:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a6800030400/0x2aac941e5f4a89a3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541255.198433:0:17185:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6800030400 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:2.0:1788541255.198437:0:17185:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a6800030400/0x2aac941e5f4a89a3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541255.198445:0:17185:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a6800030400/0x2aac941e5f4a89a3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541255.198455:0:17185:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a6800030400/0x2aac941e5f4a89a3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541255.198467:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541255.198521:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4746c063-6c88-4476-b99b-02bb8e8d54f7+19:3641:x1875420981152256:12345-0@lo:103:ldlm_bl.0 Request processed in 206us (1459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541255.198529:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788541255.199314:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4746c063-6c88-4476-b99b-02bb8e8d54f7:3644:1875420981152128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788541255.199349:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4746c063-6c88-4476-b99b-02bb8e8d54f7:3641:1875420981152256:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788541255.199374:0:17214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a683551a000/0x2aac941e5f4a896b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a8964 expref: 18 pid: 17192 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541255.199399:0:17214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17214:1875420981151872:0@lo:104: 00010000:00010000:0.0:1788541255.199412:0:17214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6800030200/0x2aac941e5f4a88a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a88a0 expref: 17 pid: 17192 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541255.199421:0:17214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17214:1875420981152000:0@lo:104: 00010000:00010000:0.0:1788541255.199438:0:17214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a6800030400/0x2aac941e5f4a89a3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541255.199448:0:17214:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a6800030400/0x2aac941e5f4a89a3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541255.199455:0:17214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a6800030400/0x2aac941e5f4a89a3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541255.199462:0:17214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6800030400/0x2aac941e5f4a89a3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541255.199717:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68378a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+16:17929:x1875420981151744:12345-0@lo:253:mount.lustre.0 Request processed in 14896us (15295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541255.199727:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788541255.199804:0:17929:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:17929:1875420981151744:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788541255.199815:0:17929:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788541255.199818:0:17929:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788541255.199820:0:17929:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788541255.199821:0:17929:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788541255.199823:0:17929:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788541255.199824:0:17929:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788541255.199825:0:17929:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788541255.199826:0:17929:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788541255.199828:0:17929:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788541255.199829:0:17929:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788541255.199839:0:17929:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000040:01000000:2.0:1788541255.219498:0:17929:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1788541255.219622:0:17953:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1788541255.219632:0:17953:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788541255.223772:0:17954:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:1.0:1788541255.224410:0:17954:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1788541255.224937:0:17929:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:1.0:1788541255.227197:0:17954:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788541255.227615:0:17954:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:0.0:1788541255.227963:0:17955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831e300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17955:1875420981152384:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788541255.228033:0:17955:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541255.228067:0:17955:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683530a180 going to sleep for 11 seconds 00000100:00100000:1.0:1788541255.228180:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981152384 00000100:00100000:1.0:1788541255.228198:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981152384 00000100:00100000:1.0:1788541255.228492:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788541255.228502:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17955:x1875420981152384:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788541255.228591:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17955:x1875420981152384:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 91us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541255.228599:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788541255.228679:0:17955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831e300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17955:1875420981152384:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1788541255.228708:0:17955:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788541255.228738:0:17955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831e300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17955:1875420981152512:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788541255.228769:0:17955:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541255.228793:0:17955:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683530a180 going to sleep for 11 seconds 00000100:00100000:1.0:1788541255.229463:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981152512 00000100:00100000:1.0:1788541255.229470:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981152512 00000100:00100000:1.0:1788541255.229500:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788541255.229507:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17955:x1875420981152512:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788541255.229626:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17955:x1875420981152512:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 119us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541255.229633:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788541255.229711:0:17955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831e300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17955:1875420981152512:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788541255.229775:0:17955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831e300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17955:1875420981152640:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788541255.229806:0:17955:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541255.229836:0:17955:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683530a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788541255.229936:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981152640 00000100:00100000:3.0:1788541255.229941:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981152640 00000100:00100000:3.0:1788541255.229984:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788541255.229992:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17955:x1875420981152640:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788541255.230252:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17955:x1875420981152640:12345-0@lo:900:lod0001_rec0000.0 Request processed in 49us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541255.230259:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788541255.230390:0:17955:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a670831e300 x1875420981152640/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788541271 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541255.230402:0:17955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831e300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17955:1875420981152640:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788541255.230450:0:17955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835f100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17955:1875420981152768:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788541255.230481:0:17955:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541255.230493:0:17955:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6811488480 going to sleep for 11 seconds 00000100:00100000:0.0:1788541255.230541:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981152768 00000100:00100000:0.0:1788541255.230546:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981152768 00000100:00100000:0.0:1788541255.230576:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788541255.230582:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17955:x1875420981152768:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788541255.230637:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17955:x1875420981152768:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 56us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541255.230644:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788541255.230717:0:17955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835f100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17955:1875420981152768:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1788541255.230761:0:17955:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1788541255.232283:0:17929:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1788541255.232403:0:17929:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788541255.232863:0:17929:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788541255.232904:0:17929:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1788541255.232948:0:17929:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788541255.237980:0:17955:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000040:00080000:3.0:1788541255.239384:0:17929:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000004:00080000:1.0:1788541255.240381:0:17955:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788541255.240389:0:17955:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000040:00080000:3.0:1788541255.242394:0:17929:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788541255.242489:0:17929:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1788541255.242684:0:17929:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788541255.246375:0:17929:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000001:00000004:0.0:1788541255.249744:0:17929:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1788541255.257490:0:17929:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788541255.257548:0:17929:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb5cdc19cf988 00100000:10000000:0.0:1788541255.257557:0:17929:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1788541255.260639:0:17929:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788541255.260673:0:17929:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.156@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788541255.260703:0:17929:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788541255.260735:0:17929:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1788541255.261587:0:17929:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788541255.261821:0:17929:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788541255.498477:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541256.028982:0:17239:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683549ae40 going to sleep for 0 seconds 00000040:00080000:3.0:1788541256.203817:0:17950:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1788541256.330095:0:17196:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788541256.330105:0:17196:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a683f356800 from 8 10000000:01000000:2.0:1788541256.330110:0:17196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788541256.330167:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551a800/0x2aac941e5f4a89aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541256.330179:0:17196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a683551a800/0x2aac941e5f4a89aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541256.330191:0:17196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a683551a800/0x2aac941e5f4a89aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541256.330229:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981152896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788541256.330306:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541256.330413:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a670801f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788541256.332538:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981152896 00000100:00100000:0.0:1788541256.332551:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981152896 00000100:00100000:0.0:1788541256.332669:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788541256.332680:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68378a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+16:17196:x1875420981152896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788541256.332697:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541256.332713:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6800031600/0x2aac941e5f4a89b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a89aa expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541256.332741:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6800031600/0x2aac941e5f4a89b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a89aa expref: 17 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541256.332751:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6800031600/0x2aac941e5f4a89b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a89aa expref: 17 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541256.332767:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6800031600, rc 0) 00000100:00100000:0.0:1788541256.332845:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68378a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+17:17196:x1875420981152896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (2538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541256.332851:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788541256.332950:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981152896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788541256.332969:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a683551a800/0x2aac941e5f4a89aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a89b1 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541256.332979:0:17196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a683551a800/0x2aac941e5f4a89aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a89b1 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541256.333046:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981153024:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788541256.333086:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541256.333222:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6804f8e600 going to sleep for 11 seconds 00000100:00100000:2.0:1788541256.333437:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981153024 00000100:00100000:2.0:1788541256.333442:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981153024 00000100:00100000:2.0:1788541256.333469:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788541256.333476:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68378a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+17:17196:x1875420981153024:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788541256.333492:0:17191:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788541256.333511:0:17191:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788541256.333514:0:17191:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1788541256.333605:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68378a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+17:17196:x1875420981153024:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 129us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541256.333613:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788541256.333796:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981153024:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788541256.333843:0:17196:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788541256.333851:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551a800/0x2aac941e5f4a89aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a89b1 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541256.333859:0:17196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a683551a800/0x2aac941e5f4a89aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a89b1 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788541256.333892:0:17196:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788541256.333895:0:17196:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a67082f3800 from 8 10000000:01000000:1.0:1788541256.333898:0:17196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788541256.333919:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6706957800/0x2aac941e5f4a89b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541256.333926:0:17196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a6706957800/0x2aac941e5f4a89b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541256.333941:0:17196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a6706957800/0x2aac941e5f4a89b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541256.333956:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981153152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788541256.333983:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541256.334004:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6804f8e600 going to sleep for 11 seconds 00000100:00100000:2.0:1788541256.334059:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981153152 00000100:00100000:2.0:1788541256.334064:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981153152 00000100:00100000:2.0:1788541256.334083:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788541256.334090:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68378a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+17:17196:x1875420981153152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788541256.334103:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541256.334113:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a683551ba00/0x2aac941e5f4a89bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a89b8 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541256.334129:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a683551ba00/0x2aac941e5f4a89bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a89b8 expref: 18 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541256.334139:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a683551ba00/0x2aac941e5f4a89bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a89b8 expref: 18 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541256.334146:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a683551ba00, rc 0) 00000100:00100000:2.0:1788541256.334227:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68378a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+18:17196:x1875420981153152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541256.334233:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788541256.334431:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981153152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788541256.334442:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a6706957800/0x2aac941e5f4a89b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a89bf expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541256.334451:0:17196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a6706957800/0x2aac941e5f4a89b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a89bf expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541256.334491:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981153280:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788541256.334518:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541256.334581:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6804f8e600 going to sleep for 11 seconds 00000100:00100000:3.0:1788541256.334613:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981153280 00000100:00100000:3.0:1788541256.334618:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981153280 00000100:00100000:2.0:1788541256.334662:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788541256.334669:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68378a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+18:17196:x1875420981153280:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788541256.334681:0:17191:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788541256.334693:0:17191:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788541256.334696:0:17191:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1788541256.334765:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68378a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+18:17196:x1875420981153280:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 96us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541256.334772:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788541256.334844:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981153280:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788541256.334904:0:17196:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788541256.334910:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6706957800/0x2aac941e5f4a89b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a89bf expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541256.334918:0:17196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a6706957800/0x2aac941e5f4a89b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a89bf expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541256.523406:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541257.033955:0:17239:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683549ae40 going to sleep for 0 seconds 00000040:00080000:2.0:1788541257.235988:0:17950:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788541257.548962:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541258.057937:0:17239:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683549ae40 going to sleep for 0 seconds 00010000:00010000:0.0:1788541258.574924:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788541258.959658:0:18197:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg256-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1788541259.083495:0:17239:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683549ae40 going to sleep for 0 seconds 00010000:00010000:1.0:1788541259.595615:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788541259.856116:0:18249:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788541259.856321:0:18249:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788541260.107247:0:17239:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683549ae40 going to sleep for 0 seconds 00000100:00080000:1.0:1788541260.234044:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788541260.234055:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788541260.234061:0:8:0:(import.c:65:import_set_state_nolock()) ffff9a670774b000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788541260.234080:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9a670774b000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:0.0:1788541260.234082:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4746c063-6c88-4476-b99b-02bb8e8d54f7:3642:1875420981153408:0@lo:400:kworker.0 00000100:00100000:1.0:1788541260.234124:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a670835df80 x1875420981153536/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788541260.234145:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788541260.234151:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788541260.234154:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788541260.234157:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788541260.234211:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1788541260.234217:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788541260.234218:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788541260.234226:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788541260.234229:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788541260.234266:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875420981153920:0@lo:400:kworker.0 00000100:00100000:1.0:1788541260.234329:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541260.234373:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981154048:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788541260.234393:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981153536:0@lo:38:kworker.0 00000100:00100000:0.0:1788541260.234415:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541260.234582:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875420981153664:0@lo:400:kworker.0 00000100:00100000:0.0:1788541260.234685:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981154048 00000100:00100000:1.0:1788541260.234694:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541260.234695:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981154048 00000100:00100000:0.0:1788541260.234758:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788541260.234769:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981154048:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788541260.234798:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000004:00000024:0.0:1788541260.234815:0:17203:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788541260.234816:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981153792:0@lo:400:kworker.0 00000100:00100000:1.0:1788541260.234847:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541260.234901:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981154048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 133us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541260.234909:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788541260.234925:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981153792 00000100:00100000:0.0:1788541260.234928:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981153792 00000100:00100000:0.0:1788541260.234942:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788541260.234947:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981153792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541260.234986:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981153792:12345-0@lo:400:kworker.0 Request processed in 38us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541260.234992:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788541260.235206:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981153792:0@lo:400:kworker.0 00000100:00100000:0.0:1788541260.235242:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981154048:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788541260.235345:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981153408 00000100:00100000:2.0:1788541260.235351:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981153408 00000100:00100000:2.0:1788541260.235390:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788541260.235395:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981153920 00000100:00100000:2.0:1788541260.235399:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68378a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+18:3642:x1875420981153408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541260.235402:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981153920 00000100:00100000:2.0:1788541260.235669:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68378a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+18:3642:x1875420981153408:12345-0@lo:400:kworker.0 Request processed in 268us (1452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541260.235679:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788541260.235845:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981153664 00000100:00100000:1.0:1788541260.235856:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981153664 00000100:00100000:3.0:1788541260.235857:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541260.235916:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788541260.235927:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875420981153920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541260.235990:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875420981153920:12345-0@lo:400:kworker.0 Request processed in 65us (1660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541260.235998:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788541260.236015:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788541260.236023:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875420981153664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541260.236063:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875420981153664:12345-0@lo:400:kworker.0 Request processed in 42us (1370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541260.236077:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788541260.236111:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a670835c700 x1875420981153664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541260.236124:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875420981153664:0@lo:400:kworker.0 00010000:00080000:1.0:1788541260.236205:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a670835d880 x1875420981153920/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541260.236219:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875420981153920:0@lo:400:kworker.0 00000100:00100000:0.0:1788541260.236365:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4746c063-6c88-4476-b99b-02bb8e8d54f7:3642:1875420981153408:0@lo:400:kworker.0 00000100:00100000:1.0:1788541260.236509:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981153536 00000100:00100000:1.0:1788541260.236514:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981153536 00000100:00100000:1.0:1788541260.236546:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788541260.236552:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3640:x1875420981153536:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788541260.236584:0:17203:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 541 last 0 00000020:00000080:1.0:1788541260.236704:0:17203:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2aac941e5f4a89c6 00000004:00100000:1.0:1788541260.236795:0:17203:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788541260.236814:0:17203:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1788541260.246754:0:17203:0:(import.c:65:import_set_state_nolock()) ffff9a67067e2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788541260.246923:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1875420981153536:12345-0@lo:38:kworker.0 Request processed in 10367us (11079us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541260.246936:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1788541260.247011:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788541260.247026:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788541260.247032:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788541260.247036:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a670774b000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1788541260.247059:0:3640:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000c425ece1): req@ffff9a6706830700 x1875420981146240/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541260.247091:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981153536:0@lo:38:kworker.0 00000100:00100000:2.0:1788541260.247251:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788541260.247272:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981154176:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788541260.247330:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541260.247387:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981154176 00000100:00100000:3.0:1788541260.247396:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981154176 00000100:00100000:3.0:1788541260.247466:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788541260.247475:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1875420981154176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788541260.247511:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788541260.247763:0:17239:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541260.247855:0:17239:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683549ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1788541260.251627:0:17203:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1788541260.251655:0:17203:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1788541260.251983:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981146240 00000100:00100000:2.0:1788541260.252004:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981146240 00000100:00100000:3.0:1788541260.252189:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3644:x1875420981154176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4693us (4837us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541260.252205:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788541260.252246:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788541260.252262:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17239:x1875420981146240:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788541260.252462:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17239:x1875420981146240:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 208us (4702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541260.252469:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788541260.252522:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981154176:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788541260.253139:0:17239:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706830700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17239:1875420981146240:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1788541260.253186:0:17239:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788541260.253239:0:17239:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d4a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17239:1875420981154304:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788541260.253290:0:17239:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541260.253328:0:17239:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68080ee480 going to sleep for 11 seconds 00000100:00100000:2.0:1788541260.253345:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981154304 00000100:00100000:2.0:1788541260.253351:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981154304 00000100:00100000:2.0:1788541260.253401:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788541260.253408:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17239:x1875420981154304:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788541260.253504:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17239:x1875420981154304:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 97us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541260.253512:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788541260.253538:0:17239:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d4a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17239:1875420981154304:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788541260.253625:0:17239:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d4a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17239:1875420981154432:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788541260.253649:0:17239:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541260.253661:0:17239:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68080ee480 going to sleep for 11 seconds 00000100:00100000:2.0:1788541260.253672:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981154432 00000100:00100000:2.0:1788541260.253675:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981154432 00000100:00100000:2.0:1788541260.253690:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788541260.253694:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17239:x1875420981154432:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788541260.253743:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17239:x1875420981154432:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 47us (93us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541260.253748:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788541260.253767:0:17239:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d4a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17239:1875420981154432:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1788541260.253970:0:17239:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788541260.260388:0:17239:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788541260.260501:0:17239:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 20, retries 0 00000004:00080000:2.0:1788541260.260508:0:17239:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1788541260.618386:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788541260.639733:0:18301:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788541260.640122:0:18301:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788541261.642317:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788541261.695023:0:18364:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe98b219d0 20000000:00000080:1.0:1788541261.695044:0:18364:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a6839405800 uarg=0000000000000000 20000000:01000000:1.0:1788541261.695089:0:18364:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788541261.695096:0:18364:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788541261.695101:0:18364:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788541261.698288:0:18365:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1788541261.698558:0:18364:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788541261.704972:0:18364:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788541261.705061:0:18364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a6706956200/0x2aac941e5f4a89cd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541261.705079:0:18364:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6800030a00/0x2aac941e5f4a8876 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a886f expref: 17 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541261.705087:0:18364:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a67075ac800/0x2aac941e5f4a8979 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a8972 expref: 17 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541261.705093:0:18364:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a6706956200/0x2aac941e5f4a89cd lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541261.705142:0:18364:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a67075ac800/0x2aac941e5f4a8979 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a8972 expref: 17 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541261.705158:0:18364:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a67075ac800/0x2aac941e5f4a8979 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a8972 expref: 17 pid: 17193 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541261.705185:0:18364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18364:1875420981154560:0@lo:104: 00000100:00100000:1.0:1788541261.705246:0:18364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788541261.705392:0:18364:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6800030a00/0x2aac941e5f4a8876 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a886f expref: 17 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541261.705416:0:18364:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6800030a00/0x2aac941e5f4a8876 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a886f expref: 17 pid: 17193 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541261.705425:0:18364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18364:1875420981154688:0@lo:104: 00000100:00100000:1.0:1788541261.705449:0:18364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541261.705604:0:18364:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68042ddf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788541261.706797:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981154560 00000100:00100000:0.0:1788541261.706805:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981154560 00000100:00100000:0.0:1788541261.706848:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981154688 00000100:00100000:0.0:1788541261.706850:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981154688 00000100:00100000:0.0:1788541261.706862:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788541261.707087:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4746c063-6c88-4476-b99b-02bb8e8d54f7+4:18364:x1875420981154560:12345-0@lo:104: 00010000:00010000:0.0:1788541261.707105:0:17181:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a6706957600/0x2aac941e5f4a8972 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a8979 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541261.707290:0:17181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788541261.707298:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4746c063-6c88-4476-b99b-02bb8e8d54f7+4:18364:x1875420981154560:12345-0@lo:104: Request processed in 429us (2049us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541261.707310:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788541261.707339:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788541261.707346:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4746c063-6c88-4476-b99b-02bb8e8d54f7+3:18364:x1875420981154688:12345-0@lo:104: 00010000:00010000:1.0:1788541261.707354:0:17181:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a683551ae00/0x2aac941e5f4a886f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a8876 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541261.707383:0:17181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788541261.707387:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4746c063-6c88-4476-b99b-02bb8e8d54f7+3:18364:x1875420981154688:12345-0@lo:104: Request processed in 43us (1938us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541261.707390:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1788541261.707522:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788541261.707530:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a6706957600/0x2aac941e5f4a8972 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a8979 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541261.707538:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706957600 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:3.0:1788541261.707542:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a6706957600/0x2aac941e5f4a8972 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a8979 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541261.707552:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a6706957600/0x2aac941e5f4a8972 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a8979 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788541261.707557:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a6706957600/0x2aac941e5f4a8972 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a8979 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541261.707561:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788541261.707595:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a6706957600/0x2aac941e5f4a8972 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a8979 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541261.707599:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788541261.707616:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a6706957600/0x2aac941e5f4a8972 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a8979 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541261.707621:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a6706957600/0x2aac941e5f4a8972 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a8979 expref: -99 pid: 17929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541261.707630:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788541261.707632:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a683551ae00/0x2aac941e5f4a886f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a8876 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541261.707635:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551ae00 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:3.0:1788541261.707637:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a683551ae00/0x2aac941e5f4a886f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a8876 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541261.707653:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a683551ae00/0x2aac941e5f4a886f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a8876 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788541261.707657:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a683551ae00/0x2aac941e5f4a886f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a8876 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541261.707660:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788541261.707669:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a683551ae00/0x2aac941e5f4a886f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a8876 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541261.707672:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788541261.707682:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a683551ae00/0x2aac941e5f4a886f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a8876 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541261.707686:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a683551ae00/0x2aac941e5f4a886f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a8876 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541261.707694:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541261.707695:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541261.707696:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541261.707706:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4746c063-6c88-4476-b99b-02bb8e8d54f7:3644:1875420981154816:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788541261.707736:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541261.707769:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788541261.707774:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4746c063-6c88-4476-b99b-02bb8e8d54f7:3642:1875420981154944:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788541261.707787:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541261.707803:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981154816 00000100:00100000:3.0:1788541261.707806:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981154816 00010000:00010000:3.0:1788541261.707822:0:17183:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a67075ac800/0x2aac941e5f4a8979 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a8972 expref: 18 pid: 17193 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541261.707852:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981154944 00000100:00100000:3.0:1788541261.707855:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981154944 00010000:00010000:3.0:1788541261.707863:0:17183:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6800030a00/0x2aac941e5f4a8876 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a886f expref: 19 pid: 17193 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541261.707897:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788541261.707902:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706831180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4746c063-6c88-4476-b99b-02bb8e8d54f7+19:3644:x1875420981154816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788541261.707910:0:17183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541261.707914:0:17183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a67075ac800/0x2aac941e5f4a8979 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a8972 expref: 19 pid: 17193 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541261.707921:0:17183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a67075ac800/0x2aac941e5f4a8979 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a8972 expref: 19 pid: 17193 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541261.707933:0:17183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541261.707952:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706831180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4746c063-6c88-4476-b99b-02bb8e8d54f7+19:3644:x1875420981154816:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541261.707956:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788541261.707964:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788541261.707967:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706831880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4746c063-6c88-4476-b99b-02bb8e8d54f7+18:3642:x1875420981154944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788541261.707972:0:17183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541261.707974:0:17183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6800030a00/0x2aac941e5f4a8876 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a886f expref: 18 pid: 17193 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541261.707980:0:17183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6800030a00/0x2aac941e5f4a8876 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a886f expref: 18 pid: 17193 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541261.708001:0:17183:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a6706956200/0x2aac941e5f4a89cd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541261.708015:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6706956200/0x2aac941e5f4a89cd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541261.708029:0:17183:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6706956200/0x2aac941e5f4a89cd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541261.708036:0:17183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6706956200/0x2aac941e5f4a89cd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541261.708044:0:17183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a6706956200/0x2aac941e5f4a89cd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541261.708049:0:17183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a6706956200/0x2aac941e5f4a89cd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541261.708052:0:17183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706956200 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:3.0:1788541261.708055:0:17183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a6706956200/0x2aac941e5f4a89cd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541261.708060:0:17183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a6706956200/0x2aac941e5f4a89cd lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541261.708065:0:17183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a6706956200/0x2aac941e5f4a89cd lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541261.708073:0:17183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541261.708099:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706831880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4746c063-6c88-4476-b99b-02bb8e8d54f7+18:3642:x1875420981154944:12345-0@lo:103:ldlm_bl.0 Request processed in 130us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541261.708106:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788541261.708136:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4746c063-6c88-4476-b99b-02bb8e8d54f7:3642:1875420981154944:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788541261.708179:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4746c063-6c88-4476-b99b-02bb8e8d54f7:3644:1875420981154816:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788541261.708765:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541261.708792:0:18364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a67075ac800/0x2aac941e5f4a8979 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a8972 expref: 17 pid: 17193 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541261.708802:0:18364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18364:1875420981154560:0@lo:104: 00010000:00010000:0.0:1788541261.708808:0:18364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6800030a00/0x2aac941e5f4a8876 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a886f expref: 16 pid: 17193 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541261.708815:0:18364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18364:1875420981154688:0@lo:104: 00010000:00010000:0.0:1788541261.708828:0:18364:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a6706956200/0x2aac941e5f4a89cd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541261.711082:0:18364:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a6706956200/0x2aac941e5f4a89cd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541261.711106:0:18364:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a6706956200/0x2aac941e5f4a89cd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541261.711114:0:18364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6706956200/0x2aac941e5f4a89cd lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788541262.090530:0:17231:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788541262.670003:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541263.690130:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788541263.690198:0:17196:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788541263.690202:0:17196:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a683f356800 from 13 10000000:01000000:1.0:1788541263.690208:0:17196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788541263.690254:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6706957400/0x2aac941e5f4a89d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541263.690265:0:17196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a6706957400/0x2aac941e5f4a89d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541263.690289:0:17196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a6706957400/0x2aac941e5f4a89d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541263.690314:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981155072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788541263.690381:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541263.690433:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707570cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788541263.690542:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981155072 00000100:00100000:3.0:1788541263.690550:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981155072 00000100:00100000:3.0:1788541263.690605:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788541263.690615:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68378a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+16:17196:x1875420981155072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788541263.690626:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541263.690640:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a67075ace00/0x2aac941e5f4a89db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a89d4 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541263.690662:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a67075ace00/0x2aac941e5f4a89db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a89d4 expref: 17 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541263.690672:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a67075ace00/0x2aac941e5f4a89db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a89d4 expref: 17 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541263.690681:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075ace00, rc 0) 00000100:00100000:3.0:1788541263.690738:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68378a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+17:17196:x1875420981155072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541263.690745:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788541263.691165:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981155072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788541263.691180:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a6706957400/0x2aac941e5f4a89d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a89db expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541263.691190:0:17196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a6706957400/0x2aac941e5f4a89d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a89db expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541263.691253:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981155200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788541263.691280:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541263.691315:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707570cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788541263.691717:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981155200 00000100:00100000:3.0:1788541263.691722:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981155200 00000100:00100000:3.0:1788541263.691757:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788541263.691765:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68378a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+17:17196:x1875420981155200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788541263.691910:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68378a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+17:17196:x1875420981155200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 145us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541263.691926:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788541263.692122:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981155200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788541263.692169:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981155328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788541263.692214:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541263.692243:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68350abb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788541263.692347:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981155328 00000100:00100000:3.0:1788541263.692352:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981155328 00000100:00100000:3.0:1788541263.692489:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788541263.692499:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68378a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+17:17196:x1875420981155328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788541263.692582:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68378a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+17:17196:x1875420981155328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541263.694571:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981155328:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788541263.695267:0:18435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788541263.695327:0:17196:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788541263.695346:0:17196:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788541263.695356:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6706957400/0x2aac941e5f4a89d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a89db expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541263.695366:0:17196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a6706957400/0x2aac941e5f4a89d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a89db expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788541263.695401:0:17196:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788541263.695404:0:17196:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a67082f3800 from 13 10000000:01000000:1.0:1788541263.695407:0:17196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788541263.695438:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6706957c00/0x2aac941e5f4a89e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541263.695446:0:17196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a6706957c00/0x2aac941e5f4a89e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541263.695455:0:17196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a6706957c00/0x2aac941e5f4a89e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541263.695475:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981155456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788541263.695536:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541263.695571:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707570cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788541263.695589:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981155456 00000100:00100000:1.0:1788541263.695594:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981155456 00000100:00100000:3.0:1788541263.702999:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788541263.704211:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788541263.704230:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68378a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+17:17196:x1875420981155456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788541263.704250:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541263.704269:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6706956000/0x2aac941e5f4a89e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a89e2 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541263.704296:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6706956000/0x2aac941e5f4a89e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a89e2 expref: 18 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541263.704307:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6706956000/0x2aac941e5f4a89e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a89e2 expref: 18 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541263.704328:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6706956000, rc 0) 00000100:00100000:1.0:1788541263.704410:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68378a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+18:17196:x1875420981155456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 187us (8874us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541263.704417:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788541263.704467:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981155456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788541263.704484:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a6706957c00/0x2aac941e5f4a89e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a89e9 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541263.704494:0:17196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a6706957c00/0x2aac941e5f4a89e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a89e9 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541263.704564:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981155584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788541263.704597:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541263.704622:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707570cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788541263.705932:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981155584 00000100:00100000:0.0:1788541263.705940:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981155584 00000100:00100000:0.0:1788541263.705993:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788541263.706000:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68378a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+18:17196:x1875420981155584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788541263.706158:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68378a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+18:17196:x1875420981155584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 158us (1560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541263.706165:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788541263.706299:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981155584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788541263.706345:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981155712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788541263.706401:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541263.706425:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68065e0780 going to sleep for 11 seconds 00000100:00100000:0.0:1788541263.706780:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981155712 00000100:00100000:0.0:1788541263.706785:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981155712 00000100:00100000:0.0:1788541263.706807:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788541263.706812:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68378a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+18:17196:x1875420981155712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788541263.706930:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68378a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+18:17196:x1875420981155712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541263.706937:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788541263.707832:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981155712:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788541263.712267:0:18436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788541263.712587:0:17196:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788541263.712614:0:17196:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788541263.712626:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6706957c00/0x2aac941e5f4a89e2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a89e9 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541263.712667:0:17196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a6706957c00/0x2aac941e5f4a89e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a89e9 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541264.714041:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541265.354587:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981155840:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788541265.354658:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541265.354713:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981155840 00000100:00100000:1.0:1788541265.354720:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981155840 00000100:00100000:1.0:1788541265.354763:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788541265.354771:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981155840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788541265.354809:0:17203:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788541265.354856:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981155840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541265.354863:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788541265.354926:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981155840:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1788541265.355073:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788541265.355077:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788541265.355080:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788541265.355083:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788541265.355104:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788541265.355107:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788541265.355109:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788541265.355112:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788541265.355145:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4746c063-6c88-4476-b99b-02bb8e8d54f7:3643:1875420981155968:0@lo:400:kworker.0 00000100:00100000:0.0:1788541265.355177:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541265.355203:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788541265.355208:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981156096:0@lo:400:kworker.0 00000100:00100000:0.0:1788541265.355227:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541265.355250:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981155968 00000100:00100000:0.0:1788541265.355253:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981155968 00000100:00100000:0.0:1788541265.355277:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788541265.355283:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68378a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+18:3643:x1875420981155968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541265.355312:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68378a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+18:3643:x1875420981155968:12345-0@lo:400:kworker.0 Request processed in 29us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541265.355317:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788541265.355344:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4746c063-6c88-4476-b99b-02bb8e8d54f7:3643:1875420981155968:0@lo:400:kworker.0 00000100:00100000:1.0:1788541265.355448:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875420981156224:0@lo:400:kworker.0 00000100:00100000:1.0:1788541265.355476:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541265.355503:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788541265.355508:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670781b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875420981156352:0@lo:400:kworker.0 00000100:00100000:1.0:1788541265.355527:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541265.355552:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981156224 00000100:00100000:1.0:1788541265.355555:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981156224 00000100:00100000:1.0:1788541265.355578:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981156352 00000100:00100000:1.0:1788541265.355580:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981156352 00000100:00100000:1.0:1788541265.355592:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788541265.355597:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875420981156224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541265.355629:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875420981156224:12345-0@lo:400:kworker.0 Request processed in 31us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541265.355635:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788541265.355645:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788541265.355650:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875420981156352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541265.355670:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875420981156352:12345-0@lo:400:kworker.0 Request processed in 21us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541265.355675:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788541265.355702:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a670781b100 x1875420981156352/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541265.355712:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670781b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875420981156352:0@lo:400:kworker.0 00010000:00080000:1.0:1788541265.355720:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a670831c000 x1875420981156224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541265.355728:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875420981156224:0@lo:400:kworker.0 00000100:00100000:1.0:1788541265.356287:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788541265.356298:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981156480:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788541265.356330:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541265.356356:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981156096 00000100:00100000:1.0:1788541265.356359:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981156096 00000100:00100000:1.0:1788541265.356382:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981156480 00000100:00100000:1.0:1788541265.356385:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981156480 00000100:00100000:1.0:1788541265.356398:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788541265.356404:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670781ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3643:x1875420981156096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541265.356437:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670781ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3643:x1875420981156096:12345-0@lo:400:kworker.0 Request processed in 33us (1209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541265.356443:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788541265.356454:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788541265.356460:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1875420981156480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788541265.356479:0:17203:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788541265.356510:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1875420981156480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 50us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541265.356516:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788541265.356546:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981156480:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788541265.356610:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981156096:0@lo:400:kworker.0 00000100:00100000:2.0:1788541265.359017:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788541255/real 1788541255] req@ffff9a67080d5c00 x1875420981149568/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788541265 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541265.359048:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a67080d5c00 x1875420981149568/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788541265 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541265.359058:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788541255/real 1788541255] req@ffff9a670835d500 x1875420981149312/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788541265 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541265.359069:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a670835d500 x1875420981149312/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788541265 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788541265.359089:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a68097af000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788541265.359110:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788541265.359114:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981149568:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788541265.359119:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a682fdc6000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788541265.359124:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788541265.359126:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981149312:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788541265.359470:0:18310:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788541265.359475:0:18310:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788541265.359478:0:18310:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788541265.359481:0:18310:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788541265.359485:0:18310:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788541265.359498:0:18310:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788541265.359501:0:18310:0:(import.c:65:import_set_state_nolock()) ffff9a682fdc6000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788541265.359506:0:18310:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 536 00000100:00080000:1.0:1788541265.359511:0:18310:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788541265.359517:0:18310:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9a682fdc6000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:1.0:1788541265.359547:0:18310:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a670835f100 x1875420981156608/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788541265.359572:0:18310:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788541265.359575:0:18310:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788541265.359577:0:18310:0:(import.c:65:import_set_state_nolock()) ffff9a68097af000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788541265.359580:0:18310:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 536 00000100:00080000:1.0:1788541265.359582:0:18310:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788541265.359585:0:18310:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a68097af000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:1.0:1788541265.359596:0:18310:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a670835c000 x1875420981156736/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788541265.359965:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981156608:0@lo:8:kworker.0 00000400:00000100:2.0:1788541265.360160:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875420981156608 offset 0 length 520: 4 00000100:00100000:2.0:1788541265.360194:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670835c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981156736:0@lo:8:kworker.0 00000400:00000100:2.0:1788541265.360213:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875420981156736 offset 0 length 520: 4 00010000:00010000:0.0:1788541265.739325:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788541265.880014:0:17930:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788541266.384165:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788541251/real 1788541251] req@ffff9a6706831f80 x1875420981147264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788541266 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541266.384197:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a6706831f80 x1875420981147264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788541266 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541266.384208:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788541251/real 1788541251] req@ffff9a6706833100 x1875420981147520/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788541266 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541266.384218:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a6706833100 x1875420981147520/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788541266 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788541266.384237:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a682ff82000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788541266.384259:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788541266.384263:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981147264:0@lo:8:kworker.0 00000100:00080000:3.0:1788541266.384268:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a682ff81800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788541266.384273:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788541266.384275:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981147520:0@lo:8:kworker.0 00000100:00080000:2.0:1788541266.384656:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788541266.384665:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788541266.384668:0:38:0:(import.c:65:import_set_state_nolock()) ffff9a682ff81800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788541266.384673:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 531 00000100:00080000:2.0:1788541266.384679:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788541266.384685:0:38:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a682ff81800 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:2.0:1788541266.384706:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a67080d7100 x1875420981157120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788541266.384720:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788541266.384723:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788541266.384725:0:38:0:(import.c:65:import_set_state_nolock()) ffff9a682ff82000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788541266.384727:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 531 00000100:00080000:2.0:1788541266.384729:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788541266.384732:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a682ff82000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:2.0:1788541266.384743:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a67080d6680 x1875420981157248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788541266.384762:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788541266.384765:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788541266.384768:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788541266.384770:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788541266.384937:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4746c063-6c88-4476-b99b-02bb8e8d54f7:3644:1875420981156864:0@lo:400:kworker.0 00000100:00100000:1.0:1788541266.385013:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541266.385051:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875420981157632:0@lo:400:kworker.0 00000100:00100000:1.0:1788541266.385075:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541266.385096:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788541266.385100:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981157504:0@lo:400:kworker.0 00000100:00100000:1.0:1788541266.385132:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541266.385160:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981157632 00000100:00100000:1.0:1788541266.385167:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981157632 00000100:00100000:1.0:1788541266.385221:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788541266.385229:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875420981157632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541266.385275:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875420981157632:12345-0@lo:400:kworker.0 Request processed in 47us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541266.385282:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788541266.385302:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981157504 00000100:00100000:1.0:1788541266.385305:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981157504 00000100:00100000:1.0:1788541266.385327:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788541266.385333:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981157504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541266.385364:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981157504:12345-0@lo:400:kworker.0 Request processed in 31us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541266.385370:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788541266.385409:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981157504:0@lo:400:kworker.0 00010000:00080000:1.0:1788541266.385422:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a67080d4000 x1875420981157632/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541266.385430:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875420981157632:0@lo:400:kworker.0 00000100:00100000:3.0:1788541266.385642:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875420981157376:0@lo:400:kworker.0 00000100:00100000:3.0:1788541266.385671:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541266.385712:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981157120:0@lo:8:kworker.0 00000400:00000100:3.0:1788541266.385736:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875420981157120 offset 0 length 520: 4 00000100:00100000:3.0:1788541266.385748:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981157248:0@lo:8:kworker.0 00000400:00000100:3.0:1788541266.385764:0:3640:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875420981157248 offset 0 length 520: 4 00000100:00100000:3.0:1788541266.385793:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981156864 00000100:00100000:3.0:1788541266.385811:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981156864 00000100:00100000:3.0:1788541266.385843:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788541266.385849:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+18:3644:x1875420981156864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541266.385902:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+18:3644:x1875420981156864:12345-0@lo:400:kworker.0 Request processed in 53us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541266.385908:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788541266.386256:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981156992:0@lo:400:kworker.0 00000100:00100000:2.0:1788541266.386288:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541266.387090:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981157376 00000100:00100000:1.0:1788541266.387098:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981157376 00000100:00100000:1.0:1788541266.387151:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788541266.387160:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875420981157376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541266.387219:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1875420981157376:12345-0@lo:400:kworker.0 Request processed in 60us (1546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541266.387225:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788541266.387267:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a67080d5180 x1875420981157376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541266.387282:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3642:1875420981157376:0@lo:400:kworker.0 00000100:00100000:1.0:1788541266.387322:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4746c063-6c88-4476-b99b-02bb8e8d54f7:3644:1875420981156864:0@lo:400:kworker.0 00000100:00100000:3.0:1788541266.387412:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981156992 00000100:00100000:3.0:1788541266.387416:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981156992 00000100:00100000:3.0:1788541266.387449:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788541266.387456:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981156992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541266.387504:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981156992:12345-0@lo:400:kworker.0 Request processed in 47us (1214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541266.387606:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981156992:0@lo:400:kworker.0 00000100:00100000:3.0:1788541266.387635:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1788541266.762371:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788541267.466578:0:17950:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788541267.790212:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541268.810761:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788541269.492416:0:18712:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788541269.492422:0:18712:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788541269.492424:0:18712:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788541269.492541:0:18712:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a67067e0800 00000020:01000004:0.0:1788541269.492560:0:18712:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788541269.492572:0:18712:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788541269.492584:0:18712:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9a6835310000) 00000020:00000080:0.0:1788541269.492596:0:18712:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788541269.537420:0:18712:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788541269.546540:0:18712:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788541269.547044:0:18712:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788541269.547739:0:18712:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788541269.551020:0:18712:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788541269.551235:0:18712:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788541269.551590:0:18712:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:3.0:1788541269.553200:0:18712:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788541269.553851:0:18712:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788541269.553864:0:18712:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788541269.554375:0:18712:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2aac941e5f4a89f7 00000020:01000004:3.0:1788541269.554385:0:18712:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788541269.554410:0:18712:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.156@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788541269.554414:0:18712:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.156@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788541269.554420:0:18712:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788541269.554425:0:18712:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788541269.554437:0:18712:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9a680599b380) 00000020:00000080:3.0:1788541269.554450:0:18712:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1788541269.555619:0:18712:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788541269.555786:0:18712:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788541269.555792:0:18712:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788541269.558164:0:18712:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788541269.558177:0:18712:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788541269.558541:0:18712:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788541269.558548:0:18712:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788541269.572433:0:18712:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788541269.572627:0:18712:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788541269.575725:0:18712:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788541269.579590:0:18712:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788541269.579602:0:18712:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788541269.595858:0:18712:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788541269.596252:0:18712:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788541269.596260:0:18712:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788541269.597846:0:18712:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788541269.597856:0:18712:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788541269.598736:0:18712:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788541269.598745:0:18712:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788541269.601047:0:18712:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788541269.601255:0:18712:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788541269.601262:0:18712:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788541269.602057:0:18712:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788541269.602066:0:18712:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788541269.639339:0:18712:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788541269.639565:0:18712:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788541269.639571:0:18712:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788541269.642762:0:18712:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788541269.642780:0:18712:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788541269.643426:0:18712:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788541269.643455:0:18712:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1788541269.643463:0:18712:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.156@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788541269.652773:0:18712:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.156@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788541269.652842:0:18712:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.156@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788541269.652846:0:18712:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788541269.652848:0:18712:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788541269.652849:0:18712:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788541269.652851:0:18712:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788541269.652852:0:18712:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788541269.652853:0:18712:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788541269.652855:0:18712:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788541269.652856:0:18712:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788541269.652858:0:18712:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788541269.652861:0:18712:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788541269.652864:0:18712:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788541269.652865:0:18712:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788541269.652866:0:18712:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788541269.652867:0:18712:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788541269.652909:0:18712:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788541269.652918:0:18712:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788541269.652919:0:18712:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788541269.652920:0:18712:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788541269.652927:0:18712:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788541269.652953:0:18712:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788541269.652973:0:18712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707818000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:18712:1875420981157760:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788541269.653043:0:18712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541269.653087:0:18712:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67078710c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788541269.653163:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981157760 00000100:00100000:1.0:1788541269.653171:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981157760 00000100:00100000:1.0:1788541269.653223:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788541269.653232:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+18:18712:x1875420981157760:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788541269.653259:0:17192:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788541269.653262:0:17192:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1788541269.653266:0:17192:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788541269.653603:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+18:18712:x1875420981157760:12345-0@lo:253:mount.lustre.0 Request processed in 371us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541269.653611:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788541269.653724:0:18712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707818000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:18712:1875420981157760:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788541269.653734:0:18712:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788541269.653736:0:18712:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788541269.653737:0:18712:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788541269.653738:0:18712:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788541269.653739:0:18712:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788541269.653741:0:18712:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788541269.653742:0:18712:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788541269.653743:0:18712:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788541269.653744:0:18712:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788541269.653745:0:18712:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788541269.653761:0:18712:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a67067e0800 from lustre-OST0000 10000000:01000000:0.0:1788541269.653784:0:18712:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788541269.653787:0:18712:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788541269.653794:0:18712:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a67079119c0 local copy 00010000:00010000:0.0:1788541269.653803:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a67075acc00/0x2aac941e5f4a87b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a87b9 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541269.653904:0:18712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707818000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:18712:1875420981157888:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788541269.653940:0:18712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541269.653964:0:18712:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707570300 going to sleep for 11 seconds 00000100:00100000:3.0:1788541269.654008:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981157888 00000100:00100000:3.0:1788541269.654012:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981157888 00000100:00100000:3.0:1788541269.654043:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788541269.654050:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+18:18712:x1875420981157888:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788541269.654127:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+18:18712:x1875420981157888:12345-0@lo:501:mount.lustre.0 Request processed in 77us (185us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788541269.654133:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788541269.654315:0:18712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707818000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:18712:1875420981157888:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788541269.654327:0:18712:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.156@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788541269.654343:0:18712:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.156@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788541269.654349:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a67075acc00/0x2aac941e5f4a87b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a87b9 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541269.654363:0:18712:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a67075acc00/0x2aac941e5f4a87b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a87b9 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788541269.654389:0:18712:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a67067e0800 10000000:01000000:0.0:1788541269.654393:0:18712:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788541269.654398:0:18712:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788541269.654400:0:18712:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788541269.654404:0:18712:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788541269.654407:0:18712:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788541269.654425:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6800030400/0x2aac941e5f4a8a05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541269.654433:0:18712:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a6800030400/0x2aac941e5f4a8a05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541269.654442:0:18712:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a6800030400/0x2aac941e5f4a8a05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541269.654453:0:18712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707818000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:18712:1875420981158016:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788541269.654476:0:18712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541269.654500:0:18712:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707570300 going to sleep for 11 seconds 00000100:00100000:3.0:1788541269.654534:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981158016 00000100:00100000:3.0:1788541269.654538:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981158016 00000100:00100000:3.0:1788541269.654569:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788541269.654575:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+18:18712:x1875420981158016:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788541269.654583:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541269.654594:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a67075ac000/0x2aac941e5f4a8a0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a8a05 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541269.654613:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a67075ac000/0x2aac941e5f4a8a0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a8a05 expref: 19 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541269.654624:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a67075ac000/0x2aac941e5f4a8a0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a8a05 expref: 19 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541269.654721:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075ac000, rc 0) 00000100:00100000:3.0:1788541269.654753:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+19:18712:x1875420981158016:12345-0@lo:101:mount.lustre.0 Request processed in 177us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541269.654758:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788541269.654809:0:18712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707818000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:18712:1875420981158016:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788541269.654820:0:18712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a6800030400/0x2aac941e5f4a8a05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8a0c expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541269.654829:0:18712:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a6800030400/0x2aac941e5f4a8a05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a8a0c expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788541269.655815:0:18712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788541269.657032:0:18712:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788541269.658922:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788541269.658974:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788541269.658988:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788541269.659000:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788541269.659013:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788541269.659025:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788541269.659048:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788541269.659055:0:18712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788541269.659317:0:18712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707818000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:18712:1875420981158144:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788541269.659392:0:18712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541269.659502:0:18712:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67075703c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788541269.665533:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981158144 00000100:00100000:1.0:1788541269.665551:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981158144 00000100:00100000:2.0:1788541269.665727:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788541269.665737:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708146c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+19:18712:x1875420981158144:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788541269.665981:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708146c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+19:18712:x1875420981158144:12345-0@lo:501:mount.lustre.0 Request processed in 244us (6587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541269.665989:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788541269.666257:0:18712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707818000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:18712:1875420981158144:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788541269.666318:0:18712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708837100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:18712:1875420981158272:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788541269.666394:0:18712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541269.666436:0:18712:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683572b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788541269.666511:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981158272 00000100:00100000:0.0:1788541269.666517:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981158272 00000100:00100000:0.0:1788541269.666555:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788541269.666563:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708144c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+19:18712:x1875420981158272:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788541269.667837:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708144c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+19:18712:x1875420981158272:12345-0@lo:503:mount.lustre.0 Request processed in 1270us (1438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541269.667847:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788541269.668066:0:18712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708837100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:18712:1875420981158272:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788541269.668523:0:18712:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788541269.668618:0:18712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708837100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:18712:1875420981158400:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788541269.668827:0:18712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541269.668963:0:18712:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683572b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788541269.675930:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981158400 00000100:00100000:3.0:1788541269.675944:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981158400 00000100:00100000:2.0:1788541269.676096:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788541269.676109:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708145450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+19:18712:x1875420981158400:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788541269.676647:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708145450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+19:18712:x1875420981158400:12345-0@lo:502:mount.lustre.0 Request processed in 540us (7818us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541269.676655:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788541269.676914:0:18712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708837100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:18712:1875420981158400:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788541269.677285:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788541269.677320:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788541269.677334:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788541269.677494:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788541269.677510:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788541269.677524:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788541269.677538:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788541269.677551:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788541269.677563:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1788541269.677575:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1788541269.677586:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1788541269.677596:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1788541269.677717:0:18712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:18712:1875420981158528:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788541269.677790:0:18712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541269.677931:0:18712:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a681084b780 going to sleep for 11 seconds 00000100:00100000:0.0:1788541269.680203:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981158528 00000100:00100000:0.0:1788541269.680217:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981158528 00000100:00100000:0.0:1788541269.680272:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788541269.680282:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708147450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+19:18712:x1875420981158528:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788541269.680501:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708147450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+19:18712:x1875420981158528:12345-0@lo:502:mount.lustre.0 Request processed in 220us (2710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541269.680514:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788541269.681608:0:18712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:18712:1875420981158528:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788541269.686067:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1788541269.686102:0:18712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1788541269.687282:0:18729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788541269.687291:0:18729:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1788541269.687298:0:18729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788541269.687300:0:18729:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788541269.687306:0:18729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788541269.687321:0:18729:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9a6706958000) 00000020:00000080:1.0:1788541269.687363:0:18729:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788541269.687370:0:18729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788541269.687477:0:18729:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a67067e0800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788541269.687487:0:18729:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788541269.687495:0:18729:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2aac941e5f4a8a1a 00010000:00010000:0.0:1788541269.701030:0:18729:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1788541269.701736:0:18729:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:0.0:1788541269.703383:0:18729:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1788541269.708102:0:18729:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788541269.708116:0:18729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788541269.708122:0:18729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788541269.708124:0:18729:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788541269.708127:0:18729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788541269.708130:0:18729:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:0.0:1788541269.708131:0:18729:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788541269.708133:0:18729:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788541269.708134:0:18729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788541269.708136:0:18729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788541269.708137:0:18729:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788541269.708140:0:18729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788541269.708143:0:18729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788541269.708144:0:18729:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788541269.708146:0:18729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788541269.708148:0:18729:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788541269.708149:0:18729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788541269.708151:0:18729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788541269.708152:0:18729:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788541269.708154:0:18729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788541269.708156:0:18729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788541269.708158:0:18729:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788541269.708161:0:18729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788541269.708191:0:18729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788541269.708194:0:18729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788541269.708195:0:18729:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788541269.708203:0:18729:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1788541269.708478:0:18712:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788541269.708507:0:18712:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788541269.708531:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6800030400/0x2aac941e5f4a8a05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8a0c expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541269.708542:0:18712:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a6800030400/0x2aac941e5f4a8a05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8a0c expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541269.708550:0:18712:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a67067e0800 from 1 10000000:01000000:3.0:1788541269.708552:0:18712:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788541269.708586:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a67075ac200/0x2aac941e5f4a8a21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541269.708604:0:18712:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a67075ac200/0x2aac941e5f4a8a21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541269.708616:0:18712:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a67075ac200/0x2aac941e5f4a8a21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541269.708646:0:18712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706831f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:18712:1875420981158656:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788541269.708706:0:18712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541269.708743:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981158656 00000100:00100000:3.0:1788541269.708749:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981158656 00000100:00100000:3.0:1788541269.708786:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788541269.708794:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708147c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+19:18712:x1875420981158656:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788541269.708806:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541269.708816:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a67075ad800/0x2aac941e5f4a8a28 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a8a21 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541269.708838:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a67075ad800/0x2aac941e5f4a8a28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a8a21 expref: 20 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541269.708848:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a67075ad800/0x2aac941e5f4a8a28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a8a21 expref: 20 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541269.708857:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075ad800, rc 0) 00000100:00100000:3.0:1788541269.708926:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708147c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+20:18712:x1875420981158656:12345-0@lo:101:mount.lustre.0 Request processed in 132us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541269.708932:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788541269.708968:0:18712:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6801370b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788541269.708992:0:18712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706831f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:18712:1875420981158656:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788541269.709005:0:18712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a67075ac200/0x2aac941e5f4a8a21 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8a28 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541269.709014:0:18712:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a67075ac200/0x2aac941e5f4a8a21 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a8a28 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788541269.713990:0:18712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788541269.714382:0:18712:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788541269.714960:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788541269.714996:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788541269.715014:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788541269.715019:0:18712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788541269.715108:0:18712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706831f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:18712:1875420981158784:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788541269.715176:0:18712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541269.715220:0:18712:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6811488f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788541269.717695:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981158784 00000100:00100000:1.0:1788541269.717711:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981158784 00000100:00100000:1.0:1788541269.717766:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788541269.717777:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708144450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+20:18712:x1875420981158784:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788541269.718061:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708144450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+20:18712:x1875420981158784:12345-0@lo:501:mount.lustre.0 Request processed in 285us (2883us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541269.718070:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788541269.719099:0:18712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706831f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:18712:1875420981158784:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788541269.719163:0:18712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706831f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:18712:1875420981158912:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788541269.719229:0:18712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541269.719269:0:18712:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6811488f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788541269.722473:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981158912 00000100:00100000:1.0:1788541269.722504:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981158912 00000100:00100000:1.0:1788541269.722566:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788541269.722577:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708147850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+20:18712:x1875420981158912:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788541269.722760:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708147850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+20:18712:x1875420981158912:12345-0@lo:503:mount.lustre.0 Request processed in 184us (3529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541269.722768:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788541269.723101:0:18712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706831f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:18712:1875420981158912:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788541269.723589:0:18712:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788541269.724400:0:18712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706831f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:18712:1875420981159040:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788541269.724485:0:18712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541269.724576:0:18712:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6811488180 going to sleep for 11 seconds 00000100:00100000:2.0:1788541269.733129:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981159040 00000100:00100000:2.0:1788541269.733144:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981159040 00000100:00100000:3.0:1788541269.735604:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788541269.735619:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708144850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+20:18712:x1875420981159040:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788541269.737372:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708144850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+20:18712:x1875420981159040:12345-0@lo:502:mount.lustre.0 Request processed in 1748us (12878us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541269.737387:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788541269.738609:0:18712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706831f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:18712:1875420981159040:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788541269.739058:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788541269.739105:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788541269.739123:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788541269.739139:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788541269.739170:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788541269.739186:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788541269.739198:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788541269.739210:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1788541269.739223:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788541269.739236:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1788541269.739250:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1788541269.739436:0:18712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:18712:1875420981159168:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788541269.739522:0:18712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541269.739619:0:18712:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a681084bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788541269.739725:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981159168 00000100:00100000:3.0:1788541269.739733:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981159168 00000100:00100000:3.0:1788541269.739835:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788541269.739846:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+20:18712:x1875420981159168:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788541269.740007:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+20:18712:x1875420981159168:12345-0@lo:502:mount.lustre.0 Request processed in 163us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541269.740017:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788541269.740109:0:18712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:18712:1875420981159168:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788541269.740161:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1788541269.740172:0:18712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788541269.742183:0:18733:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788541269.742198:0:18733:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788541269.742200:0:18733:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788541269.742207:0:18733:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a67067e0800 00000020:00000080:2.0:1788541269.742210:0:18733:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788541269.742218:0:18733:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788541269.742220:0:18733:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788541269.742221:0:18733:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788541269.742224:0:18733:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788541269.742226:0:18733:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788541269.742227:0:18733:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788541269.742231:0:18733:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a67067e0800 00000020:00000080:2.0:1788541269.742233:0:18733:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788541269.742421:0:18733:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788541269.744923:0:18733:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541269.744929:0:18733:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788541269.744937:0:18733:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788541269.744943:0:18733:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541269.744944:0:18733:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788541269.744949:0:18733:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a67067e0800 00000020:00000080:3.0:1788541269.744951:0:18733:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788541269.744996:0:18733:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788541269.744999:0:18733:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541269.745000:0:18733:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788541269.745002:0:18733:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788541269.745004:0:18733:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541269.745005:0:18733:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788541269.745008:0:18733:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a67067e0800 00000020:00000080:3.0:1788541269.745010:0:18733:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788541269.745049:0:18733:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788541269.745052:0:18733:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788541269.745053:0:18733:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788541269.745055:0:18733:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1788541269.747543:0:18712:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788541269.747599:0:18712:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788541269.747626:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a67075ac200/0x2aac941e5f4a8a21 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8a28 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541269.747640:0:18712:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a67075ac200/0x2aac941e5f4a8a21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8a28 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541269.747706:0:18712:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788541269.747709:0:18712:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a67067e0800 10000000:01000000:3.0:1788541269.747712:0:18712:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a67067e0800 10000000:01000000:3.0:1788541269.747716:0:18712:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788541269.747724:0:18712:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a67067e0800 from 1 10000000:01000000:3.0:1788541269.747727:0:18712:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788541269.747767:0:18712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a67075adc00/0x2aac941e5f4a8a2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541269.747776:0:18712:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a67075adc00/0x2aac941e5f4a8a2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541269.747789:0:18712:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a67075adc00/0x2aac941e5f4a8a2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541269.747817:0:18712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706830a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:18712:1875420981159296:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788541269.747916:0:18712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541269.747964:0:18712:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6811488f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788541269.750736:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981159296 00000100:00100000:0.0:1788541269.750750:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981159296 00000100:00100000:0.0:1788541269.750806:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788541269.750815:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708146850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+20:18712:x1875420981159296:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788541269.750832:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541269.750851:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6800030a00/0x2aac941e5f4a8a36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a8a2f expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541269.751060:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6800030a00/0x2aac941e5f4a8a36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a8a2f expref: 21 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541269.751073:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6800030a00/0x2aac941e5f4a8a36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a8a2f expref: 21 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541269.751082:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6800030a00, rc 0) 00000100:00100000:0.0:1788541269.751172:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708146850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+21:18712:x1875420981159296:12345-0@lo:101:mount.lustre.0 Request processed in 358us (3256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541269.751179:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788541269.751295:0:18712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706830a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:18712:1875420981159296:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788541269.751314:0:18712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a67075adc00/0x2aac941e5f4a8a2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8a36 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541269.751325:0:18712:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a67075adc00/0x2aac941e5f4a8a2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a8a36 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788541269.752776:0:18712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1788541269.753280:0:18712:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788541269.753523:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788541269.753547:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788541269.753562:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788541269.753574:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788541269.753584:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788541269.753595:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788541269.753606:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788541269.753617:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788541269.753629:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788541269.753750:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788541269.753764:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788541269.753776:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788541269.753803:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788541269.753817:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788541269.753829:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788541269.753841:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788541269.753854:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788541269.753865:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788541269.754027:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788541269.754042:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788541269.754055:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788541269.754066:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788541269.754078:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788541269.754102:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788541269.754118:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1788541269.754129:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1788541269.754141:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1788541269.754153:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1788541269.754178:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1788541269.754201:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1788541269.754212:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1788541269.754224:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1788541269.754235:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1788541269.754247:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1788541269.754261:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1788541269.754274:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1788541269.754288:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1788541269.754311:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1788541269.754316:0:18712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1788541269.758135:0:18712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706830a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:18712:1875420981159424:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788541269.758214:0:18712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541269.758302:0:18712:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a681084bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788541269.762176:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981159424 00000100:00100000:2.0:1788541269.762192:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981159424 00000100:00100000:3.0:1788541269.762428:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788541269.762441:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708146050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+21:18712:x1875420981159424:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788541269.762628:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708146050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+21:18712:x1875420981159424:12345-0@lo:501:mount.lustre.0 Request processed in 189us (4413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541269.762710:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788541269.762806:0:18712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706830a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:18712:1875420981159424:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788541269.762861:0:18712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708834e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:18712:1875420981159552:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788541269.762931:0:18712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541269.762969:0:18712:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a681084bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788541269.763010:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981159552 00000100:00100000:0.0:1788541269.763016:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981159552 00000100:00100000:0.0:1788541269.763052:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788541269.763059:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708145050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+21:18712:x1875420981159552:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788541269.763155:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708145050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+21:18712:x1875420981159552:12345-0@lo:503:mount.lustre.0 Request processed in 96us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541269.763162:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788541269.763299:0:18712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708834e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:18712:1875420981159552:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788541269.763740:0:18712:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788541269.763833:0:18712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708834e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:18712:1875420981159680:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788541269.763888:0:18712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541269.763916:0:18712:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707873b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788541269.764037:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981159680 00000100:00100000:2.0:1788541269.764042:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981159680 00000100:00100000:2.0:1788541269.764075:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788541269.764082:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708145c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+21:18712:x1875420981159680:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788541269.764181:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708145c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+21:18712:x1875420981159680:12345-0@lo:502:mount.lustre.0 Request processed in 100us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541269.764189:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788541269.764222:0:18712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708834e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:18712:1875420981159680:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788541269.764689:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788541269.764716:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788541269.764729:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788541269.764741:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788541269.764752:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788541269.764763:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788541269.764774:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788541269.764785:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788541269.764796:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788541269.764806:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788541269.764818:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788541269.764844:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788541269.764856:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788541269.764906:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788541269.764922:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788541269.764935:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788541269.764947:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788541269.764960:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788541269.764973:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788541269.764986:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788541269.765000:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788541269.765014:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788541269.765026:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788541269.765039:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788541269.765053:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1788541269.765066:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1788541269.765080:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1788541269.765102:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1788541269.765116:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1788541269.765139:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1788541269.765152:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1788541269.765165:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1788541269.765176:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1788541269.765187:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1788541269.765199:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1788541269.765211:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1788541269.765222:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1788541269.765234:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1788541269.765246:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1788541269.765343:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1788541269.765363:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1788541269.765377:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1788541269.765388:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1788541269.765400:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1788541269.765420:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1788541269.765445:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1788541269.765459:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1788541269.765471:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1788541269.765512:0:18712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708834e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:18712:1875420981159808:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788541269.765568:0:18712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541269.765609:0:18712:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707873b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788541269.767184:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981159808 00000100:00100000:2.0:1788541269.767196:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981159808 00000100:00100000:2.0:1788541269.767255:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788541269.767277:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708145850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+21:18712:x1875420981159808:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788541269.767451:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708145850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+21:18712:x1875420981159808:12345-0@lo:502:mount.lustre.0 Request processed in 180us (1882us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541269.767459:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788541269.768519:0:18712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708834e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:18712:1875420981159808:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788541269.768820:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1788541269.768847:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1788541269.768899:0:18712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706832d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:18712:1875420981159936:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788541269.769019:0:18712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541269.769050:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981159936 00000100:00100000:2.0:1788541269.769057:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981159936 00000100:00100000:3.0:1788541269.769059:0:18712:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a682e719780 going to sleep for 11 seconds 00000100:00100000:2.0:1788541269.769112:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788541269.769121:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835708c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+21:18712:x1875420981159936:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788541269.769203:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835708c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+21:18712:x1875420981159936:12345-0@lo:502:mount.lustre.0 Request processed in 83us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541269.769211:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788541269.769222:0:18712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706832d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:18712:1875420981159936:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788541269.769254:0:18712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1788541269.769262:0:18712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788541269.769843:0:18738:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788541269.769859:0:18738:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9a6805998000) 00000020:00000080:3.0:1788541269.770013:0:18738:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1788541269.770176:0:18738:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a67067e0800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788541269.770181:0:18738:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a67067e0800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788541269.770184:0:18738:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a67067e0800 3 00010000:00080000:3.0:1788541269.770220:0:18738:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a683f192800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.156@tcp at head 00010000:00010000:3.0:1788541269.772330:0:18738:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1788541269.772727:0:18738:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788541269.772779:0:18738:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788541269.772794:0:18738:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x2aac941e5f4a8a44 00000100:00080000:3.0:1788541269.772805:0:18738:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788541269.772811:0:18738:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a683f192800 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:3.0:1788541269.772844:0:18738:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6706832d80 x1875420981160064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788541269.772983:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875420981160064:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788541269.773082:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788541269.773148:0:18738:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788541269.773191:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788541269.773195:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788541269.773198:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788541269.773201:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788541269.773223:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788541269.773227:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788541269.773229:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788541269.773240:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788541269.773269:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981160448:0@lo:400:kworker.0 00000100:00100000:3.0:1788541269.773322:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541269.773422:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788541269.773430:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706831500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875420981160576:0@lo:400:kworker.0 00000100:00100000:3.0:1788541269.773458:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541269.774015:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981160192:0@lo:400:kworker.0 00000100:00100000:3.0:1788541269.774048:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541269.774068:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788541269.774074:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875420981160320:0@lo:400:kworker.0 00000100:00100000:3.0:1788541269.774109:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541269.774460:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981160448 00000100:00100000:3.0:1788541269.774468:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981160448 00000100:00100000:3.0:1788541269.774506:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981160192 00000100:00100000:3.0:1788541269.774509:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981160192 00000100:00100000:3.0:1788541269.774525:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788541269.774534:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981160448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541269.774591:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981160448:12345-0@lo:400:kworker.0 Request processed in 58us (1268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541269.774599:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788541269.774614:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788541269.774621:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981160192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541269.774664:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981160192:12345-0@lo:400:kworker.0 Request processed in 43us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541269.774671:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788541269.774713:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981160192:0@lo:400:kworker.0 00000100:00100000:3.0:1788541269.774758:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981160448:0@lo:400:kworker.0 00000100:00100000:1.0:1788541269.775191:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981160064 00000100:00100000:1.0:1788541269.775196:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981160064 00000100:00100000:1.0:1788541269.775211:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981160576 00000100:00100000:1.0:1788541269.775213:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981160576 00000100:00100000:1.0:1788541269.775228:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981160320 00000100:00100000:1.0:1788541269.775231:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981160320 00000100:00100000:1.0:1788541269.775242:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788541269.775248:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875420981160576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541269.775297:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875420981160576:12345-0@lo:400:kworker.0 Request processed in 49us (1838us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541269.775303:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788541269.775315:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788541269.775320:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875420981160320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541269.775362:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875420981160320:12345-0@lo:400:kworker.0 Request processed in 41us (1252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541269.775368:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788541269.775379:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788541269.775383:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875420981160064:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788541269.775404:0:17200:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 550 last 0 00000020:00000080:1.0:1788541269.775438:0:17200:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x2aac941e5f4a8a4b 00000004:00100000:1.0:1788541269.775456:0:17200:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788541269.775505:0:17200:0:(import.c:65:import_set_state_nolock()) ffff9a680a572000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788541269.775546:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1875420981160064:12345-0@lo:38:llog_process_th.0 Request processed in 162us (2465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541269.775552:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788541269.775612:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6706831f80 x1875420981160320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541269.775625:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875420981160320:0@lo:400:kworker.0 00010000:00080000:1.0:1788541269.775671:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6706832d80 x1875420981160064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788541279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541269.775681:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788541269.775689:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1788541269.775698:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788541269.775704:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788541269.775707:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a683f192800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788541269.775712:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3640:1875420981160064:0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788541269.779095:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6706831500 x1875420981160576/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541269.779114:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706831500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875420981160576:0@lo:400:kworker.0 00000020:01000004:3.0:1788541269.779729:0:18738:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788541269.779765:0:18738:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9a6706520000) 00000020:00000080:3.0:1788541269.779793:0:18738:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1788541269.779922:0:18738:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a67067e0800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788541269.779927:0:18738:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a67067e0800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788541269.779930:0:18738:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a67067e0800 3 00010000:00080000:3.0:1788541269.779961:0:18738:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a6809c4b800@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.156@tcp at head 00010000:00010000:3.0:1788541269.784830:0:18738:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1788541269.785647:0:18738:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1788541269.785692:0:18738:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788541269.785706:0:18738:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x2aac941e5f4a8a59 00000100:00080000:3.0:1788541269.785717:0:18738:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788541269.785724:0:18738:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9a6809c4b800 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:3.0:1788541269.785760:0:18738:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6706831500 x1875420981160704/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788541269.785790:0:18738:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788541269.785824:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788541269.785828:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788541269.785831:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788541269.785834:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788541269.785837:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788541269.785847:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788541269.785850:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788541269.785853:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788541269.793049:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706831500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875420981160704:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788541269.793145:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541269.793422:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981160704 00000100:00100000:1.0:1788541269.793433:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981160704 00000100:00100000:1.0:1788541269.793482:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788541269.793490:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670781bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875420981160704:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788541269.793521:0:17200:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 550 last 0 00000020:00000080:1.0:1788541269.793575:0:17200:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x2aac941e5f4a8a60 00000004:00100000:1.0:1788541269.793592:0:17200:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788541269.793631:0:17200:0:(import.c:65:import_set_state_nolock()) ffff9a680a575800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788541269.793686:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670781bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1875420981160704:12345-0@lo:38:llog_process_th.0 Request processed in 195us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541269.793701:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788541269.794010:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a6706831500 x1875420981160704/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788541279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541269.794022:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788541269.794031:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1788541269.794039:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788541269.794045:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788541269.794047:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a6809c4b800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788541269.794052:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706831500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3640:1875420981160704:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788541269.794221:0:18738:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:3.0:1788541269.794418:0:18712:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788541269.794447:0:18712:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788541269.794466:0:18712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a67075adc00/0x2aac941e5f4a8a2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8a36 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541269.794477:0:18712:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a67075adc00/0x2aac941e5f4a8a2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8a36 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788541269.794526:0:18712:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788541269.794529:0:18712:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788541269.794530:0:18712:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788541269.794532:0:18712:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788541269.794533:0:18712:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788541269.794535:0:18712:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788541269.794536:0:18712:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788541269.794538:0:18712:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788541269.794539:0:18712:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788541269.794543:0:18712:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1788541269.794545:0:18712:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788541269.794546:0:18712:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788541269.794547:0:18712:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788541269.794548:0:18712:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788541269.794549:0:18712:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788541269.794550:0:18712:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788541269.794551:0:18712:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788541269.794552:0:18712:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788541269.794554:0:18712:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788541269.794572:0:18712:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788541269.794588:0:18712:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706830700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:18712:1875420981160832:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788541269.794645:0:18712:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541269.794677:0:18712:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a682e719480 going to sleep for 11 seconds 00000100:00100000:3.0:1788541269.794695:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981160832 00000100:00100000:3.0:1788541269.794699:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981160832 00000100:00100000:3.0:1788541269.794739:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788541269.794746:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683570b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+21:18712:x1875420981160832:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788541269.794767:0:17193:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788541269.794779:0:17193:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788541269.799524:0:17193:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788541269.799547:0:17193:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788541269.799839:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683570b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+21:18712:x1875420981160832:12345-0@lo:253:mount.lustre.0 Request processed in 5086us (5185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541269.799854:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788541269.800064:0:18712:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706830700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:18712:1875420981160832:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788541269.800084:0:18712:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788541269.800098:0:18712:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788541269.800112:0:18712:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788541269.800113:0:18712:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788541269.800114:0:18712:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788541269.800116:0:18712:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788541269.800117:0:18712:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788541269.800119:0:18712:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788541269.800121:0:18712:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788541269.800123:0:18712:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788541269.800141:0:18712:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1788541269.800375:0:17214:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788541269.800381:0:17214:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788541269.800407:0:17214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a6706957600/0x2aac941e5f4a8a67 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541269.800425:0:17214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6800031600/0x2aac941e5f4a89b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a89aa expref: 20 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541269.800433:0:17214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a683551ba00/0x2aac941e5f4a89bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a89b8 expref: 20 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541269.800441:0:17214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a6706957600/0x2aac941e5f4a8a67 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541269.800480:0:17214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a683551ba00/0x2aac941e5f4a89bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a89b8 expref: 20 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541269.800495:0:17214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a683551ba00/0x2aac941e5f4a89bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a89b8 expref: 20 pid: 17191 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541269.800509:0:17214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708834380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17214:1875420981160960:0@lo:104: 00000100:00100000:1.0:1788541269.800552:0:17214:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788541269.800597:0:17214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6800031600/0x2aac941e5f4a89b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a89aa expref: 20 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541269.800617:0:17214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6800031600/0x2aac941e5f4a89b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a89aa expref: 20 pid: 17193 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541269.800626:0:17214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708835c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17214:1875420981161088:0@lo:104: 00000100:00100000:1.0:1788541269.800652:0:17214:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541269.800668:0:17214:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707873e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788541269.800695:0:17182:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788541269.800711:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981160960 00000100:00100000:1.0:1788541269.800718:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981160960 00000100:00100000:1.0:1788541269.800754:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981161088 00000100:00100000:1.0:1788541269.800756:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981161088 00000100:00100000:1.0:1788541269.800769:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788541269.800777:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708836a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4746c063-6c88-4476-b99b-02bb8e8d54f7+4:17214:x1875420981160960:12345-0@lo:104: 00010000:00010000:1.0:1788541269.800792:0:17182:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a6706957800/0x2aac941e5f4a89b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a89bf expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541269.800838:0:17182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788541269.800844:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708836a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4746c063-6c88-4476-b99b-02bb8e8d54f7+4:17214:x1875420981160960:12345-0@lo:104: Request processed in 67us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541269.800850:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788541269.800863:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788541269.800887:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6839221c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4746c063-6c88-4476-b99b-02bb8e8d54f7+3:17214:x1875420981161088:12345-0@lo:104: 00010000:00010000:1.0:1788541269.800894:0:17182:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a683551a800/0x2aac941e5f4a89aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a89b1 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541269.801014:0:17182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788541269.801020:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6839221c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4746c063-6c88-4476-b99b-02bb8e8d54f7+3:17214:x1875420981161088:12345-0@lo:104: Request processed in 151us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541269.801030:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788541269.801070:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788541269.801076:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a6706957800/0x2aac941e5f4a89b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a89bf expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541269.801084:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706957800 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:1.0:1788541269.801098:0:17186:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a6706957800/0x2aac941e5f4a89b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a89bf expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541269.801108:0:17186:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a6706957800/0x2aac941e5f4a89b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a89bf expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788541269.801116:0:17186:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a6706957800/0x2aac941e5f4a89b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a89bf expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788541269.801122:0:17186:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788541269.801150:0:17186:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a6706957800/0x2aac941e5f4a89b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a89bf expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541269.801157:0:17186:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788541269.801176:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a6706957800/0x2aac941e5f4a89b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a89bf expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541269.801183:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a6706957800/0x2aac941e5f4a89b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a89bf expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541269.801198:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788541269.801201:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a683551a800/0x2aac941e5f4a89aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a89b1 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541269.801217:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551a800 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:1.0:1788541269.801220:0:17186:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a683551a800/0x2aac941e5f4a89aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a89b1 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541269.801227:0:17186:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a683551a800/0x2aac941e5f4a89aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a89b1 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788541269.801234:0:17186:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a683551a800/0x2aac941e5f4a89aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a89b1 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788541269.801240:0:17186:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788541269.801253:0:17186:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a683551a800/0x2aac941e5f4a89aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a89b1 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541269.801336:0:17186:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788541269.801344:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a683551a800/0x2aac941e5f4a89aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a89b1 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541269.801350:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a683551a800/0x2aac941e5f4a89aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a89b1 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541269.801362:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541269.801364:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541269.801366:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541269.801373:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541269.801393:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4746c063-6c88-4476-b99b-02bb8e8d54f7:3641:1875420981161216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788541269.801427:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541269.801450:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788541269.801456:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4746c063-6c88-4476-b99b-02bb8e8d54f7:3641:1875420981161344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788541269.801486:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541269.801516:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981161216 00000100:00100000:1.0:1788541269.801520:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981161216 00010000:00010000:1.0:1788541269.801536:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a683551ba00/0x2aac941e5f4a89bf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a89b8 expref: 21 pid: 17191 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541269.801555:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981161344 00000100:00100000:1.0:1788541269.801559:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981161344 00010000:00010000:1.0:1788541269.801568:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6800031600/0x2aac941e5f4a89b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a89aa expref: 22 pid: 17193 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541269.801580:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788541269.801587:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708834000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4746c063-6c88-4476-b99b-02bb8e8d54f7+22:3641:x1875420981161216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788541269.801597:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541269.801602:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a683551ba00/0x2aac941e5f4a89bf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a89b8 expref: 22 pid: 17191 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541269.801612:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a683551ba00/0x2aac941e5f4a89bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a89b8 expref: 22 pid: 17191 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541269.801627:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788541269.801655:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708834000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4746c063-6c88-4476-b99b-02bb8e8d54f7+22:3641:x1875420981161216:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541269.801661:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788541269.801672:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788541269.801678:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68378a8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4746c063-6c88-4476-b99b-02bb8e8d54f7+21:3641:x1875420981161344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788541269.801685:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541269.801689:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6800031600/0x2aac941e5f4a89b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a89aa expref: 21 pid: 17193 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541269.801709:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6800031600/0x2aac941e5f4a89b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a89aa expref: 21 pid: 17193 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541269.801720:0:17185:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a6706957600/0x2aac941e5f4a8a67 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541269.801728:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6706957600/0x2aac941e5f4a8a67 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788541269.801742:0:17185:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006552442s 00010000:00010000:1.0:1788541269.801747:0:17185:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6706957600/0x2aac941e5f4a8a67 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541269.801755:0:17185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a6706957600/0x2aac941e5f4a8a67 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541269.801761:0:17185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a6706957600/0x2aac941e5f4a8a67 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541269.801768:0:17185:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a6706957600/0x2aac941e5f4a8a67 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541269.801774:0:17185:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706957600 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:1.0:1788541269.801778:0:17185:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a6706957600/0x2aac941e5f4a8a67 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541269.801786:0:17185:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a6706957600/0x2aac941e5f4a8a67 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541269.801795:0:17185:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a6706957600/0x2aac941e5f4a8a67 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541269.801811:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788541269.801834:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68378a8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4746c063-6c88-4476-b99b-02bb8e8d54f7+21:3641:x1875420981161344:12345-0@lo:103:ldlm_bl.0 Request processed in 156us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541269.801840:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788541269.802769:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4746c063-6c88-4476-b99b-02bb8e8d54f7:3641:1875420981161344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788541269.802786:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4746c063-6c88-4476-b99b-02bb8e8d54f7:3641:1875420981161216:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788541269.802820:0:17214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a683551ba00/0x2aac941e5f4a89bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a89b8 expref: 20 pid: 17191 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541269.802832:0:17214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708834380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17214:1875420981160960:0@lo:104: 00010000:00010000:1.0:1788541269.802842:0:17214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6800031600/0x2aac941e5f4a89b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a89aa expref: 19 pid: 17193 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541269.802851:0:17214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708835c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17214:1875420981161088:0@lo:104: 00010000:00010000:1.0:1788541269.802863:0:17214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a6706957600/0x2aac941e5f4a8a67 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541269.802900:0:17214:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a6706957600/0x2aac941e5f4a8a67 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541269.802907:0:17214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a6706957600/0x2aac941e5f4a8a67 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541269.802921:0:17214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6706957600/0x2aac941e5f4a8a67 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1788541269.804574:0:18712:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1788541269.823904:0:18712:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788541269.823933:0:18712:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788541269.823971:0:18712:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788541269.824023:0:18712:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.156@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788541269.824043:0:18712:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788541269.824067:0:18712:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1788541269.824818:0:18712:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788541269.825044:0:18712:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788541269.845059:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541270.474859:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981161472:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788541270.475471:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541270.475519:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788541270.475525:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981161600:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788541270.475545:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541270.475817:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981161472 00000100:00100000:2.0:1788541270.475827:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981161472 00000100:00100000:2.0:1788541270.475899:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981161600 00000100:00100000:2.0:1788541270.475913:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981161600 00000100:00100000:2.0:1788541270.475933:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788541270.475941:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981161472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788541270.475974:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788541270.476032:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981161472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541270.476040:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788541270.476073:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788541270.476080:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981161600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788541270.476105:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788541270.476132:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981161600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 54us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541270.476137:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788541270.476176:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981161600:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788541270.476192:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981161472:0@lo:41:osp-pre-0-1.0 00000020:00000004:3.0:1788541270.791671:0:18791:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788541270.793198:0:18791:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788541270.857995:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788541271.818540:0:17196:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788541271.818548:0:17196:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a683f356800 from 9 10000000:01000000:0.0:1788541271.818554:0:17196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788541271.818595:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a8a6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541271.818607:0:17196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a8a6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541271.818631:0:17196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a8a6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541271.818658:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707818e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981161728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788541271.818722:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541271.818766:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a680529c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788541271.818811:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981161728 00000100:00100000:3.0:1788541271.818819:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981161728 00000100:00100000:3.0:1788541271.818909:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788541271.818919:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683570b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+19:17196:x1875420981161728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788541271.818932:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541271.818945:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a67075ac800/0x2aac941e5f4a8a75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a8a6e expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541271.818970:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a67075ac800/0x2aac941e5f4a8a75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a8a6e expref: 20 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541271.818981:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a67075ac800/0x2aac941e5f4a8a75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a8a6e expref: 20 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541271.818991:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a67075ac800, rc 0) 00000100:00100000:3.0:1788541271.819030:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683570b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+20:17196:x1875420981161728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541271.819037:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788541271.819370:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707818e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981161728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788541271.819386:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a8a6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8a75 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541271.819406:0:17196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a8a6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a8a75 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541271.819453:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707818e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981161856:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788541271.819487:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541271.819517:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a680529c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788541271.819632:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981161856 00000100:00100000:3.0:1788541271.819642:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981161856 00000100:00100000:3.0:1788541271.819680:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788541271.819687:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683570a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+20:17196:x1875420981161856:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788541271.819701:0:17193:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788541271.819718:0:17193:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788541271.819721:0:17193:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1788541271.819785:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683570a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+20:17196:x1875420981161856:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 98us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541271.819792:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788541271.819916:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707818e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981161856:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788541271.819971:0:17196:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788541271.819978:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a8a6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8a75 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541271.819986:0:17196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a8a6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8a75 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788541271.819995:0:17196:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788541271.819997:0:17196:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a67082f3800 from 9 10000000:01000000:0.0:1788541271.819999:0:17196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788541271.820014:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75ea00/0x2aac941e5f4a8a7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541271.820021:0:17196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a682e75ea00/0x2aac941e5f4a8a7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541271.820029:0:17196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a682e75ea00/0x2aac941e5f4a8a7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541271.820042:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707818e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981161984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788541271.820086:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541271.820108:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6802daeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788541271.823902:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981161984 00000100:00100000:3.0:1788541271.823918:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981161984 00000100:00100000:3.0:1788541271.823985:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788541271.823994:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835709450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+20:17196:x1875420981161984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788541271.824011:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541271.824030:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6800031600/0x2aac941e5f4a8a83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a8a7c expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541271.824056:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6800031600/0x2aac941e5f4a8a83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a8a7c expref: 21 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541271.824068:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6800031600/0x2aac941e5f4a8a83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a8a7c expref: 21 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541271.824088:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6800031600, rc 0) 00000100:00100000:3.0:1788541271.824154:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835709450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+21:17196:x1875420981161984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (4068us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541271.824161:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788541271.824727:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707818e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981161984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788541271.824746:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a682e75ea00/0x2aac941e5f4a8a7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8a83 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541271.824755:0:17196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a682e75ea00/0x2aac941e5f4a8a7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a8a83 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541271.824817:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707818e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981162112:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788541271.824853:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541271.824907:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6802daeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788541271.825008:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981162112 00000100:00100000:3.0:1788541271.825013:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981162112 00000100:00100000:3.0:1788541271.825044:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788541271.825050:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683570ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+21:17196:x1875420981162112:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788541271.825062:0:17191:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788541271.825087:0:17191:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788541271.825091:0:17191:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1788541271.825162:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683570ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+21:17196:x1875420981162112:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 112us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541271.825169:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788541271.825241:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707818e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981162112:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788541271.825291:0:17196:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788541271.825297:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75ea00/0x2aac941e5f4a8a7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8a83 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541271.825305:0:17196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a682e75ea00/0x2aac941e5f4a8a7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8a83 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541271.887235:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788541272.403090:0:17231:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788541272.907096:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541273.935858:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541274.954192:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788541275.082276:0:18310:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788541275.082283:0:18310:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788541275.082287:0:18310:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788541275.082290:0:18310:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788541275.082328:0:18310:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788541275.082331:0:18310:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788541275.082334:0:18310:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788541275.082337:0:18310:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788541275.082515:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707818e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4746c063-6c88-4476-b99b-02bb8e8d54f7:3641:1875420981162240:0@lo:400:kworker.0 00000100:00100000:0.0:1788541275.082600:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541275.082643:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707818a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875420981162752:0@lo:400:kworker.0 00000100:00100000:0.0:1788541275.082666:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541275.082691:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788541275.082697:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670781aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981162368:0@lo:400:kworker.0 00000100:00100000:0.0:1788541275.082720:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541275.082738:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707819500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875420981162880:0@lo:400:kworker.0 00000100:00100000:0.0:1788541275.082758:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541275.082783:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707819180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875420981162496:0@lo:400:kworker.0 00000100:00100000:0.0:1788541275.082804:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541275.082819:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707818380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875420981163008:0@lo:400:kworker.0 00000100:00100000:0.0:1788541275.082848:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541275.082860:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788541275.082865:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981162624:0@lo:400:kworker.0 00000100:00100000:0.0:1788541275.082909:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541275.082941:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981162240 00000100:00100000:0.0:1788541275.082948:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981162240 00000100:00100000:0.0:1788541275.082995:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788541275.083004:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835709850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+21:3641:x1875420981162240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541275.083077:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835709850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+21:3641:x1875420981162240:12345-0@lo:400:kworker.0 Request processed in 74us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541275.083085:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788541275.083124:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981162752 00000100:00100000:0.0:1788541275.083128:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981162752 00000100:00100000:0.0:1788541275.083146:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981162880 00000100:00100000:0.0:1788541275.083149:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981162880 00000100:00100000:0.0:1788541275.083170:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981162496 00000100:00100000:0.0:1788541275.083173:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981162496 00000100:00100000:0.0:1788541275.083184:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981163008 00000100:00100000:0.0:1788541275.083186:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981163008 00000100:00100000:0.0:1788541275.083202:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788541275.083208:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670781a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875420981162752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541275.083242:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670781a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875420981162752:12345-0@lo:400:kworker.0 Request processed in 35us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541275.083248:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788541275.083260:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788541275.083266:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707819880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875420981162880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541275.083292:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707819880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875420981162880:12345-0@lo:400:kworker.0 Request processed in 27us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541275.083298:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788541275.083308:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788541275.083313:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670781b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875420981162496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541275.083342:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670781b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875420981162496:12345-0@lo:400:kworker.0 Request processed in 29us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541275.083348:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788541275.083359:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788541275.083372:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670781a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875420981163008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541275.083399:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670781a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875420981163008:12345-0@lo:400:kworker.0 Request processed in 29us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541275.083405:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788541275.083424:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981162368 00000100:00100000:0.0:1788541275.083428:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981162368 00000100:00100000:0.0:1788541275.083449:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981162624 00000100:00100000:0.0:1788541275.083452:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981162624 00000100:00100000:0.0:1788541275.083464:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788541275.083470:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707819c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981162368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541275.083502:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707819c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981162368:12345-0@lo:400:kworker.0 Request processed in 32us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541275.083508:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788541275.083520:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788541275.083526:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670781b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981162624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541275.083551:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670781b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981162624:12345-0@lo:400:kworker.0 Request processed in 26us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541275.083556:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1788541275.083599:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788541275.083604:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788541275.083637:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981162624:0@lo:400:kworker.0 00010000:00080000:0.0:1788541275.083650:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6707819180 x1875420981162496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541275.083660:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707819180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875420981162496:0@lo:400:kworker.0 00010000:00080000:0.0:1788541275.083670:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6707818380 x1875420981163008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541275.083691:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707818380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875420981163008:0@lo:400:kworker.0 00000100:00100000:0.0:1788541275.083730:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670781aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981162368:0@lo:400:kworker.0 00010000:00080000:0.0:1788541275.083741:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6707819500 x1875420981162880/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541275.083749:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707819500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875420981162880:0@lo:400:kworker.0 00000100:00100000:0.0:1788541275.083757:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707818e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4746c063-6c88-4476-b99b-02bb8e8d54f7:3641:1875420981162240:0@lo:400:kworker.0 00010000:00080000:0.0:1788541275.083765:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6707818a80 x1875420981162752/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541275.083772:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707818a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875420981162752:0@lo:400:kworker.0 00000100:00100000:1.0:1788541275.597654:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788541275.597680:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981163136:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788541275.597755:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541275.597804:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981163136 00000100:00100000:1.0:1788541275.597812:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981163136 00000100:00100000:1.0:1788541275.597859:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788541275.597907:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981163136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788541275.597942:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788541275.597988:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981163136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541275.597995:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788541275.598078:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981163136:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788541275.599194:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981163264:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788541275.599244:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541275.599312:0:18270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981163264 00000100:00100000:2.0:1788541275.599318:0:18270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981163264 00000100:00100000:2.0:1788541275.599355:0:18270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788541275.599364:0:18270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981163264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788541275.599388:0:18270:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788541275.609699:0:18270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981163264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 10326us (10444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541275.609715:0:18270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788541275.613396:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981163264:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788541275.982526:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788541276.623848:0:19081:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg256-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788541277.005678:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788541277.515238:0:19133:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788541277.515452:0:19133:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1788541277.706413:0:17950:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788541278.026364:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788541278.392704:0:19183:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788541278.392956:0:19183:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788541279.050204:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541280.023566:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788541265/real 1788541265] req@ffff9a670835f100 x1875420981156608/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788541280 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541280.023599:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a670835f100 x1875420981156608/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788541280 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541280.023609:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788541265/real 1788541265] req@ffff9a670835c000 x1875420981156736/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788541280 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541280.023620:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a670835c000 x1875420981156736/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788541280 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788541280.023641:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a682fdc6000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788541280.023699:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788541280.023703:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981156608:0@lo:8:kworker.0 00000100:00080000:2.0:1788541280.023709:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a68097af000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788541280.026465:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788541280.026476:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670835c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981156736:0@lo:8:kworker.0 00000100:00080000:3.0:1788541280.026766:0:18310:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788541280.026770:0:18310:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788541280.026773:0:18310:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788541280.026776:0:18310:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788541280.026790:0:18310:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788541280.026793:0:18310:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788541280.026797:0:18310:0:(import.c:65:import_set_state_nolock()) ffff9a682fdc6000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788541280.026802:0:18310:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 546 00000100:00080000:3.0:1788541280.026808:0:18310:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788541280.026814:0:18310:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9a682fdc6000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:3.0:1788541280.026833:0:18310:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6706830700 x1875420981163904/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788541280.026844:0:18310:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788541280.026846:0:18310:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788541280.026848:0:18310:0:(import.c:65:import_set_state_nolock()) ffff9a68097af000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788541280.026857:0:18310:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 546 00000100:00080000:3.0:1788541280.026859:0:18310:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788541280.026863:0:18310:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a68097af000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:3.0:1788541280.026897:0:18310:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6706831500 x1875420981164032/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788541280.026929:0:18310:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788541280.026932:0:18310:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788541280.026934:0:18310:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788541280.026936:0:18310:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788541280.026953:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981163520:0@lo:400:kworker.0 00000100:00100000:1.0:1788541280.026960:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981163776:0@lo:400:kworker.0 00000100:00100000:2.0:1788541280.027151:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981163904:0@lo:8:kworker.0 00000100:00100000:2.0:1788541280.027389:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541280.027389:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541280.027648:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981163904 00000100:00100000:0.0:1788541280.027657:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981163904 00000100:00100000:0.0:1788541280.027691:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788541280.027698:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1875420981163904:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788541280.027726:0:18716:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 560 last 0 00000020:00000080:0.0:1788541280.027759:0:18716:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2aac941e5f4a8a8a 00000100:00100000:2.0:1788541280.027961:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706831500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981164032:0@lo:8:kworker.0 00000100:00100000:2.0:1788541280.027988:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541280.028287:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875420981163648:0@lo:400:kworker.0 00000100:00100000:2.0:1788541280.028319:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541280.028341:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875420981164416:0@lo:400:kworker.0 00000100:00100000:2.0:1788541280.028363:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541280.028956:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981163648 00000100:00100000:2.0:1788541280.028964:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981163648 00000100:00100000:2.0:1788541280.029092:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981164416 00000100:00100000:2.0:1788541280.029097:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981164416 00000100:00100000:2.0:1788541280.029127:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788541280.029135:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875420981163648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541280.029194:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875420981163648:12345-0@lo:400:kworker.0 Request processed in 60us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541280.029202:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788541280.029218:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788541280.029224:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875420981164416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541280.029249:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875420981164416:12345-0@lo:400:kworker.0 Request processed in 26us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541280.029255:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1788541280.029363:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6706831180 x1875420981163648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541280.029377:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875420981163648:0@lo:400:kworker.0 00010000:00080000:2.0:1788541280.029387:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6705aa6680 x1875420981164416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541280.029407:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875420981164416:0@lo:400:kworker.0 00000100:00100000:2.0:1788541280.029952:0:18717:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788541280.029962:0:18717:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788541280.031960:0:18718:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788541280.031985:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981164032 00000100:00100000:2.0:1788541280.031993:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981164032 00000100:00100000:1.0:1788541280.032054:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788541280.032070:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4746c063-6c88-4476-b99b-02bb8e8d54f7:3641:1875420981163392:0@lo:400:kworker.0 00002000:00100000:0.0:1788541280.032203:0:18716:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9a683533a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1788541280.032210:0:18716:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1788541280.032213:0:18716:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1788541280.032253:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541280.032318:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875420981164160:0@lo:400:kworker.0 00000100:00100000:1.0:1788541280.032343:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:0.0:1788541280.032378:0:18716:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00100000:1.0:1788541280.032388:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981163776 00000100:00100000:1.0:1788541280.032392:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981163776 00000100:00080000:0.0:1788541280.032406:0:18716:0:(import.c:65:import_set_state_nolock()) ffff9a683533e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788541280.032422:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788541280.032429:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981163776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541280.032532:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981163776:12345-0@lo:400:kworker.0 Request processed in 103us (5144us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541280.032540:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788541280.032562:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981164160 00000100:00100000:1.0:1788541280.032565:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981164160 00000100:00100000:1.0:1788541280.032582:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788541280.032590:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1875420981163904:12345-0@lo:8:kworker.0 Request processed in 4893us (5203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541280.032597:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788541280.032611:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788541280.032615:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1875420981164032:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788541280.032632:0:18716:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788541280.032649:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875420981164160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541280.032682:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875420981164160:12345-0@lo:400:kworker.0 Request processed in 93us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541280.032689:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1788541280.032729:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6706832d80 x1875420981164160/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541280.032741:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875420981164160:0@lo:400:kworker.0 00000100:00100000:1.0:1788541280.032751:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981163776:0@lo:400:kworker.0 00000100:00080000:1.0:1788541280.033032:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788541280.033064:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6706830700 x1875420981163904/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788541300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541280.033073:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788541280.033079:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1788541280.033086:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788541280.033207:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788541280.033211:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a682fdc6000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788541280.033221:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788541280.033226:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981163904:0@lo:8:kworker.0 00000100:00100000:2.0:1788541280.034140:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981163392 00000100:00100000:2.0:1788541280.034147:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981163392 00000100:00100000:2.0:1788541280.034188:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788541280.034197:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683570b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+21:3641:x1875420981163392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541280.034249:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683570b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+21:3641:x1875420981163392:12345-0@lo:400:kworker.0 Request processed in 53us (1995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541280.034256:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788541280.034271:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788541280.034312:0:17939:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788541280.034332:0:17939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17939:1875420981164672:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1788541280.034335:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875420981164288:0@lo:400:kworker.0 00000100:00100000:3.0:1788541280.034356:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541280.034357:0:17939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541280.034372:0:17939:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68065e0d80 going to sleep for 11 seconds 00000004:00080000:2.0:1788541280.034385:0:17938:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1788541280.034407:0:18270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981163520 00000100:00100000:1.0:1788541280.034412:0:18270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981163520 00000100:00100000:1.0:1788541280.034436:0:18270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788541280.034443:0:18270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981163520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541280.034493:0:18270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981163520:12345-0@lo:400:kworker.0 Request processed in 50us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541280.034500:0:18270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000004:00080000:2.0:1788541280.034537:0:17938:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 560952665802ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788541280.034544:0:17938:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1788541280.034549:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981164288 00000100:00100000:3.0:1788541280.034552:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981164288 00000100:00100000:2.0:1788541280.034574:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981164544:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788541280.034585:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788541280.034600:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541280.034634:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4746c063-6c88-4476-b99b-02bb8e8d54f7:3641:1875420981163392:0@lo:400:kworker.0 00000100:00100000:2.0:1788541280.034670:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981164672 00000100:00100000:2.0:1788541280.034673:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981164672 00000100:00100000:3.0:1788541280.035206:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875420981164288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541280.035247:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875420981164288:12345-0@lo:400:kworker.0 Request processed in 656us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541280.035255:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1788541280.035272:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788541280.035277:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788541280.035298:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981163520:0@lo:400:kworker.0 00010000:00080000:3.0:1788541280.035310:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6706831f80 x1875420981164288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541280.035327:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875420981164288:0@lo:400:kworker.0 00000100:00100000:1.0:1788541280.035918:0:19250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788541280.035930:0:19250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17939:x1875420981164672:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1788541280.037057:0:17930:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:3.0:1788541280.038165:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981164544 00000100:00100000:3.0:1788541280.038176:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981164544 00000100:00100000:3.0:1788541280.038222:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788541280.038231:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3641:x1875420981164544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788541280.038258:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788541280.038332:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3641:x1875420981164544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (3731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541280.038339:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788541280.038382:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a67080d5500 x1875420981164544/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541296 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541280.038401:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981164544:0@lo:13:osp-pre-0-1.0 00002000:00080000:3.0:1788541280.048652:0:19250:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1788541280.048665:0:19250:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1788541280.048774:0:19250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17939:x1875420981164672:12345-0@lo:7:osp-pre-0-1.0 Request processed in 12842us (14411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541280.048792:0:19250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788541280.048924:0:17939:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a67080d4a80 x1875420981164672/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788541296 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541280.048955:0:17939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17939:1875420981164672:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1788541280.048970:0:17939:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:1.0:1788541280.049024:0:17939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708837b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17939:1875420981164800:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1788541280.049058:0:17939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541280.049085:0:17939:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67078719c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788541280.049190:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981164800 00000100:00100000:3.0:1788541280.049197:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981164800 00000100:00100000:3.0:1788541280.049277:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788541280.049287:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708837480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17939:x1875420981164800:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1788541280.049311:0:18717:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1788541280.049345:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708837480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17939:x1875420981164800:12345-0@lo:5:osp-pre-0-1.0 Request processed in 60us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541280.049352:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788541280.053328:0:17939:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6708837b80 x1875420981164800/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788541296 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541280.053345:0:17939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708837b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17939:1875420981164800:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1788541280.053360:0:17939:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1788541280.053409:0:17939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708837b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17939:1875420981164928:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1788541280.058586:0:17939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541280.058631:0:17939:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67078719c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788541280.059215:0:19250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981164928 00000100:00100000:2.0:1788541280.059225:0:19250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981164928 00000100:00100000:2.0:1788541280.059281:0:19250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788541280.059291:0:19250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708834700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17939:x1875420981164928:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1788541280.059336:0:19250:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:0.0:1788541280.061281:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1875420981164032:12345-0@lo:8:kworker.0 Request processed in 28660us (33287us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788541280.061294:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788541280.064374:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a68097af000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788541280.064384:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788541280.064389:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706831500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981164032:0@lo:8:kworker.0 00010000:00010000:0.0:1788541280.075108:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788541280.090758:0:18713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1788541280.090777:0:18713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1788541280.091325:0:19250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708834700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17939:x1875420981164928:12345-0@lo:5:osp-pre-0-1.0 Request processed in 32031us (32741us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788541280.091337:0:19250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788541280.096646:0:17939:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6708837b80 x1875420981164928/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788541296 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541280.096664:0:17939:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788541280.096671:0:17939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708837b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17939:1875420981164928:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1788541280.096690:0:17939:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:3.0:1788541280.107660:0:17939:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17939:1875420981165056:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788541280.107729:0:17939:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541280.107769:0:17939:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68080eed80 going to sleep for 11 seconds 00000100:00100000:1.0:1788541280.112253:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981165056 00000100:00100000:1.0:1788541280.112267:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981165056 00000100:00100000:1.0:1788541280.112338:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788541280.112348:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17939:x1875420981165056:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1788541280.112457:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17939:x1875420981165056:12345-0@lo:900:osp-pre-0-1.0 Request processed in 111us (4727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541280.112465:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788541280.113819:0:17939:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6705aa6300 x1875420981165056/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788541296 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541280.113835:0:17939:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17939:1875420981165056:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1788541280.719073:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981165184:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788541280.719143:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541280.719188:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981165312:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788541280.719209:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541280.719238:0:18270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981165184 00000100:00100000:1.0:1788541280.719245:0:18270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981165184 00000100:00100000:1.0:1788541280.719283:0:18270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981165312 00000100:00100000:1.0:1788541280.719286:0:18270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981165312 00000100:00100000:1.0:1788541280.719299:0:18270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788541280.719307:0:18270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981165184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788541280.719337:0:18270:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788541280.719376:0:18270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981165184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541280.719383:0:18270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788541280.719399:0:18270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788541280.719405:0:18270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981165312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788541280.719421:0:18270:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788541280.719448:0:18270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981165312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 43us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541280.719454:0:18270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788541280.719495:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981165184:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788541280.719529:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981165312:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788541281.099393:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541282.125774:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788541282.634720:0:17231:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788541283.146904:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541284.170766:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788541284.738677:0:19529:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788541284.738682:0:19529:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788541284.738683:0:19529:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788541284.738794:0:19529:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9a6839114000 00000020:01000004:2.0:1788541284.738810:0:19529:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788541284.739093:0:19529:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788541284.739110:0:19529:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9a682e748000) 00000020:00000080:2.0:1788541284.739129:0:19529:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788541284.785733:0:19529:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788541284.786484:0:19529:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788541284.786747:0:19529:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788541284.788454:0:19529:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788541284.788812:0:19529:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788541284.789195:0:19529:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788541284.789385:0:19529:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:2.0:1788541284.793741:0:19529:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788541284.794022:0:19529:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788541284.794038:0:19529:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788541284.794052:0:19529:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2aac941e5f4a8a98 00000020:01000004:2.0:1788541284.794068:0:19529:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788541284.794095:0:19529:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.156@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788541284.794106:0:19529:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.156@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788541284.794113:0:19529:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788541284.794146:0:19529:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1788541284.794150:0:19529:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.156@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788541284.825122:0:19529:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.156@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788541284.825170:0:19529:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.156@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1788541284.825175:0:19529:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788541284.825177:0:19529:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788541284.825179:0:19529:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788541284.825180:0:19529:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788541284.825181:0:19529:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788541284.825182:0:19529:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788541284.825184:0:19529:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788541284.825186:0:19529:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788541284.825187:0:19529:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788541284.825191:0:19529:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1788541284.825194:0:19529:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788541284.825195:0:19529:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788541284.825196:0:19529:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788541284.825197:0:19529:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788541284.825198:0:19529:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788541284.825200:0:19529:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788541284.825201:0:19529:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788541284.825202:0:19529:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788541284.825203:0:19529:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788541284.825233:0:19529:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788541284.825253:0:19529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708835f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:19529:1875420981165440:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788541284.825324:0:19529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541284.825709:0:19529:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a680529c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788541284.826668:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981165440 00000100:00100000:0.0:1788541284.826745:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981165440 00000100:00100000:0.0:1788541284.826808:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788541284.826819:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683570a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+21:19529:x1875420981165440:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788541284.826855:0:17191:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788541284.826859:0:17191:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788541284.826862:0:17191:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788541284.827684:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683570a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+21:19529:x1875420981165440:12345-0@lo:253:mount.lustre.0 Request processed in 863us (2355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541284.827695:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788541284.827831:0:19529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708835f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:19529:1875420981165440:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788541284.827844:0:19529:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788541284.827847:0:19529:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788541284.827849:0:19529:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788541284.827850:0:19529:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788541284.827851:0:19529:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788541284.827867:0:19529:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788541284.828072:0:19529:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788541284.828075:0:19529:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788541284.828077:0:19529:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788541284.828078:0:19529:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788541284.828281:0:19529:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a6839114000 from lustre-OST0001 10000000:01000000:2.0:1788541284.828324:0:19529:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788541284.828327:0:19529:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788541284.828340:0:19529:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a67079119c0 local copy 00010000:00010000:2.0:1788541284.828352:0:19529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a67075acc00/0x2aac941e5f4a87b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a87b9 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541284.828450:0:19529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:19529:1875420981165568:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788541284.828506:0:19529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541284.828545:0:19529:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683572b540 going to sleep for 11 seconds 00000100:00100000:0.0:1788541284.828561:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981165568 00000100:00100000:0.0:1788541284.828568:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981165568 00000100:00100000:0.0:1788541284.828608:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788541284.828616:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835709050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+21:19529:x1875420981165568:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788541284.828761:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835709050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+21:19529:x1875420981165568:12345-0@lo:501:mount.lustre.0 Request processed in 145us (266us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788541284.828775:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788541284.828939:0:19529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:19529:1875420981165568:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788541284.828969:0:19529:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.156@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788541284.828998:0:19529:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.156@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788541284.829005:0:19529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a67075acc00/0x2aac941e5f4a87b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a87b9 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541284.829014:0:19529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a67075acc00/0x2aac941e5f4a87b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a87b9 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541284.829039:0:19529:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a6839114000 10000000:01000000:3.0:1788541284.829044:0:19529:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788541284.829049:0:19529:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788541284.829051:0:19529:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788541284.829055:0:19529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788541284.829058:0:19529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788541284.829091:0:19529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68043ccc00/0x2aac941e5f4a8a9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541284.829099:0:19529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a68043ccc00/0x2aac941e5f4a8a9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541284.829114:0:19529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a68043ccc00/0x2aac941e5f4a8a9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541284.829126:0:19529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:19529:1875420981165696:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788541284.829152:0:19529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541284.829183:0:19529:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a682e6dd780 going to sleep for 11 seconds 00000100:00100000:0.0:1788541284.829262:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981165696 00000100:00100000:0.0:1788541284.829267:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981165696 00000100:00100000:0.0:1788541284.829300:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788541284.829307:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835708450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+21:19529:x1875420981165696:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788541284.829316:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541284.829329:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a682e75f000/0x2aac941e5f4a8aa6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a8a9f expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541284.829350:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a682e75f000/0x2aac941e5f4a8aa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a8a9f expref: 22 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541284.829361:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a682e75f000/0x2aac941e5f4a8aa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a8a9f expref: 22 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541284.829369:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75f000, rc 0) 00000100:00100000:0.0:1788541284.829397:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835708450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+22:19529:x1875420981165696:12345-0@lo:101:mount.lustre.0 Request processed in 90us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541284.829403:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788541284.829672:0:19529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:19529:1875420981165696:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788541284.829696:0:19529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a68043ccc00/0x2aac941e5f4a8a9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8aa6 expref: -99 pid: 19529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541284.829705:0:19529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a68043ccc00/0x2aac941e5f4a8a9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a8aa6 expref: -99 pid: 19529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788541284.831084:0:19529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788541284.833618:0:19529:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788541284.839006:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788541284.839062:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788541284.839074:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788541284.839086:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788541284.839097:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788541284.839108:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788541284.839132:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788541284.839137:0:19529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788541284.839245:0:19529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:19529:1875420981165824:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788541284.839311:0:19529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541284.839352:0:19529:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68029f5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788541284.840345:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981165824 00000100:00100000:2.0:1788541284.840359:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981165824 00000100:00100000:2.0:1788541284.840412:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788541284.840423:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835709c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+22:19529:x1875420981165824:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788541284.840605:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835709c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+22:19529:x1875420981165824:12345-0@lo:501:mount.lustre.0 Request processed in 184us (1294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541284.840614:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788541284.841106:0:19529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:19529:1875420981165824:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788541284.841172:0:19529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:19529:1875420981165952:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788541284.841218:0:19529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541284.841257:0:19529:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68029f5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788541284.841303:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981165952 00000100:00100000:0.0:1788541284.841308:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981165952 00000100:00100000:0.0:1788541284.841344:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788541284.841352:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683570bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+22:19529:x1875420981165952:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788541284.842684:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683570bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+22:19529:x1875420981165952:12345-0@lo:503:mount.lustre.0 Request processed in 1324us (1457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541284.842696:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788541284.843032:0:19529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:19529:1875420981165952:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788541284.843541:0:19529:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788541284.843637:0:19529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:19529:1875420981166080:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788541284.843705:0:19529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541284.843741:0:19529:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68029f5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788541284.843818:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981166080 00000100:00100000:0.0:1788541284.843830:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981166080 00000100:00100000:0.0:1788541284.844118:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788541284.844128:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683570a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+22:19529:x1875420981166080:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788541284.847428:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683570a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+22:19529:x1875420981166080:12345-0@lo:502:mount.lustre.0 Request processed in 3294us (3715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541284.847443:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788541284.847691:0:19529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:19529:1875420981166080:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788541284.848040:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788541284.848073:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788541284.848088:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788541284.848103:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788541284.848116:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788541284.848128:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788541284.848142:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788541284.848156:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788541284.848169:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1788541284.848206:0:19529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:19529:1875420981166208:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788541284.848719:0:19529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541284.848912:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981166208 00000100:00100000:0.0:1788541284.848919:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981166208 00000100:00100000:0.0:1788541284.849077:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788541284.849088:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+22:19529:x1875420981166208:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788541284.849210:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+22:19529:x1875420981166208:12345-0@lo:502:mount.lustre.0 Request processed in 124us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541284.851359:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788541284.851452:0:19529:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68029f5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788541284.851484:0:19529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:19529:1875420981166208:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788541284.851656:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1788541284.851672:0:19529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:0.0:1788541284.853212:0:19533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788541284.853222:0:19533:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1788541284.853228:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788541284.853231:0:19533:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788541284.853237:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788541284.853321:0:19533:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9a68353119c0) 00000020:00000080:0.0:1788541284.853348:0:19533:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788541284.853356:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788541284.853419:0:19533:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a6839114000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788541284.853428:0:19533:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788541284.853436:0:19533:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2aac941e5f4a8ab4 00010000:00010000:0.0:1788541284.859745:0:19533:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:0.0:1788541284.860595:0:19533:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:0.0:1788541284.863822:0:19533:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1788541284.867491:0:19533:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788541284.867515:0:19533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788541284.867522:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788541284.867525:0:19533:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788541284.867530:0:19533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788541284.867533:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788541284.867535:0:19533:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788541284.867538:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788541284.867540:0:19533:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788541284.867543:0:19533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788541284.867545:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788541284.867546:0:19533:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788541284.867549:0:19533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788541284.867551:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788541284.867552:0:19533:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788541284.867556:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788541284.867583:0:19533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788541284.867586:0:19533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788541284.867587:0:19533:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788541284.867590:0:19533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1788541284.867753:0:19529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1788541284.867786:0:19529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788541284.867809:0:19529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68043ccc00/0x2aac941e5f4a8a9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8aa6 expref: -99 pid: 19529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541284.867820:0:19529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a68043ccc00/0x2aac941e5f4a8a9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8aa6 expref: -99 pid: 19529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788541284.867828:0:19529:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a6839114000 from 1 10000000:01000000:1.0:1788541284.867831:0:19529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788541284.867865:0:19529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6706957600/0x2aac941e5f4a8abb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541284.867890:0:19529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a6706957600/0x2aac941e5f4a8abb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541284.867901:0:19529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a6706957600/0x2aac941e5f4a8abb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541284.867927:0:19529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708835f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:19529:1875420981166336:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788541284.868006:0:19529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541284.868048:0:19529:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a680529c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788541284.868078:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981166336 00000100:00100000:0.0:1788541284.868086:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981166336 00000100:00100000:0.0:1788541284.868182:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788541284.868191:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+22:19529:x1875420981166336:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788541284.868204:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541284.868218:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a682e75f400/0x2aac941e5f4a8ac2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a8abb expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541284.868244:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a682e75f400/0x2aac941e5f4a8ac2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a8abb expref: 23 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541284.868280:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a682e75f400/0x2aac941e5f4a8ac2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a8abb expref: 23 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541284.868288:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75f400, rc 0) 00000100:00100000:0.0:1788541284.868340:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+23:19529:x1875420981166336:12345-0@lo:101:mount.lustre.0 Request processed in 151us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541284.868347:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788541284.868433:0:19529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708835f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:19529:1875420981166336:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788541284.868448:0:19529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a6706957600/0x2aac941e5f4a8abb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8ac2 expref: -99 pid: 19529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541284.868456:0:19529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a6706957600/0x2aac941e5f4a8abb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a8ac2 expref: -99 pid: 19529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788541284.874897:0:19529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788541284.875217:0:19529:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788541284.876743:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788541284.877329:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788541284.877365:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788541284.877371:0:19529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788541284.877455:0:19529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:19529:1875420981166464:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788541284.877690:0:19529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541284.877770:0:19529:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6708307e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788541284.877857:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981166464 00000100:00100000:0.0:1788541284.877863:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981166464 00000100:00100000:0.0:1788541284.878093:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788541284.878104:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+23:19529:x1875420981166464:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788541284.878217:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+23:19529:x1875420981166464:12345-0@lo:501:mount.lustre.0 Request processed in 115us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541284.878224:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788541284.878341:0:19529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:19529:1875420981166464:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788541284.878374:0:19529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:19529:1875420981166592:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788541284.878407:0:19529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541284.878503:0:19529:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6708307e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788541284.878581:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981166592 00000100:00100000:3.0:1788541284.878586:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981166592 00000100:00100000:3.0:1788541284.878607:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788541284.878613:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+23:19529:x1875420981166592:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788541284.878690:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+23:19529:x1875420981166592:12345-0@lo:503:mount.lustre.0 Request processed in 76us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541284.878705:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788541284.878766:0:19529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:19529:1875420981166592:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788541284.879384:0:19529:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788541284.879444:0:19529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:19529:1875420981166720:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788541284.879483:0:19529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541284.879590:0:19529:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6708307e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788541284.879718:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981166720 00000100:00100000:0.0:1788541284.879723:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981166720 00000100:00100000:3.0:1788541284.879761:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788541284.879768:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+23:19529:x1875420981166720:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788541284.879855:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+23:19529:x1875420981166720:12345-0@lo:502:mount.lustre.0 Request processed in 87us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541284.879861:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788541284.880017:0:19529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:19529:1875420981166720:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788541284.880171:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788541284.880192:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788541284.880204:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788541284.880215:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788541284.880226:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788541284.880238:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788541284.880357:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788541284.880375:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1788541284.880386:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788541284.880408:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1788541284.880420:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1788541284.880441:0:19529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:19529:1875420981166848:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788541284.880472:0:19529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541284.880508:0:19529:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6708307e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788541284.880595:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981166848 00000100:00100000:3.0:1788541284.880599:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981166848 00000100:00100000:3.0:1788541284.880618:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788541284.880624:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+23:19529:x1875420981166848:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788541284.880694:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+23:19529:x1875420981166848:12345-0@lo:502:mount.lustre.0 Request processed in 69us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541284.880700:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788541284.880762:0:19529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:19529:1875420981166848:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788541284.880809:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1788541284.880822:0:19529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788541284.882212:0:19537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788541284.882225:0:19537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788541284.882227:0:19537:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788541284.882234:0:19537:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a6839114000 00000020:00000080:2.0:1788541284.882237:0:19537:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788541284.882244:0:19537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788541284.882404:0:19537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788541284.882405:0:19537:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788541284.882410:0:19537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788541284.882413:0:19537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788541284.882414:0:19537:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788541284.882418:0:19537:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a6839114000 00000020:00000080:2.0:1788541284.882420:0:19537:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788541284.882564:0:19537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788541284.882569:0:19537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788541284.882570:0:19537:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788541284.882573:0:19537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788541284.882575:0:19537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788541284.882577:0:19537:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788541284.882580:0:19537:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a6839114000 00000020:00000080:2.0:1788541284.882583:0:19537:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788541284.890338:0:19537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788541284.890352:0:19537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788541284.890355:0:19537:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788541284.890360:0:19537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788541284.890366:0:19537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788541284.890367:0:19537:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788541284.890372:0:19537:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a6839114000 00000020:00000080:2.0:1788541284.890375:0:19537:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788541284.890445:0:19537:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788541284.890448:0:19537:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788541284.890450:0:19537:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788541284.890453:0:19537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1788541284.893150:0:19529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788541284.893198:0:19529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788541284.893220:0:19529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a6706957600/0x2aac941e5f4a8abb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8ac2 expref: -99 pid: 19529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541284.893233:0:19529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a6706957600/0x2aac941e5f4a8abb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8ac2 expref: -99 pid: 19529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788541284.894864:0:19529:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788541284.894910:0:19529:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a6839114000 10000000:01000000:2.0:1788541284.894914:0:19529:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a6839114000 10000000:01000000:2.0:1788541284.894937:0:19529:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788541284.894944:0:19529:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9a6839114000 from 1 10000000:01000000:2.0:1788541284.894948:0:19529:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788541284.895000:0:19529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551b600/0x2aac941e5f4a8ac9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541284.895011:0:19529:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a683551b600/0x2aac941e5f4a8ac9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541284.895023:0:19529:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a683551b600/0x2aac941e5f4a8ac9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541284.895047:0:19529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:19529:1875420981166976:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788541284.895116:0:19529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541284.895167:0:19529:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6708307a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788541284.896363:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981166976 00000100:00100000:0.0:1788541284.896372:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981166976 00000100:00100000:0.0:1788541284.896422:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788541284.896431:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+23:19529:x1875420981166976:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788541284.896447:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541284.896461:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a682e75e000/0x2aac941e5f4a8ad0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a8ac9 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541284.896854:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a682e75e000/0x2aac941e5f4a8ad0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a8ac9 expref: 24 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541284.896901:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a682e75e000/0x2aac941e5f4a8ad0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a8ac9 expref: 24 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541284.896911:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75e000, rc 0) 00000100:00100000:0.0:1788541284.897594:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+24:19529:x1875420981166976:12345-0@lo:101:mount.lustre.0 Request processed in 1161us (2476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541284.897602:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788541284.897719:0:19529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:19529:1875420981166976:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788541284.897740:0:19529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a683551b600/0x2aac941e5f4a8ac9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8ad0 expref: -99 pid: 19529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541284.897761:0:19529:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a683551b600/0x2aac941e5f4a8ac9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a8ad0 expref: -99 pid: 19529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788541284.906607:0:19529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:1.0:1788541284.907779:0:19529:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788541284.908088:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788541284.908119:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788541284.908134:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788541284.908149:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788541284.908165:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788541284.908179:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788541284.908195:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788541284.908211:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788541284.908243:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788541284.908259:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788541284.908271:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788541284.908283:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788541284.908296:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788541284.908310:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788541284.908325:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788541284.908339:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788541284.908354:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788541284.908517:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788541284.908538:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788541284.908552:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788541284.908564:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788541284.908579:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788541284.908596:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788541284.908619:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788541284.908652:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1788541284.908741:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1788541284.908762:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1788541284.908780:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1788541284.908800:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1788541284.908828:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1788541284.908846:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1788541284.908864:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1788541284.908919:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1788541284.908939:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1788541284.908968:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1788541284.908984:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1788541284.908996:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1788541284.909008:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1788541284.909019:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:1.0:1788541284.909031:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:1.0:1788541284.909060:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:1.0:1788541284.909074:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:1.0:1788541284.909085:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:1.0:1788541284.909096:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:1.0:1788541284.909109:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:1.0:1788541284.909126:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:1.0:1788541284.909154:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:1.0:1788541284.909160:0:19529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:1.0:1788541284.909271:0:19529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708835f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:19529:1875420981167104:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788541284.909341:0:19529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541284.909586:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981167104 00000100:00100000:2.0:1788541284.909596:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981167104 00000100:00100000:1.0:1788541284.909601:0:19529:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a680529c780 going to sleep for 11 seconds 00000100:00100000:2.0:1788541284.909652:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788541284.909663:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+24:19529:x1875420981167104:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788541284.909789:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+24:19529:x1875420981167104:12345-0@lo:501:mount.lustre.0 Request processed in 127us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541284.909797:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788541284.909825:0:19529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708835f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:19529:1875420981167104:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788541284.909863:0:19529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708835f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:19529:1875420981167232:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788541284.910312:0:19529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541284.910336:0:19529:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a680529c780 going to sleep for 11 seconds 00000100:00100000:0.0:1788541284.910747:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981167232 00000100:00100000:0.0:1788541284.910754:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981167232 00000100:00100000:0.0:1788541284.910801:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788541284.910811:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+24:19529:x1875420981167232:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788541284.910971:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+24:19529:x1875420981167232:12345-0@lo:503:mount.lustre.0 Request processed in 162us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541284.910979:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788541284.911092:0:19529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708835f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:19529:1875420981167232:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788541284.912409:0:19529:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788541284.912568:0:19529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:19529:1875420981167360:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788541284.912638:0:19529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541284.912681:0:19529:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6708307a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788541284.912756:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981167360 00000100:00100000:0.0:1788541284.912764:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981167360 00000100:00100000:0.0:1788541284.912850:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788541284.912861:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+24:19529:x1875420981167360:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788541284.913040:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+24:19529:x1875420981167360:12345-0@lo:502:mount.lustre.0 Request processed in 181us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541284.913048:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788541284.913134:0:19529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:19529:1875420981167360:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788541284.913331:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788541284.913356:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788541284.913386:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788541284.913404:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788541284.913419:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788541284.913452:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788541284.913468:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788541284.913483:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788541284.913498:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788541284.913510:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788541284.913534:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788541284.913549:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788541284.913566:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788541284.913581:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788541284.913599:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788541284.913613:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788541284.913627:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788541284.913640:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788541284.913657:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788541284.913683:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788541284.913700:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788541284.913725:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788541284.913741:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788541284.913757:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788541284.913768:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1788541284.913784:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1788541284.913797:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1788541284.913810:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1788541284.913823:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1788541284.913837:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1788541284.913851:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1788541284.913864:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1788541284.913905:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1788541284.913930:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1788541284.913944:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1788541284.913976:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1788541284.913991:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1788541284.914018:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1788541284.914033:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1788541284.914045:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1788541284.914056:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1788541284.914067:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1788541284.914080:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1788541284.914104:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1788541284.914119:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1788541284.914131:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1788541284.914141:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1788541284.914153:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1788541284.914198:0:19529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:19529:1875420981167488:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788541284.914256:0:19529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541284.914821:0:19529:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6708307a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788541284.915076:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981167488 00000100:00100000:1.0:1788541284.915085:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981167488 00000100:00100000:1.0:1788541284.915137:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788541284.915148:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+24:19529:x1875420981167488:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788541284.915322:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+24:19529:x1875420981167488:12345-0@lo:502:mount.lustre.0 Request processed in 175us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541284.915331:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788541284.915658:0:19529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:19529:1875420981167488:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788541284.916132:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1788541284.916157:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1788541284.916187:0:19529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:19529:1875420981167616:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788541284.916235:0:19529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541284.917082:0:19529:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6708307a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788541284.917124:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981167616 00000100:00100000:1.0:1788541284.917132:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981167616 00000100:00100000:1.0:1788541284.917192:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788541284.917204:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+24:19529:x1875420981167616:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788541284.917385:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+24:19529:x1875420981167616:12345-0@lo:502:mount.lustre.0 Request processed in 182us (1148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541284.917394:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788541284.918137:0:19529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:19529:1875420981167616:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788541284.918265:0:19529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1788541284.918280:0:19529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788541284.919155:0:19542:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788541284.919172:0:19542:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9a6831d419c0) 00000020:00000080:0.0:1788541284.919201:0:19542:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:0.0:1788541284.919281:0:19542:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a6839114000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788541284.919285:0:19542:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a6839114000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788541284.919295:0:19542:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a6839114000 3 00010000:00080000:0.0:1788541284.919327:0:19542:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a670190c000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.156@tcp at head 00010000:00010000:1.0:1788541284.922608:0:19542:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1788541284.922888:0:19542:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788541284.922936:0:19542:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788541284.922947:0:19542:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x2aac941e5f4a8ade 00000100:00080000:1.0:1788541284.922966:0:19542:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788541284.922972:0:19542:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a670190c000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:1.0:1788541284.923007:0:19542:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6708837b80 x1875420981167744/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788541284.923038:0:19542:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788541284.923063:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875420981167744:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788541284.923101:0:18310:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788541284.923106:0:18310:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788541284.923109:0:18310:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788541284.923112:0:18310:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788541284.923140:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788541284.923158:0:18310:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788541284.923170:0:18310:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788541284.923172:0:18310:0:(import.c:65:import_set_state_nolock()) ffff9a68097af000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788541284.923178:0:18310:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 560 00000100:00080000:1.0:1788541284.923183:0:18310:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788541284.923195:0:18310:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a68097af000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:3.0:1788541284.923205:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981167744 00000100:00100000:1.0:1788541284.923211:0:18310:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6708835c00 x1875420981168384/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788541284.923212:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981167744 00000100:00100000:3.0:1788541284.923248:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788541284.923255:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875420981167744:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788541284.923279:0:17200:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 565 last 0 00000020:00000080:3.0:1788541284.923308:0:17200:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x2aac941e5f4a8ae5 00000004:00100000:3.0:1788541284.923324:0:17200:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788541284.923354:0:17200:0:(import.c:65:import_set_state_nolock()) ffff9a682ff99000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788541284.923404:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1875420981167744:12345-0@lo:38:llog_process_th.0 Request processed in 149us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541284.923411:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788541284.923437:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981168384:0@lo:8:kworker.0 00000100:00100000:3.0:1788541284.923464:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788541284.923497:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6708837b80 x1875420981167744/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788541294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541284.923508:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788541284.923515:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1788541284.923521:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788541284.923525:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788541284.923527:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a670190c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788541284.923532:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3640:1875420981167744:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788541284.923569:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981168384 00000100:00100000:3.0:1788541284.923573:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981168384 00000100:00100000:3.0:1788541284.923599:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788541284.923604:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3640:x1875420981168384:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788541284.923643:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3640:x1875420981168384:12345-0@lo:8:kworker.0 Request processed in 38us (178us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788541284.923649:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788541284.923740:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788541284.923745:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a68097af000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788541284.923748:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788541284.923751:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981168384:0@lo:8:kworker.0 00000100:00100000:1.0:1788541284.924891:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981167872:0@lo:400:kworker.0 00000100:00100000:1.0:1788541284.924941:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541284.924980:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708834e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875420981168512:0@lo:400:kworker.0 00000100:00100000:1.0:1788541284.925004:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541284.925026:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788541284.925033:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981168256:0@lo:400:kworker.0 00000100:00100000:1.0:1788541284.925055:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541284.925084:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875420981168000:0@lo:400:kworker.0 00000100:00100000:1.0:1788541284.925108:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541284.925122:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875420981168640:0@lo:400:kworker.0 00000100:00100000:1.0:1788541284.925142:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541284.925156:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788541284.925162:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981168128:0@lo:400:kworker.0 00000100:00100000:1.0:1788541284.925183:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541284.925200:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875420981168768:0@lo:400:kworker.0 00000100:00100000:1.0:1788541284.925223:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541284.925248:0:18270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981167872 00000100:00100000:1.0:1788541284.925254:0:18270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981167872 00000100:00100000:1.0:1788541284.925294:0:18270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981168128 00000100:00100000:1.0:1788541284.925298:0:18270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981168128 00000100:00100000:1.0:1788541284.925311:0:18270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788541284.925319:0:18270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981167872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541284.925937:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788541284.925948:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981168128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541284.926005:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981168128:12345-0@lo:400:kworker.0 Request processed in 60us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541284.926012:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788541284.927025:0:18270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981167872:12345-0@lo:400:kworker.0 Request processed in 47us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541284.927035:0:18270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788541284.927223:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981168128:0@lo:400:kworker.0 00000100:00100000:1.0:1788541284.927256:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981167872:0@lo:400:kworker.0 00000100:00100000:3.0:1788541284.927489:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981168512 00000100:00100000:3.0:1788541284.927497:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981168512 00000100:00100000:3.0:1788541284.927537:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981168000 00000100:00100000:3.0:1788541284.927541:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981168000 00000100:00100000:3.0:1788541284.927554:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981168640 00000100:00100000:3.0:1788541284.927557:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981168640 00000100:00100000:3.0:1788541284.927586:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981168768 00000100:00100000:3.0:1788541284.927590:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981168768 00000100:00080000:1.0:1788541284.927607:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788541284.927613:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1788541284.927615:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788541284.927624:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875420981168512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541284.927707:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875420981168512:12345-0@lo:400:kworker.0 Request processed in 85us (2701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541284.927714:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788541284.927729:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788541284.927736:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875420981168000:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1788541284.927760:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6708834e00 x1875420981168512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541284.927772:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708834e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875420981168512:0@lo:400:kworker.0 00000100:00100000:3.0:1788541284.927791:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875420981168000:12345-0@lo:400:kworker.0 Request processed in 53us (2679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541284.927798:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788541284.927813:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788541284.927821:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875420981168640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541284.927856:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875420981168640:12345-0@lo:400:kworker.0 Request processed in 36us (2713us total) trans 0 rc 0/0 00010000:00080000:2.0:1788541284.927863:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6708836680 x1875420981168000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541284.927867:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788541284.927913:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875420981168000:0@lo:400:kworker.0 00010000:00080000:2.0:1788541284.927942:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6708837100 x1875420981168640/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541284.927959:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875420981168640:0@lo:400:kworker.0 00000100:00100000:0.0:1788541284.928065:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981168256 00000100:00100000:0.0:1788541284.928071:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981168256 00000100:00100000:0.0:1788541284.928125:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788541284.928135:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981168256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541284.928167:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788541284.928175:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670835f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875420981168768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541284.928182:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981168256:12345-0@lo:400:kworker.0 Request processed in 49us (3124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541284.928190:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788541284.928217:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670835f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875420981168768:12345-0@lo:400:kworker.0 Request processed in 43us (2991us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541284.928224:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000020:01000004:0.0:1788541284.928310:0:19542:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788541284.928326:0:19542:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9a6831d43380) 00000020:00000080:0.0:1788541284.928348:0:19542:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1788541284.928469:0:19542:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a6839114000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788541284.928474:0:19542:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a6839114000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788541284.928476:0:19542:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a6839114000 3 00010000:00080000:0.0:1788541284.928507:0:19542:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a6705aea800@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.156@tcp at head 00010000:00010000:0.0:1788541284.930315:0:19542:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00010000:00080000:2.0:1788541284.931058:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6708835c00 x1875420981168768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541284.931074:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875420981168768:0@lo:400:kworker.0 00000100:00080000:1.0:1788541284.931188:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788541284.931217:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a6708835f80 x1875420981168256/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541284.931228:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981168256:0@lo:400:kworker.0 00000020:00000080:2.0:1788541284.932273:0:19542:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1788541284.932354:0:19542:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788541284.932436:0:19542:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x2aac941e5f4a8af3 00000100:00080000:2.0:1788541284.932448:0:19542:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788541284.932454:0:19542:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9a6705aea800 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:2.0:1788541284.932500:0:19542:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a67080d5880 x1875420981168896/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788541284.932566:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875420981168896:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788541284.932642:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788541284.932709:0:19542:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788541284.933461:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981168896 00000100:00100000:1.0:1788541284.933469:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981168896 00000100:00100000:1.0:1788541284.933546:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788541284.933554:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1875420981168896:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788541284.933589:0:17200:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 565 last 0 00000020:00000080:1.0:1788541284.933632:0:17200:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x2aac941e5f4a8afa 00000004:00100000:1.0:1788541284.933650:0:17200:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788541284.933693:0:17200:0:(import.c:65:import_set_state_nolock()) ffff9a682e794000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788541284.933767:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1875420981168896:12345-0@lo:38:llog_process_th.0 Request processed in 212us (1125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541284.933774:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788541284.933919:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a67080d5880 x1875420981168896/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788541294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541284.933930:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788541284.933938:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1788541284.933945:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788541284.933960:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788541284.933968:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a6705aea800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788541284.933975:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3640:1875420981168896:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788541284.934225:0:18310:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788541284.934230:0:18310:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788541284.934233:0:18310:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788541284.934236:0:18310:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1788541284.934460:0:19542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1788541284.934686:0:19529:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788541284.934722:0:19529:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788541284.934739:0:19529:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551b600/0x2aac941e5f4a8ac9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8ad0 expref: -99 pid: 19529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541284.934751:0:19529:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a683551b600/0x2aac941e5f4a8ac9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8ad0 expref: -99 pid: 19529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788541284.934799:0:19529:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788541284.934802:0:19529:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788541284.934803:0:19529:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788541284.934804:0:19529:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788541284.934805:0:19529:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788541284.934806:0:19529:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788541284.934808:0:19529:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788541284.934810:0:19529:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788541284.934811:0:19529:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788541284.934815:0:19529:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1788541284.934817:0:19529:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788541284.934822:0:19529:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788541284.934823:0:19529:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788541284.934824:0:19529:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788541284.934824:0:19529:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788541284.934825:0:19529:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788541284.934826:0:19529:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788541284.934827:0:19529:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788541284.934828:0:19529:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788541284.934846:0:19529:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788541284.934861:0:19529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708835c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:19529:1875420981169024:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788541284.934933:0:19529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541284.934977:0:19529:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a680529c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788541284.935111:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981169024 00000100:00100000:0.0:1788541284.935117:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981169024 00000100:00100000:0.0:1788541284.935168:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788541284.935183:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+24:19529:x1875420981169024:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788541284.935206:0:17193:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788541284.935225:0:17193:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788541284.937241:0:17193:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788541284.937284:0:17193:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788541284.937653:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+24:19529:x1875420981169024:12345-0@lo:253:mount.lustre.0 Request processed in 2466us (2707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541284.937665:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788541284.937796:0:19529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708835c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4746c063-6c88-4476-b99b-02bb8e8d54f7:19529:1875420981169024:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788541284.937815:0:19529:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788541284.937819:0:19529:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788541284.937821:0:19529:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788541284.937822:0:19529:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788541284.937823:0:19529:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788541284.937824:0:19529:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788541284.937825:0:19529:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788541284.937827:0:19529:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788541284.937828:0:19529:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788541284.937830:0:19529:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788541284.937848:0:19529:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1788541284.944893:0:17214:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788541284.944905:0:17214:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788541284.944930:0:17214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a682e75f800/0x2aac941e5f4a8b01 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541284.944960:0:17214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a67075ac800/0x2aac941e5f4a8a75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a8a6e expref: 23 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541284.944969:0:17214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6800031600/0x2aac941e5f4a8a83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a8a7c expref: 23 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541284.944977:0:17214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a682e75f800/0x2aac941e5f4a8b01 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541284.945029:0:17214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6800031600/0x2aac941e5f4a8a83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a8a7c expref: 23 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541284.945046:0:17214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6800031600/0x2aac941e5f4a8a83 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a8a7c expref: 23 pid: 17192 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541284.945061:0:17214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707818a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17214:1875420981169152:0@lo:104: 00000100:00100000:0.0:1788541284.945138:0:17214:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788541284.945186:0:17214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a67075ac800/0x2aac941e5f4a8a75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a8a6e expref: 23 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541284.945195:0:17214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a67075ac800/0x2aac941e5f4a8a75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a8a6e expref: 23 pid: 17191 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541284.945205:0:17214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707819500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17214:1875420981169280:0@lo:104: 00000100:00100000:0.0:1788541284.945231:0:17214:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541284.945248:0:17214:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68077d39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788541284.945325:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981169152 00000100:00100000:1.0:1788541284.945333:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981169152 00000100:00100000:1.0:1788541284.945381:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981169280 00000100:00100000:1.0:1788541284.945385:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981169280 00000100:00100000:1.0:1788541284.945404:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788541284.945413:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707818e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4746c063-6c88-4476-b99b-02bb8e8d54f7+4:17214:x1875420981169152:12345-0@lo:104: 00010000:00010000:1.0:1788541284.945427:0:17181:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a682e75ea00/0x2aac941e5f4a8a7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a8a83 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541284.945493:0:17181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788541284.945501:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707818e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4746c063-6c88-4476-b99b-02bb8e8d54f7+4:17214:x1875420981169152:12345-0@lo:104: Request processed in 88us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541284.945509:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788541284.945530:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788541284.945538:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670781aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4746c063-6c88-4476-b99b-02bb8e8d54f7+3:17214:x1875420981169280:12345-0@lo:104: 00010000:00010000:1.0:1788541284.945553:0:17181:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a8a6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a8a75 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541284.945596:0:17181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788541284.945602:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670781aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4746c063-6c88-4476-b99b-02bb8e8d54f7+3:17214:x1875420981169280:12345-0@lo:104: Request processed in 66us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541284.945609:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1788541284.945619:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788541284.945633:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a682e75ea00/0x2aac941e5f4a8a7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a8a83 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541284.945633:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788541284.945645:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75ea00 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:3.0:1788541284.945649:0:17186:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a682e75ea00/0x2aac941e5f4a8a7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a8a83 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541284.945657:0:17186:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a682e75ea00/0x2aac941e5f4a8a7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a8a83 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788541284.945665:0:17186:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a682e75ea00/0x2aac941e5f4a8a7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a8a83 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541284.945670:0:17186:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788541284.945700:0:17186:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a682e75ea00/0x2aac941e5f4a8a7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a8a83 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541284.945707:0:17186:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788541284.945727:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a682e75ea00/0x2aac941e5f4a8a7c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a8a83 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541284.945734:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a682e75ea00/0x2aac941e5f4a8a7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a8a83 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541284.945744:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541284.945746:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541284.945748:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541284.945766:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4746c063-6c88-4476-b99b-02bb8e8d54f7:3643:1875420981169408:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788541284.945795:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541284.945837:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981169408 00000100:00100000:3.0:1788541284.945845:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981169408 00010000:00010000:3.0:1788541284.947099:0:17184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6800031600/0x2aac941e5f4a8a83 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a8a7c expref: 24 pid: 17192 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541284.947142:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788541284.947155:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4746c063-6c88-4476-b99b-02bb8e8d54f7+24:3643:x1875420981169408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788541284.947184:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541284.947190:0:17184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6800031600/0x2aac941e5f4a8a83 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a8a7c expref: 24 pid: 17192 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541284.947201:0:17184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6800031600/0x2aac941e5f4a8a83 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a8a7c expref: 24 pid: 17192 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541284.947218:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541284.947272:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4746c063-6c88-4476-b99b-02bb8e8d54f7+24:3643:x1875420981169408:12345-0@lo:103:ldlm_bl.0 Request processed in 122us (1475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541284.947280:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788541284.947329:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4746c063-6c88-4476-b99b-02bb8e8d54f7:3643:1875420981169408:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788541284.947491:0:17214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6800031600/0x2aac941e5f4a8a83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a8a7c expref: 23 pid: 17192 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541284.947504:0:17214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707818a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17214:1875420981169152:0@lo:104: 00000100:00100000:0.0:1788541284.947514:0:17214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707819500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17214:1875420981169280:0@lo:104: 00010000:00010000:0.0:1788541284.947531:0:17214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a682e75f800/0x2aac941e5f4a8b01 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541284.952002:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541284.952016:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a8a6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a8a75 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541284.952029:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75e200 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:3.0:1788541284.952033:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a8a6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a8a75 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541284.952044:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a8a6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a8a75 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788541284.952052:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a8a6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a8a75 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541284.952068:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788541284.952112:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a8a6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a8a75 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541284.952119:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788541284.952140:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a8a6e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a8a75 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541284.952148:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a682e75e200/0x2aac941e5f4a8a6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a8a75 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541284.952166:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541284.952168:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541284.952170:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541284.952196:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4746c063-6c88-4476-b99b-02bb8e8d54f7:3644:1875420981169536:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788541284.952264:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541284.952334:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981169536 00000100:00100000:3.0:1788541284.952342:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981169536 00010000:00010000:3.0:1788541284.952367:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a67075ac800/0x2aac941e5f4a8a75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a8a6e expref: 23 pid: 17191 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541284.952394:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788541284.952401:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4746c063-6c88-4476-b99b-02bb8e8d54f7+23:3644:x1875420981169536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788541284.952413:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541284.952418:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a67075ac800/0x2aac941e5f4a8a75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a8a6e expref: 23 pid: 17191 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541284.952429:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a67075ac800/0x2aac941e5f4a8a75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a8a6e expref: 23 pid: 17191 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541284.952449:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a67075ac800/0x2aac941e5f4a8a75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a8a6e expref: 23 pid: 17191 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541284.952461:0:17185:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a682e75f800/0x2aac941e5f4a8b01 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541284.952468:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a682e75f800/0x2aac941e5f4a8b01 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788541284.952481:0:17185:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007577613s 00010000:00010000:3.0:1788541284.952486:0:17185:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a682e75f800/0x2aac941e5f4a8b01 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541284.952493:0:17185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a682e75f800/0x2aac941e5f4a8b01 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541284.952500:0:17185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a682e75f800/0x2aac941e5f4a8b01 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541284.952507:0:17185:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a682e75f800/0x2aac941e5f4a8b01 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541284.952512:0:17185:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75f800 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:3.0:1788541284.952516:0:17185:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a682e75f800/0x2aac941e5f4a8b01 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541284.952524:0:17185:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a682e75f800/0x2aac941e5f4a8b01 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541284.952541:0:17185:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a682e75f800/0x2aac941e5f4a8b01 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541284.952558:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541284.952648:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4746c063-6c88-4476-b99b-02bb8e8d54f7+22:3644:x1875420981169536:12345-0@lo:103:ldlm_bl.0 Request processed in 246us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541284.952655:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1788541284.952681:0:17214:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a682e75f800/0x2aac941e5f4a8b01 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541284.952689:0:17214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a682e75f800/0x2aac941e5f4a8b01 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541284.952694:0:17214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a682e75f800/0x2aac941e5f4a8b01 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541284.952707:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541284.952709:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541284.954466:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4746c063-6c88-4476-b99b-02bb8e8d54f7:3644:1875420981169536:0@lo:103:ldlm_bl.0 00000001:00000004:1.0:1788541284.961645:0:19529:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1788541284.965188:0:19529:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788541284.965203:0:19529:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788541284.965248:0:19529:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788541284.965298:0:19529:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.156@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788541284.965321:0:19529:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1788541284.965350:0:19529:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1788541284.967164:0:19529:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788541284.968065:0:19529:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788541285.203207:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541285.322024:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788541285.322046:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981169664:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788541285.322112:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541285.322141:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981169664 00000100:00100000:0.0:1788541285.322150:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981169664 00000100:00100000:0.0:1788541285.322203:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788541285.322292:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981169664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788541285.322323:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788541285.322380:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981169664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (266us total) trans 0 rc 0/0 00010000:00080000:2.0:1788541285.322434:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6705aa5f80 x1875420981169664/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541301 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541285.322454:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981169664:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788541285.329195:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788541285.837272:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981169792:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788541285.837349:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541285.837414:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981169920:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788541285.837448:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541285.837496:0:18270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981169792 00000100:00100000:2.0:1788541285.837504:0:18270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981169792 00000100:00100000:2.0:1788541285.837553:0:18270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981169920 00000100:00100000:2.0:1788541285.837557:0:18270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981169920 00000100:00100000:2.0:1788541285.837576:0:18270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788541285.837586:0:18270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981169792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788541285.837626:0:18270:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788541285.837686:0:18270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981169792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541285.837694:0:18270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788541285.837710:0:18270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788541285.837717:0:18270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981169920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788541285.837732:0:18270:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788541285.837763:0:18270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981169920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 46us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541285.837769:0:18270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788541285.837816:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981169920:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788541285.837896:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981169792:0@lo:41:osp-pre-0-1.0 00000020:00000004:1.0:1788541285.880565:0:19596:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788541285.880808:0:19596:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788541286.217990:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788541286.795975:0:17196:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788541286.795984:0:17196:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a683f356800 from 10 10000000:01000000:2.0:1788541286.795990:0:17196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788541286.796041:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551a000/0x2aac941e5f4a8b08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541286.796053:0:17196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a683551a000/0x2aac941e5f4a8b08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541286.796066:0:17196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a683551a000/0x2aac941e5f4a8b08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541286.796110:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981170048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788541286.796186:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541286.796272:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6707570b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788541286.797910:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981170048 00000100:00100000:1.0:1788541286.797922:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981170048 00000100:00100000:1.0:1788541286.798060:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788541286.798072:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+22:17196:x1875420981170048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788541286.798090:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541286.798106:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6706956200/0x2aac941e5f4a8b0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a8b08 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541286.798132:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6706956200/0x2aac941e5f4a8b0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a8b08 expref: 23 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541286.798157:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6706956200/0x2aac941e5f4a8b0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a8b08 expref: 23 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541286.798166:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6706956200, rc 0) 00000100:00100000:1.0:1788541286.798248:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+23:17196:x1875420981170048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (2060us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541286.798255:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788541286.798346:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981170048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788541286.798365:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a683551a000/0x2aac941e5f4a8b08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8b0f expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541286.798375:0:17196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a683551a000/0x2aac941e5f4a8b08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a8b0f expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541286.798437:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981170176:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788541286.798482:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541286.801674:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68394b56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788541286.810965:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981170176 00000100:00100000:2.0:1788541286.810981:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981170176 00000100:00100000:2.0:1788541286.811060:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788541286.811072:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+23:17196:x1875420981170176:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788541286.811102:0:17192:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788541286.811118:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788541286.811121:0:17192:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1788541286.811261:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+23:17196:x1875420981170176:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 191us (12777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541286.811268:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788541286.812948:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981170176:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788541286.813035:0:17196:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788541286.813047:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551a000/0x2aac941e5f4a8b08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8b0f expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541286.813058:0:17196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a683551a000/0x2aac941e5f4a8b08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8b0f expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541286.813068:0:17196:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788541286.813072:0:17196:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9a67082f3800 from 10 10000000:01000000:3.0:1788541286.813075:0:17196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788541286.813108:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68043cda00/0x2aac941e5f4a8b16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541286.813116:0:17196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a68043cda00/0x2aac941e5f4a8b16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541286.813125:0:17196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a68043cda00/0x2aac941e5f4a8b16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541286.813143:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981170304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788541286.813195:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541286.813236:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68394b56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788541286.813258:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981170304 00000100:00100000:3.0:1788541286.813264:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981170304 00000100:00100000:3.0:1788541286.813298:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788541286.813306:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68378a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+23:17196:x1875420981170304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788541286.813328:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541286.813342:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a68043cd400/0x2aac941e5f4a8b1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a8b16 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541286.813368:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68043cd400/0x2aac941e5f4a8b1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a8b16 expref: 24 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541286.813378:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a68043cd400/0x2aac941e5f4a8b1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a8b16 expref: 24 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541286.813388:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68043cd400, rc 0) 00000100:00100000:3.0:1788541286.813422:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68378a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+24:17196:x1875420981170304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541286.813429:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788541286.813465:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981170304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788541286.813477:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a68043cda00/0x2aac941e5f4a8b16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8b1d expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541286.813486:0:17196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a68043cda00/0x2aac941e5f4a8b16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a8b1d expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541286.813526:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981170432:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788541286.813557:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541286.813570:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68394b56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788541286.813581:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981170432 00000100:00100000:3.0:1788541286.813585:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981170432 00000100:00100000:3.0:1788541286.813603:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788541286.813609:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68378a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+24:17196:x1875420981170432:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788541286.813627:0:17192:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788541286.813642:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788541286.813645:0:17192:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1788541286.813710:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68378a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+24:17196:x1875420981170432:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 100us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541286.813716:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788541286.813740:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981170432:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788541286.817744:0:17196:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788541286.818879:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68043cda00/0x2aac941e5f4a8b16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8b1d expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541286.818897:0:17196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a68043cda00/0x2aac941e5f4a8b16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8b1d expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541286.985983:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788541266/real 1788541266] req@ffff9a67080d7100 x1875420981157120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788541286 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541286.986020:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a67080d7100 x1875420981157120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788541286 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541286.986031:0:3640:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788541266/real 1788541266] req@ffff9a67080d6680 x1875420981157248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788541286 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541286.986042:0:3640:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a67080d6680 x1875420981157248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788541286 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788541286.986062:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a682ff81800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788541286.986083:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788541286.986087:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981157120:0@lo:8:kworker.0 00000100:00080000:1.0:1788541286.986093:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a682ff82000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788541286.986098:0:3640:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788541286.986101:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981157248:0@lo:8:kworker.0 00000100:00100000:2.0:1788541286.986290:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:3.0:1788541286.986312:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788541286.986317:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788541286.986320:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a682ff81800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788541286.986325:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 547 00000100:00080000:3.0:1788541286.986330:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788541286.986336:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a682ff81800 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:3.0:1788541286.986354:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6705aa5180 x1875420981170688/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788541286.986369:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788541286.986381:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788541286.986382:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a682ff82000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788541286.986385:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 547 00000100:00080000:3.0:1788541286.986401:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788541286.986404:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a682ff82000 using connection 192.168.202.156@tcp/0@lo 00000100:00100000:3.0:1788541286.986415:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6705aa4a80 x1875420981170816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788541286.986516:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788541286.986529:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981171200:0@lo:400:kworker.0 00000100:00100000:1.0:1788541286.986594:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541286.986732:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981171200 00000100:00100000:0.0:1788541286.986741:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981171200 00000100:00100000:0.0:1788541286.986809:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788541286.986817:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708837100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981171200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541286.986861:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708837100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981171200:12345-0@lo:400:kworker.0 Request processed in 45us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541286.986886:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788541286.986940:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788541286.986968:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6705aa5880 x1875420981171200/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788541302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541286.986979:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981171200:0@lo:400:kworker.0 00000100:00100000:2.0:1788541286.988672:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981170560:0@lo:400:kworker.0 00000100:00100000:2.0:1788541286.988740:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541286.989192:0:18270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981170560 00000100:00100000:1.0:1788541286.989202:0:18270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981170560 00000100:00100000:1.0:1788541286.989296:0:18270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788541286.989307:0:18270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981170560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541286.989395:0:18270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981170560:12345-0@lo:400:kworker.0 Request processed in 89us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541286.989403:0:18270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788541286.989494:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875420981170944:0@lo:400:kworker.0 00000100:00100000:0.0:1788541286.989505:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981170560:0@lo:400:kworker.0 00000100:00100000:1.0:1788541286.989525:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541286.989617:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788541286.989625:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981171072:0@lo:400:kworker.0 00000100:00100000:1.0:1788541286.989652:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541286.989688:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981170688:0@lo:8:kworker.0 00000100:00100000:1.0:1788541286.989724:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541286.989755:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981170816:0@lo:8:kworker.0 00000100:00100000:1.0:1788541286.989807:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541286.989839:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981170688 00000100:00100000:1.0:1788541286.989843:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981170688 00000100:00100000:0.0:1788541286.989925:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981171072 00000100:00100000:0.0:1788541286.989930:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981171072 00000100:00100000:0.0:1788541286.989967:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788541286.989974:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981171072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541286.990015:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981171072:12345-0@lo:400:kworker.0 Request processed in 41us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541286.990021:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788541286.990106:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981170944 00000100:00100000:1.0:1788541286.990109:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981170816 00000100:00100000:2.0:1788541286.990111:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981170944 00000100:00100000:1.0:1788541286.990112:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981170816 00000100:00100000:1.0:1788541286.990124:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788541286.990136:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708835880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3640:x1875420981170688:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788541286.990138:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788541286.990143:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875420981170944:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1788541286.990165:0:18717:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 567 last 0 00000100:00100000:2.0:1788541286.990174:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875420981170944:12345-0@lo:400:kworker.0 Request processed in 31us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541286.990180:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000020:00000080:1.0:1788541286.990196:0:18717:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2aac941e5f4a8b24 00002000:00100000:1.0:1788541286.990212:0:18717:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9a682e790800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788541286.990217:0:18717:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788541286.990220:0:18717:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1788541286.990238:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788541286.990243:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708836d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3640:x1875420981170816:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788541286.990259:0:18718:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 567 last 0 00000020:00000080:0.0:1788541286.990276:0:18718:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2aac941e5f4a8b2b 00002000:00100000:0.0:1788541286.990282:0:18718:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9a683533f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788541286.990285:0:18718:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788541286.990287:0:18718:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788541286.990310:0:18717:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788541286.990336:0:18717:0:(import.c:65:import_set_state_nolock()) ffff9a682e797000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788541286.990382:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708835880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3640:x1875420981170688:12345-0@lo:8:kworker.0 Request processed in 246us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541286.990388:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788541286.990422:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981171072:0@lo:400:kworker.0 00010000:00080000:1.0:1788541286.990434:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6705aa4700 x1875420981170944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1788541286.990441:0:18718:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:1.0:1788541286.990444:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875420981170944:0@lo:400:kworker.0 00000100:00080000:0.0:1788541286.990453:0:18718:0:(import.c:65:import_set_state_nolock()) ffff9a6835339000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788541286.990483:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708836d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3640:x1875420981170816:12345-0@lo:8:kworker.0 Request processed in 238us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541286.990497:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1788541286.990636:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00010000:00080000:2.0:1788541286.990636:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6705aa5180 x1875420981170688/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788541311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788541286.990641:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788541286.990644:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a68097af000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1788541286.990645:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788541286.990652:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9a68097af000 using connection 192.168.202.156@tcp/0@lo 00000100:00080000:2.0:1788541286.990657:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788541286.990665:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788541286.990671:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788541286.990673:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a682ff81800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788541286.990688:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788541286.990694:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981170688:0@lo:8:kworker.0 00000100:00100000:3.0:1788541286.990695:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a6705aa4700 x1875420981171328/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00080000:2.0:1788541286.990710:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6705aa4a80 x1875420981170816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788541311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541286.990718:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:3.0:1788541286.990722:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:2.0:1788541286.990722:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788541286.990727:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788541286.990730:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00100000:3.0:1788541286.990731:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875420981171456:0@lo:400:kworker.0 00000100:00080000:2.0:1788541286.990732:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a682ff82000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788541286.990742:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788541286.990745:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3640:1875420981170816:0@lo:8:kworker.0 00000100:00100000:3.0:1788541286.990762:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541286.990773:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981171328:0@lo:8:kworker.0 00000100:00100000:2.0:1788541286.990796:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541286.990799:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788541286.990807:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875420981171584:0@lo:400:kworker.0 00000100:00100000:3.0:1788541286.990828:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788541286.990835:0:17223:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:3.0:1788541286.990846:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981171712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788541286.990851:0:17223:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17223:1875420981171840:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788541286.990897:0:17223:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541286.990912:0:17223:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68029f5f00 going to sleep for 11 seconds 00000004:00080000:1.0:1788541286.991025:0:17222:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1788541286.991072:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788541286.991093:0:17222:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 567909221766ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788541286.991100:0:17222:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788541286.991102:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981171456 00000100:00100000:3.0:1788541286.991106:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981171456 00000004:00080000:1.0:1788541286.991122:0:17224:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1788541286.991131:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981171584 00000100:00100000:3.0:1788541286.991133:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981171584 00000100:00100000:3.0:1788541286.991162:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000004:00080000:1.0:1788541286.991163:0:17224:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 567909292376ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788541286.991167:0:17224:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788541286.991169:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875420981171456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541286.991180:0:17200:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788541286.991187:0:17200:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788541286.991202:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875420981171456:12345-0@lo:400:kworker.0 Request processed in 34us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541286.991217:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788541286.991231:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788541286.991236:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875420981171584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541286.991265:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1875420981171584:12345-0@lo:400:kworker.0 Request processed in 29us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541286.991270:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1788541286.991293:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6705aa5880 x1875420981171584/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541286.991302:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3642:1875420981171584:0@lo:400:kworker.0 00010000:00080000:3.0:1788541286.991324:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6705aa5500 x1875420981171456/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541286.991332:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875420981171456:0@lo:400:kworker.0 00000100:00100000:3.0:1788541286.991361:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875420981171968:0@lo:400:kworker.0 00000100:00100000:3.0:1788541286.991651:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541286.991679:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981171968 00000100:00100000:3.0:1788541286.991683:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981171968 00000100:00100000:3.0:1788541286.991705:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788541286.991710:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875420981171968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541286.991745:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1875420981171968:12345-0@lo:400:kworker.0 Request processed in 34us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541286.991752:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788541286.991766:0:19250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981171328 00000100:00100000:1.0:1788541286.991770:0:19250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981171328 00010000:00080000:3.0:1788541286.991774:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6705aa5500 x1875420981171968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541286.991783:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3643:1875420981171968:0@lo:400:kworker.0 00000100:00100000:1.0:1788541286.991789:0:19250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981171840 00000100:00100000:1.0:1788541286.991792:0:19250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981171840 00000100:00100000:3.0:1788541286.991808:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788541286.991814:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3640:x1875420981171328:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788541286.991816:0:19250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788541286.991820:0:19250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706831500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17223:x1875420981171840:12345-0@lo:5:osp-pre-0-0.0 00010000:00080000:3.0:1788541286.991835:0:18716:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 567 last 0 00000100:00080000:1.0:1788541286.991916:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788541286.991921:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788541286.991922:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:3.0:1788541286.992146:0:18716:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x2aac941e5f4a8b32 00002000:00100000:3.0:1788541286.992160:0:18716:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9a68101d5800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1788541286.992164:0:18716:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1788541286.992167:0:18716:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788541286.992214:0:18716:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1788541286.992236:0:18716:0:(import.c:65:import_set_state_nolock()) ffff9a6802b4d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788541286.992278:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1875420981171328:12345-0@lo:8:kworker.0 Request processed in 463us (1480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541286.992285:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788541286.992347:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875420981172224:0@lo:400:kworker.0 00000100:00100000:3.0:1788541286.992377:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541286.992405:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707819500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981172352:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1788541286.992406:0:17225:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:0.0:1788541286.992422:0:17225:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707818a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17225:1875420981172480:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788541286.992427:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541286.992448:0:17225:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541286.992456:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981171712 00000100:00100000:3.0:1788541286.992460:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981171712 00000100:00100000:0.0:1788541286.992463:0:17225:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6706859600 going to sleep for 11 seconds 00000100:00100000:0.0:1788541286.992474:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981172480 00000100:00100000:0.0:1788541286.992477:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981172480 00000100:00100000:3.0:1788541286.992479:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981172352 00000100:00100000:3.0:1788541286.992481:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981172352 00000100:00100000:3.0:1788541286.992493:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788541286.992500:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1875420981171712:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788541286.992501:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788541286.992506:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707818380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:17225:x1875420981172480:12345-0@lo:5:osp-pre-1-0.0 00002000:00000024:3.0:1788541286.992514:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788541286.992628:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1875420981171712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (1555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541286.992635:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788541286.992645:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788541286.992655:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788541286.992657:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875420981172096:0@lo:400:kworker.0 00000100:00100000:3.0:1788541286.992661:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1875420981172352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788541286.992676:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788541286.992686:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541286.992701:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1875420981172352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541286.992707:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788541286.992732:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707819500 x1875420981172352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541302 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541286.992747:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707819500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981172352:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788541286.992759:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a67080d7100 x1875420981171712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541302 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541286.992769:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981171712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788541286.992792:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981172224 00000100:00100000:3.0:1788541286.992795:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981172224 00000100:00100000:3.0:1788541286.992830:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981172096 00000100:00100000:3.0:1788541286.992833:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981172096 00000100:00100000:3.0:1788541286.992849:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1788541286.992850:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6705aa4700 x1875420981171328/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788541311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788541286.992864:0:3640:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1788541286.992899:0:3640:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788541286.992912:0:3640:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788541286.992915:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9a68097af000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788541286.992928:0:3640:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788541286.992942:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3640:1875420981171328:0@lo:8:kworker.0 00000004:00080000:2.0:1788541286.992964:0:17940:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788541286.993035:0:17940:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 567911163669ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788541286.993041:0:17940:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1788541286.993195:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875420981172224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541286.993249:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875420981172224:12345-0@lo:400:kworker.0 Request processed in 58us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541286.993255:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788541286.993268:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788541286.993274:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707819180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875420981172096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541286.993306:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707819180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875420981172096:12345-0@lo:400:kworker.0 Request processed in 32us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541286.993320:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1788541286.993355:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6705aa6300 x1875420981172224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788541286.993359:0:17941:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788541286.993366:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875420981172224:0@lo:400:kworker.0 00000100:00100000:3.0:1788541286.993378:0:17941:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17941:1875420981172736:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1788541286.993402:0:17941:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541286.993418:0:17941:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68394b56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788541286.993430:0:18716:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1788541286.993436:0:18716:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00010000:00080000:3.0:1788541286.993529:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6705aa5500 x1875420981172096/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541286.993539:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875420981172096:0@lo:400:kworker.0 00000100:00100000:3.0:1788541286.993635:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788541286.993641:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981172608:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788541286.993665:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541286.993688:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981172608 00000100:00100000:3.0:1788541286.993693:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981172608 00000100:00100000:3.0:1788541286.993728:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788541286.993735:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875420981172608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788541286.993749:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788541286.993778:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3644:x1875420981172608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541286.993784:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788541286.993807:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6705aa5180 x1875420981172608/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788541302 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541286.993821:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981172608:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788541286.994036:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981172736 00000100:00100000:3.0:1788541286.994046:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981172736 00000100:00100000:3.0:1788541286.994136:0:19664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788541286.994144:0:19664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17941:x1875420981172736:12345-0@lo:7:osp-pre-1-1.0 00000100:00080000:0.0:1788541286.996581:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788541286.996597:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788541286.996601:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1788541286.997077:0:17178:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:0.0:1788541286.997101:0:17178:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:0.0:1788541286.997802:0:19250:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1788541286.997811:0:19250:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1788541286.997819:0:19250:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00000004:00080000:3.0:1788541286.998763:0:17930:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:2.0:1788541287.001085:0:18717:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1788541287.001096:0:18717:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1788541287.001103:0:18717:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00002000:00080000:3.0:1788541287.004718:0:19664:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1788541287.004733:0:19664:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1788541287.005060:0:19664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17941:x1875420981172736:12345-0@lo:7:osp-pre-1-1.0 Request processed in 10914us (11652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541287.005071:0:19664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1788541287.005155:0:17941:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6705aa4700 x1875420981172736/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788541302 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541287.005174:0:17941:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17941:1875420981172736:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1788541287.005187:0:17941:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788541287.005224:0:17941:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708835c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17941:1875420981172864:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788541287.005255:0:17941:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541287.005279:0:17941:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6808989180 going to sleep for 11 seconds 00000100:00100000:3.0:1788541287.005452:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981172864 00000100:00100000:3.0:1788541287.005458:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981172864 00000100:00100000:3.0:1788541287.005524:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788541287.005532:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17941:x1875420981172864:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788541287.005555:0:18716:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1788541287.005584:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17941:x1875420981172864:12345-0@lo:5:osp-pre-1-1.0 Request processed in 54us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541287.005590:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1788541287.006840:0:17941:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6708835c00 x1875420981172864/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788541303 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541287.006853:0:17941:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708835c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17941:1875420981172864:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1788541287.006866:0:17941:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788541287.006923:0:17941:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67082fb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17941:1875420981172992:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788541287.007097:0:17941:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541287.007123:0:17941:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6808989180 going to sleep for 11 seconds 00002000:00010000:1.0:1788541287.008000:0:19250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788541287.008010:0:19250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007954e8dc/0x2aac941e5f4a8b39 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.008027:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1788541287.008032:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541287.008046:0:19250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007954e8dc/0x2aac941e5f4a8b39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.008065:0:19250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007954e8dc/0x2aac941e5f4a8b39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.008076:0:19250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007954e8dc/0x2aac941e5f4a8b39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.008084:0:19250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007954e8dc/0x2aac941e5f4a8b39 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.008143:0:19250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788541287.011188:0:19546:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541287.011202:0:19546:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007954e8dc/0x2aac941e5f4a8b39 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.011217:0:19546:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706956c00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788541287.011222:0:19546:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007954e8dc/0x2aac941e5f4a8b39 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.011257:0:19546:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007954e8dc/0x2aac941e5f4a8b39 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.011524:0:19546:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007954e8dc/0x2aac941e5f4a8b39 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.011533:0:19546:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007954e8dc/0x2aac941e5f4a8b39 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788541287.013502:0:18717:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788541287.013513:0:18717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ec00a0b/0x2aac941e5f4a8b40 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.013528:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=567s v=(0 0) 00010000:00010000:2.0:1788541287.013533:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541287.013540:0:18717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ec00a0b/0x2aac941e5f4a8b40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.013556:0:18717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ec00a0b/0x2aac941e5f4a8b40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.013566:0:18717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ec00a0b/0x2aac941e5f4a8b40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.013585:0:18717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ec00a0b/0x2aac941e5f4a8b40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.013638:0:18717:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788541287.013900:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981172992 00000100:00100000:3.0:1788541287.013909:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981172992 00010000:00010000:1.0:1788541287.014074:0:19546:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788541287.014082:0:19546:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ec00a0b/0x2aac941e5f4a8b40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.014091:0:19546:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551ac00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:1.0:1788541287.014096:0:19546:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ec00a0b/0x2aac941e5f4a8b40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.014106:0:19546:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ec00a0b/0x2aac941e5f4a8b40 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.014122:0:19546:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ec00a0b/0x2aac941e5f4a8b40 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.014140:0:19546:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ec00a0b/0x2aac941e5f4a8b40 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.014156:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541287.014157:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541287.016330:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541287.016544:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788541287.016563:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17941:x1875420981172992:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788541287.016612:0:18716:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00010000:00010000:1.0:1788541287.016802:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788541287.017227:0:19250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788541287.017235:0:19250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af111ead/0x2aac941e5f4a8b47 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.017251:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=567s v=(0 0) 00010000:00010000:0.0:1788541287.017255:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541287.017261:0:19250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af111ead/0x2aac941e5f4a8b47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.017279:0:19250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af111ead/0x2aac941e5f4a8b47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.017290:0:19250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af111ead/0x2aac941e5f4a8b47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.017307:0:19250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af111ead/0x2aac941e5f4a8b47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.017325:0:19250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788541287.017335:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541287.017340:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af111ead/0x2aac941e5f4a8b47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.017347:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75f600 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788541287.017351:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af111ead/0x2aac941e5f4a8b47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.017360:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af111ead/0x2aac941e5f4a8b47 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.017625:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af111ead/0x2aac941e5f4a8b47 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.017634:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af111ead/0x2aac941e5f4a8b47 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.017651:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541287.017653:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541287.017655:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788541287.017737:0:18717:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788541287.017743:0:18717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4ae154d/0x2aac941e5f4a8b4e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.017752:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=567s v=(0 0) 00010000:00010000:2.0:1788541287.017755:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541287.017759:0:18717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4ae154d/0x2aac941e5f4a8b4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.017770:0:18717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4ae154d/0x2aac941e5f4a8b4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.017778:0:18717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4ae154d/0x2aac941e5f4a8b4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.017785:0:18717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4ae154d/0x2aac941e5f4a8b4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.017839:0:18717:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788541287.018126:0:19250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788541287.018141:0:19250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084d2274b/0x2aac941e5f4a8b55 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.018150:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=567s v=(0 0) 00010000:00010000:0.0:1788541287.018152:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541287.018157:0:19250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084d2274b/0x2aac941e5f4a8b55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.018166:0:19250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084d2274b/0x2aac941e5f4a8b55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.018173:0:19250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084d2274b/0x2aac941e5f4a8b55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.018179:0:19250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084d2274b/0x2aac941e5f4a8b55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788541287.018695:0:18717:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788541287.018701:0:18717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003ed1e60/0x2aac941e5f4a8b5c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.018715:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=567s v=(0 0) 00010000:00010000:2.0:1788541287.018718:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541287.018722:0:18717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003ed1e60/0x2aac941e5f4a8b5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.018733:0:18717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003ed1e60/0x2aac941e5f4a8b5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.018740:0:18717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003ed1e60/0x2aac941e5f4a8b5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.018747:0:18717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003ed1e60/0x2aac941e5f4a8b5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.019120:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788541287.019127:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4ae154d/0x2aac941e5f4a8b4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.019136:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551b000 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:1.0:1788541287.019140:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4ae154d/0x2aac941e5f4a8b4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.019149:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4ae154d/0x2aac941e5f4a8b4e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.019164:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4ae154d/0x2aac941e5f4a8b4e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.019172:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4ae154d/0x2aac941e5f4a8b4e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.019187:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788541287.019192:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084d2274b/0x2aac941e5f4a8b55 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.019204:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75fc00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:1.0:1788541287.019208:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084d2274b/0x2aac941e5f4a8b55 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.019216:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084d2274b/0x2aac941e5f4a8b55 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.019227:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084d2274b/0x2aac941e5f4a8b55 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.019236:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788541287.019239:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003ed1e60/0x2aac941e5f4a8b5c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.019246:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551b200 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:1.0:1788541287.019249:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003ed1e60/0x2aac941e5f4a8b5c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.019257:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003ed1e60/0x2aac941e5f4a8b5c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.019266:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003ed1e60/0x2aac941e5f4a8b5c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.019274:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541287.019281:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541287.019283:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541287.019955:0:18717:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788541287.019963:0:18717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003ed1e60/0x2aac941e5f4a8b5c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788541287.020516:0:18717:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788541287.020522:0:18717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000265d9b95/0x2aac941e5f4a8b63 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.020533:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=567s v=(0 0) 00010000:00010000:2.0:1788541287.020538:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541287.020543:0:18717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000265d9b95/0x2aac941e5f4a8b63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.020566:0:18717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000265d9b95/0x2aac941e5f4a8b63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.020575:0:18717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000265d9b95/0x2aac941e5f4a8b63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.020583:0:18717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000265d9b95/0x2aac941e5f4a8b63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.020597:0:18717:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788541287.020727:0:19546:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788541287.020733:0:19546:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000265d9b95/0x2aac941e5f4a8b63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.020741:0:19546:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551b400 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:1.0:1788541287.020745:0:19546:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000265d9b95/0x2aac941e5f4a8b63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.020753:0:19546:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000265d9b95/0x2aac941e5f4a8b63 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.020768:0:19546:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000265d9b95/0x2aac941e5f4a8b63 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.020775:0:19546:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000265d9b95/0x2aac941e5f4a8b63 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.020792:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541287.020793:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541287.020795:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541287.020801:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541287.020842:0:19250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788541287.020849:0:19250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084d2274b/0x2aac941e5f4a8b55 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788541287.020982:0:18717:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788541287.020988:0:18717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f1b9022/0x2aac941e5f4a8b6a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.020996:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=567s v=(0 0) 00010000:00010000:2.0:1788541287.020999:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541287.021003:0:18717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f1b9022/0x2aac941e5f4a8b6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.021012:0:18717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f1b9022/0x2aac941e5f4a8b6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.021019:0:18717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f1b9022/0x2aac941e5f4a8b6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.021036:0:18717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f1b9022/0x2aac941e5f4a8b6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.021050:0:18717:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788541287.021058:0:19546:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541287.021062:0:19546:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f1b9022/0x2aac941e5f4a8b6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.021069:0:19546:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551be00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:2.0:1788541287.021072:0:19546:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f1b9022/0x2aac941e5f4a8b6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.021078:0:19546:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f1b9022/0x2aac941e5f4a8b6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.021088:0:19546:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f1b9022/0x2aac941e5f4a8b6a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.021096:0:19546:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f1b9022/0x2aac941e5f4a8b6a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.021109:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541287.021110:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541287.021112:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541287.021222:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788541287.021437:0:19250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788541287.021443:0:19250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944a934e/0x2aac941e5f4a8b71 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.021451:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1788541287.021460:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541287.021464:0:19250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000944a934e/0x2aac941e5f4a8b71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.021473:0:19250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000944a934e/0x2aac941e5f4a8b71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.021481:0:19250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000944a934e/0x2aac941e5f4a8b71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.021487:0:19250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000944a934e/0x2aac941e5f4a8b71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.021501:0:19250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788541287.021507:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788541287.021511:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000944a934e/0x2aac941e5f4a8b71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.021517:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706957200 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:1.0:1788541287.021520:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000944a934e/0x2aac941e5f4a8b71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.021527:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000944a934e/0x2aac941e5f4a8b71 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.021538:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000944a934e/0x2aac941e5f4a8b71 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.021562:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000944a934e/0x2aac941e5f4a8b71 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.021575:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541287.021577:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541287.021579:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788541287.022194:0:18717:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788541287.022201:0:18717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011719250/0x2aac941e5f4a8b78 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.022211:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=567s v=(0 0) 00010000:00010000:0.0:1788541287.022220:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541287.022226:0:18717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011719250/0x2aac941e5f4a8b78 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.022239:0:18717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011719250/0x2aac941e5f4a8b78 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.022247:0:18717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011719250/0x2aac941e5f4a8b78 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.022255:0:18717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011719250/0x2aac941e5f4a8b78 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.022274:0:18717:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788541287.022396:0:19546:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541287.022406:0:19546:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011719250/0x2aac941e5f4a8b78 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.022414:0:19546:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75ec00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:2.0:1788541287.022418:0:19546:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011719250/0x2aac941e5f4a8b78 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788541287.022664:0:19250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788541287.022670:0:19250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009beddb9a/0x2aac941e5f4a8b7f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.022678:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=567s v=(0 0) 00010000:00010000:0.0:1788541287.022681:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541287.022685:0:19250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009beddb9a/0x2aac941e5f4a8b7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.022694:0:19250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009beddb9a/0x2aac941e5f4a8b7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.022702:0:19250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009beddb9a/0x2aac941e5f4a8b7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.022714:0:19250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009beddb9a/0x2aac941e5f4a8b7f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.022726:0:19250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788541287.022735:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541287.022738:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009beddb9a/0x2aac941e5f4a8b7f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.022744:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75e600 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788541287.022747:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009beddb9a/0x2aac941e5f4a8b7f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.022755:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009beddb9a/0x2aac941e5f4a8b7f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.022768:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009beddb9a/0x2aac941e5f4a8b7f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.022774:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009beddb9a/0x2aac941e5f4a8b7f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.022787:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541287.022789:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541287.022790:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788541287.022920:0:18717:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788541287.022944:0:18717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d13f9ad/0x2aac941e5f4a8b86 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.022952:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=567s v=(0 0) 00010000:00010000:0.0:1788541287.022955:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541287.022959:0:18717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d13f9ad/0x2aac941e5f4a8b86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.022967:0:18717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d13f9ad/0x2aac941e5f4a8b86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.022975:0:18717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d13f9ad/0x2aac941e5f4a8b86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.022981:0:18717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d13f9ad/0x2aac941e5f4a8b86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.022995:0:18717:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788541287.023001:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541287.023005:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d13f9ad/0x2aac941e5f4a8b86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.023011:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75ee00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788541287.023015:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d13f9ad/0x2aac941e5f4a8b86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.023022:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d13f9ad/0x2aac941e5f4a8b86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.023039:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d13f9ad/0x2aac941e5f4a8b86 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.023046:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d13f9ad/0x2aac941e5f4a8b86 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.023059:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541287.023060:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541287.023062:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541287.023201:0:19546:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011719250/0x2aac941e5f4a8b78 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.023212:0:19546:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011719250/0x2aac941e5f4a8b78 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.023219:0:19546:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011719250/0x2aac941e5f4a8b78 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.023232:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541287.023234:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541287.023235:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788541287.024448:0:18717:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788541287.024457:0:18717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc017dc7/0x2aac941e5f4a8b8d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.024469:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1788541287.024473:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541287.024479:0:18717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc017dc7/0x2aac941e5f4a8b8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.024490:0:18717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc017dc7/0x2aac941e5f4a8b8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.024499:0:18717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc017dc7/0x2aac941e5f4a8b8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.024507:0:18717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc017dc7/0x2aac941e5f4a8b8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.024532:0:18717:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788541287.024612:0:19250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788541287.024618:0:19250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a0a6b27/0x2aac941e5f4a8b94 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.024626:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=567s v=(0 0) 00010000:00010000:2.0:1788541287.024629:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541287.024633:0:19250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a0a6b27/0x2aac941e5f4a8b94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.024656:0:19250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a0a6b27/0x2aac941e5f4a8b94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.024665:0:19250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a0a6b27/0x2aac941e5f4a8b94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.024672:0:19250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a0a6b27/0x2aac941e5f4a8b94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.024700:0:19250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788541287.024708:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788541287.024715:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc017dc7/0x2aac941e5f4a8b8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.024723:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706957a00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788541287.024726:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc017dc7/0x2aac941e5f4a8b8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.024735:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc017dc7/0x2aac941e5f4a8b8d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.024756:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc017dc7/0x2aac941e5f4a8b8d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.024764:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc017dc7/0x2aac941e5f4a8b8d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.024791:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541287.024795:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a0a6b27/0x2aac941e5f4a8b94 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.024802:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551a800 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788541287.024806:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a0a6b27/0x2aac941e5f4a8b94 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.024813:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a0a6b27/0x2aac941e5f4a8b94 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.024824:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a0a6b27/0x2aac941e5f4a8b94 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.024832:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541287.024834:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541287.024835:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541287.025098:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788541287.025140:0:18717:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788541287.025146:0:18717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009412ebd7/0x2aac941e5f4a8b9b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.025153:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1788541287.025157:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541287.025161:0:18717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009412ebd7/0x2aac941e5f4a8b9b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.025170:0:18717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009412ebd7/0x2aac941e5f4a8b9b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.025179:0:18717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009412ebd7/0x2aac941e5f4a8b9b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.025186:0:18717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009412ebd7/0x2aac941e5f4a8b9b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.025205:0:18717:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788541287.025337:0:19250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a0a6b27/0x2aac941e5f4a8b94 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.025356:0:19546:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541287.025361:0:19546:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009412ebd7/0x2aac941e5f4a8b9b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.025368:0:19546:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706956600 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:2.0:1788541287.025586:0:19546:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009412ebd7/0x2aac941e5f4a8b9b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.025596:0:19546:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009412ebd7/0x2aac941e5f4a8b9b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.025609:0:19546:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009412ebd7/0x2aac941e5f4a8b9b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.025622:0:19546:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009412ebd7/0x2aac941e5f4a8b9b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.025636:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541287.025638:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541287.025639:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788541287.026053:0:18717:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788541287.026060:0:18717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000944a934e/0x2aac941e5f4a8ba2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.026074:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1788541287.026078:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541287.026082:0:18717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000944a934e/0x2aac941e5f4a8ba2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.026104:0:18717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000944a934e/0x2aac941e5f4a8ba2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.026112:0:18717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000944a934e/0x2aac941e5f4a8ba2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.026119:0:18717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000944a934e/0x2aac941e5f4a8ba2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.026142:0:18717:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788541287.026173:0:19250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788541287.026178:0:19250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f1b9022/0x2aac941e5f4a8ba9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.026186:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=567s v=(0 0) 00010000:00010000:2.0:1788541287.026189:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541287.026193:0:19250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f1b9022/0x2aac941e5f4a8ba9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.026203:0:19250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f1b9022/0x2aac941e5f4a8ba9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.026211:0:19250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f1b9022/0x2aac941e5f4a8ba9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.026218:0:19250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f1b9022/0x2aac941e5f4a8ba9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.026236:0:19250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788541287.026390:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788541287.026412:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000944a934e/0x2aac941e5f4a8ba2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.026420:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706957200 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:3.0:1788541287.026424:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000944a934e/0x2aac941e5f4a8ba2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.026438:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000944a934e/0x2aac941e5f4a8ba2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.026451:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000944a934e/0x2aac941e5f4a8ba2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.026458:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000944a934e/0x2aac941e5f4a8ba2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.026473:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788541287.026476:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f1b9022/0x2aac941e5f4a8ba9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.026483:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551be00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:3.0:1788541287.026486:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f1b9022/0x2aac941e5f4a8ba9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.026494:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f1b9022/0x2aac941e5f4a8ba9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.026505:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f1b9022/0x2aac941e5f4a8ba9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.026513:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f1b9022/0x2aac941e5f4a8ba9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.026538:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541287.026540:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541287.026542:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541287.026586:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788541287.026771:0:19250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788541287.026777:0:19250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028f52e49/0x2aac941e5f4a8bb0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.026787:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=567s v=(0 0) 00010000:00010000:3.0:1788541287.026790:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541287.026794:0:19250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028f52e49/0x2aac941e5f4a8bb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.026803:0:19250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028f52e49/0x2aac941e5f4a8bb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.026811:0:19250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028f52e49/0x2aac941e5f4a8bb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.026818:0:19250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028f52e49/0x2aac941e5f4a8bb0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.026885:0:19250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788541287.027029:0:19546:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541287.027039:0:19546:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028f52e49/0x2aac941e5f4a8bb0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.027047:0:19546:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68043cd800 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:2.0:1788541287.027051:0:19546:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028f52e49/0x2aac941e5f4a8bb0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.027059:0:19546:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028f52e49/0x2aac941e5f4a8bb0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.027070:0:19546:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028f52e49/0x2aac941e5f4a8bb0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.027078:0:19546:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028f52e49/0x2aac941e5f4a8bb0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.027092:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541287.027093:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541287.027095:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788541287.027205:0:18717:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788541287.027212:0:18717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009beddb9a/0x2aac941e5f4a8bb7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.027220:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=567s v=(0 0) 00010000:00010000:0.0:1788541287.027223:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541287.027227:0:18717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009beddb9a/0x2aac941e5f4a8bb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.027246:0:18717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009beddb9a/0x2aac941e5f4a8bb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.027254:0:18717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009beddb9a/0x2aac941e5f4a8bb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.027261:0:18717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009beddb9a/0x2aac941e5f4a8bb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.027346:0:18717:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788541287.027454:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788541287.027459:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009beddb9a/0x2aac941e5f4a8bb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.027476:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75e600 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:3.0:1788541287.027480:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009beddb9a/0x2aac941e5f4a8bb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.027488:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009beddb9a/0x2aac941e5f4a8bb7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.027499:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009beddb9a/0x2aac941e5f4a8bb7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.027507:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009beddb9a/0x2aac941e5f4a8bb7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.027520:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541287.027522:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541287.027523:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788541287.028234:0:19250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:0.0:1788541287.028234:0:18717:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788541287.028242:0:19250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005546f032/0x2aac941e5f4a8bbe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.028242:0:18717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d13f9ad/0x2aac941e5f4a8bc5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.028253:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=567s v=(0 0) 00010000:00010000:0.0:1788541287.028253:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=567s v=(0 0) 00010000:00010000:3.0:1788541287.028257:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541287.028257:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541287.028263:0:19250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005546f032/0x2aac941e5f4a8bbe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.028263:0:18717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d13f9ad/0x2aac941e5f4a8bc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.028274:0:19250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005546f032/0x2aac941e5f4a8bbe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.028274:0:18717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d13f9ad/0x2aac941e5f4a8bc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.028283:0:18717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d13f9ad/0x2aac941e5f4a8bc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.028286:0:19250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005546f032/0x2aac941e5f4a8bbe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.028294:0:19250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005546f032/0x2aac941e5f4a8bbe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.028298:0:18717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d13f9ad/0x2aac941e5f4a8bc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.028348:0:19250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788541287.028355:0:18717:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788541287.028363:0:19546:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788541287.028367:0:19546:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005546f032/0x2aac941e5f4a8bbe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.028450:0:19546:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68043cc600 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788541287.028454:0:19546:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005546f032/0x2aac941e5f4a8bbe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.028463:0:19546:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005546f032/0x2aac941e5f4a8bbe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.028475:0:19546:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005546f032/0x2aac941e5f4a8bbe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.028483:0:19546:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005546f032/0x2aac941e5f4a8bbe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.028494:0:19546:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541287.028498:0:19546:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d13f9ad/0x2aac941e5f4a8bc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.028514:0:19546:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75ee00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788541287.028517:0:19546:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d13f9ad/0x2aac941e5f4a8bc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.028524:0:19546:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d13f9ad/0x2aac941e5f4a8bc5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.028535:0:19546:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d13f9ad/0x2aac941e5f4a8bc5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.028542:0:19546:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d13f9ad/0x2aac941e5f4a8bc5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.028553:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541287.028554:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541287.028556:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788541287.029210:0:18717:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788541287.029217:0:18717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084d2274b/0x2aac941e5f4a8bcc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.029226:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=567s v=(0 0) 00010000:00010000:0.0:1788541287.029230:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541287.029235:0:18717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084d2274b/0x2aac941e5f4a8bcc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.029245:0:18717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084d2274b/0x2aac941e5f4a8bcc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.029257:0:18717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084d2274b/0x2aac941e5f4a8bcc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.029264:0:18717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084d2274b/0x2aac941e5f4a8bcc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.029280:0:18717:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788541287.029563:0:18717:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788541287.029568:0:18717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af111ead/0x2aac941e5f4a8bd3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.029576:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=567s v=(0 0) 00010000:00010000:0.0:1788541287.029579:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541287.029583:0:18717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af111ead/0x2aac941e5f4a8bd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.029592:0:18717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af111ead/0x2aac941e5f4a8bd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.029599:0:18717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af111ead/0x2aac941e5f4a8bd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.029605:0:18717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af111ead/0x2aac941e5f4a8bd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.029626:0:18717:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788541287.029634:0:19546:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788541287.029638:0:19546:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084d2274b/0x2aac941e5f4a8bcc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.029644:0:19546:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75fc00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788541287.029647:0:19546:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084d2274b/0x2aac941e5f4a8bcc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.029654:0:19546:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084d2274b/0x2aac941e5f4a8bcc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.029664:0:19546:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084d2274b/0x2aac941e5f4a8bcc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.029671:0:19546:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084d2274b/0x2aac941e5f4a8bcc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.029683:0:19546:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541287.029686:0:19546:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af111ead/0x2aac941e5f4a8bd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.029692:0:19546:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75f600 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788541287.029695:0:19546:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af111ead/0x2aac941e5f4a8bd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.029711:0:19546:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af111ead/0x2aac941e5f4a8bd3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.029721:0:19546:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af111ead/0x2aac941e5f4a8bd3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.029728:0:19546:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af111ead/0x2aac941e5f4a8bd3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.029738:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541287.029740:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541287.029741:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541287.030083:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541287.030092:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788541287.030484:0:19250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788541287.030490:0:19250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc017dc7/0x2aac941e5f4a8bda lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.030500:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1788541287.030504:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541287.030508:0:19250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc017dc7/0x2aac941e5f4a8bda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.030518:0:19250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc017dc7/0x2aac941e5f4a8bda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.030527:0:19250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc017dc7/0x2aac941e5f4a8bda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.030544:0:19250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc017dc7/0x2aac941e5f4a8bda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.030564:0:19250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788541287.030567:0:19546:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541287.030571:0:19546:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc017dc7/0x2aac941e5f4a8bda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.030578:0:19546:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706957a00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788541287.030582:0:19546:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc017dc7/0x2aac941e5f4a8bda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.030590:0:19546:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc017dc7/0x2aac941e5f4a8bda lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.030601:0:19546:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc017dc7/0x2aac941e5f4a8bda lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.030619:0:19546:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc017dc7/0x2aac941e5f4a8bda lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.030634:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541287.030636:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541287.030638:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788541287.030670:0:18717:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788541287.030675:0:18717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e6f7d87/0x2aac941e5f4a8be1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.030688:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=567s v=(0 0) 00010000:00010000:0.0:1788541287.030692:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541287.030696:0:18717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e6f7d87/0x2aac941e5f4a8be1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.030705:0:18717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e6f7d87/0x2aac941e5f4a8be1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.030713:0:18717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e6f7d87/0x2aac941e5f4a8be1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.030720:0:18717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e6f7d87/0x2aac941e5f4a8be1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.030781:0:18717:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788541287.030992:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788541287.030999:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e6f7d87/0x2aac941e5f4a8be1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.031007:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75fe00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:3.0:1788541287.031010:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e6f7d87/0x2aac941e5f4a8be1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.031018:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e6f7d87/0x2aac941e5f4a8be1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.031030:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e6f7d87/0x2aac941e5f4a8be1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.031037:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e6f7d87/0x2aac941e5f4a8be1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788541287.031105:0:19250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788541287.031111:0:19250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009412ebd7/0x2aac941e5f4a8be8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.031119:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1788541287.031122:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541287.031126:0:19250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009412ebd7/0x2aac941e5f4a8be8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.031133:0:19250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009412ebd7/0x2aac941e5f4a8be8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.031139:0:19250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009412ebd7/0x2aac941e5f4a8be8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.031143:0:19250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009412ebd7/0x2aac941e5f4a8be8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.031155:0:19250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788541287.031172:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788541287.031177:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009412ebd7/0x2aac941e5f4a8be8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.031185:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706956600 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:3.0:1788541287.031188:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009412ebd7/0x2aac941e5f4a8be8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.031196:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009412ebd7/0x2aac941e5f4a8be8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.031207:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009412ebd7/0x2aac941e5f4a8be8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.031215:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009412ebd7/0x2aac941e5f4a8be8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.031228:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541287.031229:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541287.031231:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788541287.031329:0:18717:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788541287.031340:0:18717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007330cc41/0x2aac941e5f4a8bef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.031348:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=567s v=(0 0) 00010000:00010000:0.0:1788541287.031351:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541287.031353:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541287.031355:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541287.031355:0:18717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007330cc41/0x2aac941e5f4a8bef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.031356:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541287.031365:0:18717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007330cc41/0x2aac941e5f4a8bef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788541287.031498:0:19250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788541287.031504:0:19250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007954e8dc/0x2aac941e5f4a8bf6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.031518:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1788541287.031521:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541287.031525:0:19250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007954e8dc/0x2aac941e5f4a8bf6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.031531:0:18717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007330cc41/0x2aac941e5f4a8bef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.031533:0:19250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007954e8dc/0x2aac941e5f4a8bf6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.031540:0:18717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007330cc41/0x2aac941e5f4a8bef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.031600:0:18717:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788541287.031714:0:19546:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541287.031719:0:19546:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007330cc41/0x2aac941e5f4a8bef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.031727:0:19546:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75f200 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:2.0:1788541287.031737:0:19546:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007330cc41/0x2aac941e5f4a8bef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.031745:0:19546:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007330cc41/0x2aac941e5f4a8bef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.031757:0:19546:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007330cc41/0x2aac941e5f4a8bef lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.031764:0:19546:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007330cc41/0x2aac941e5f4a8bef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.031775:0:19250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007954e8dc/0x2aac941e5f4a8bf6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.031779:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541287.031780:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541287.031782:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541287.031782:0:19250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007954e8dc/0x2aac941e5f4a8bf6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.031795:0:19250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788541287.031829:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788541287.031833:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007954e8dc/0x2aac941e5f4a8bf6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.031840:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706956c00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:3.0:1788541287.031848:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007954e8dc/0x2aac941e5f4a8bf6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.031856:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007954e8dc/0x2aac941e5f4a8bf6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.031985:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007954e8dc/0x2aac941e5f4a8bf6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.031995:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007954e8dc/0x2aac941e5f4a8bf6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.032009:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541287.032010:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541287.032012:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788541287.032078:0:19250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788541287.032083:0:19250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001205e250/0x2aac941e5f4a8bfd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.032091:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1788541287.032094:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541287.032098:0:19250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001205e250/0x2aac941e5f4a8bfd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.032107:0:19250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001205e250/0x2aac941e5f4a8bfd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.032125:0:19250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001205e250/0x2aac941e5f4a8bfd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.032132:0:19250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001205e250/0x2aac941e5f4a8bfd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.032151:0:19250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788541287.032167:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541287.032171:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001205e250/0x2aac941e5f4a8bfd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.032179:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706957800 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:2.0:1788541287.032182:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001205e250/0x2aac941e5f4a8bfd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.032190:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001205e250/0x2aac941e5f4a8bfd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.032201:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001205e250/0x2aac941e5f4a8bfd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.032214:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001205e250/0x2aac941e5f4a8bfd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.032228:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541287.032230:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541287.032231:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788541287.032413:0:19250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788541287.032418:0:19250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001974258/0x2aac941e5f4a8c04 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.032427:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1788541287.032430:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541287.032434:0:19250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001974258/0x2aac941e5f4a8c04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.032443:0:19250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001974258/0x2aac941e5f4a8c04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.032451:0:19250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001974258/0x2aac941e5f4a8c04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.032458:0:19250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001974258/0x2aac941e5f4a8c04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.032479:0:19250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788541287.032483:0:19546:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541287.032487:0:19546:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001974258/0x2aac941e5f4a8c04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.032495:0:19546:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706957e00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:2.0:1788541287.032498:0:19546:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001974258/0x2aac941e5f4a8c04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.032506:0:19546:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001974258/0x2aac941e5f4a8c04 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.032516:0:19546:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001974258/0x2aac941e5f4a8c04 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.032524:0:19546:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001974258/0x2aac941e5f4a8c04 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.032537:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541287.032539:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541287.032541:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788541287.032637:0:18717:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788541287.032642:0:18717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011719250/0x2aac941e5f4a8c0b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.032650:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=567s v=(0 0) 00010000:00010000:0.0:1788541287.032653:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541287.032656:0:18717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011719250/0x2aac941e5f4a8c0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.032665:0:18717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011719250/0x2aac941e5f4a8c0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.032680:0:18717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011719250/0x2aac941e5f4a8c0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.032686:0:18717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011719250/0x2aac941e5f4a8c0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.032705:0:18717:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788541287.032738:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541287.032743:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011719250/0x2aac941e5f4a8c0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.032750:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75ec00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:2.0:1788541287.032753:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011719250/0x2aac941e5f4a8c0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.032761:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011719250/0x2aac941e5f4a8c0b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.032772:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011719250/0x2aac941e5f4a8c0b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.032779:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011719250/0x2aac941e5f4a8c0b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.032793:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541287.032795:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541287.032796:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788541287.033123:0:19250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788541287.033129:0:19250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a0a6b27/0x2aac941e5f4a8c12 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.033137:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=567s v=(0 0) 00010000:00010000:2.0:1788541287.033140:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541287.033143:0:19250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a0a6b27/0x2aac941e5f4a8c12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.033163:0:19250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a0a6b27/0x2aac941e5f4a8c12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.033171:0:19250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a0a6b27/0x2aac941e5f4a8c12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.033178:0:19250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a0a6b27/0x2aac941e5f4a8c12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.033196:0:19250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788541287.033640:0:19250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788541287.033647:0:19250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003ed1e60/0x2aac941e5f4a8c19 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.033656:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=567s v=(0 0) 00010000:00010000:2.0:1788541287.033659:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541287.033663:0:19250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003ed1e60/0x2aac941e5f4a8c19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.033673:0:19250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003ed1e60/0x2aac941e5f4a8c19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.033681:0:19250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003ed1e60/0x2aac941e5f4a8c19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.033697:0:19250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003ed1e60/0x2aac941e5f4a8c19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.033710:0:19250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788541287.033719:0:19546:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788541287.033723:0:19546:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a0a6b27/0x2aac941e5f4a8c12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.033730:0:19546:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551a800 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:2.0:1788541287.033733:0:19546:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a0a6b27/0x2aac941e5f4a8c12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.033742:0:19546:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a0a6b27/0x2aac941e5f4a8c12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.033762:0:19546:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a0a6b27/0x2aac941e5f4a8c12 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.033770:0:19546:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a0a6b27/0x2aac941e5f4a8c12 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.033783:0:19546:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541287.033787:0:19546:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003ed1e60/0x2aac941e5f4a8c19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.033802:0:19546:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551b200 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:2.0:1788541287.033805:0:19546:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003ed1e60/0x2aac941e5f4a8c19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.033813:0:19546:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003ed1e60/0x2aac941e5f4a8c19 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.033822:0:19546:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003ed1e60/0x2aac941e5f4a8c19 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.033829:0:19546:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003ed1e60/0x2aac941e5f4a8c19 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.033841:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541287.033843:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541287.033844:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541287.036035:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788541287.036099:0:18717:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788541287.036107:0:18717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d13f9ad/0x2aac941e5f4a8c20 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.036121:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=567s v=(0 0) 00010000:00010000:0.0:1788541287.036125:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541287.036130:0:18717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d13f9ad/0x2aac941e5f4a8c20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.036144:0:18717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d13f9ad/0x2aac941e5f4a8c20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.036153:0:18717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d13f9ad/0x2aac941e5f4a8c20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.036161:0:18717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d13f9ad/0x2aac941e5f4a8c20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.036188:0:18717:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788541287.036197:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541287.036202:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d13f9ad/0x2aac941e5f4a8c20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.036210:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75ee00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788541287.036215:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d13f9ad/0x2aac941e5f4a8c20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.036224:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d13f9ad/0x2aac941e5f4a8c20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.036239:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d13f9ad/0x2aac941e5f4a8c20 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.036246:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d13f9ad/0x2aac941e5f4a8c20 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.036261:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541287.036263:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541287.036265:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788541287.037005:0:19250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788541287.037015:0:19250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da68ed35/0x2aac941e5f4a8c27 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.037025:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=567s v=(0 0) 00010000:00010000:3.0:1788541287.037028:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541287.037033:0:19250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da68ed35/0x2aac941e5f4a8c27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.037042:0:19250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da68ed35/0x2aac941e5f4a8c27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.037050:0:19250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da68ed35/0x2aac941e5f4a8c27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.037064:0:19250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da68ed35/0x2aac941e5f4a8c27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.037078:0:19250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788541287.037385:0:19250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788541287.037390:0:19250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053bee01a/0x2aac941e5f4a8c2e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.037399:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=567s v=(0 0) 00010000:00010000:3.0:1788541287.037402:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541287.037405:0:19250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053bee01a/0x2aac941e5f4a8c2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.037415:0:19250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053bee01a/0x2aac941e5f4a8c2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.037423:0:19250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053bee01a/0x2aac941e5f4a8c2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.037430:0:19250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053bee01a/0x2aac941e5f4a8c2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.037449:0:19250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788541287.037454:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788541287.037459:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da68ed35/0x2aac941e5f4a8c27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.037467:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68043cc400 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788541287.037476:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da68ed35/0x2aac941e5f4a8c27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.037484:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da68ed35/0x2aac941e5f4a8c27 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.037498:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da68ed35/0x2aac941e5f4a8c27 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.037506:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da68ed35/0x2aac941e5f4a8c27 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.037520:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541287.037523:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053bee01a/0x2aac941e5f4a8c2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.037530:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68043cce00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788541287.037533:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053bee01a/0x2aac941e5f4a8c2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.037540:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053bee01a/0x2aac941e5f4a8c2e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.037549:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053bee01a/0x2aac941e5f4a8c2e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.037556:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053bee01a/0x2aac941e5f4a8c2e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.037574:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541287.037576:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541287.037578:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788541287.037745:0:19250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788541287.037750:0:19250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000464c56ee/0x2aac941e5f4a8c35 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.037762:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=567s v=(0 0) 00010000:00010000:3.0:1788541287.037764:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541287.037768:0:19250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000464c56ee/0x2aac941e5f4a8c35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.037777:0:19250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000464c56ee/0x2aac941e5f4a8c35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.037785:0:19250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000464c56ee/0x2aac941e5f4a8c35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.037791:0:19250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000464c56ee/0x2aac941e5f4a8c35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.037810:0:19250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788541287.037916:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541287.037921:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000464c56ee/0x2aac941e5f4a8c35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.037929:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68043cd000 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788541287.037942:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000464c56ee/0x2aac941e5f4a8c35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.037950:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000464c56ee/0x2aac941e5f4a8c35 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.037961:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000464c56ee/0x2aac941e5f4a8c35 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.037968:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000464c56ee/0x2aac941e5f4a8c35 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.037980:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541287.037982:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541287.037984:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788541287.038123:0:19250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788541287.038128:0:19250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f26a8c0/0x2aac941e5f4a8c3c lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.038136:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=567s v=(0 0) 00010000:00010000:3.0:1788541287.038139:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541287.038143:0:19250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f26a8c0/0x2aac941e5f4a8c3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.038153:0:19250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f26a8c0/0x2aac941e5f4a8c3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.038173:0:19250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f26a8c0/0x2aac941e5f4a8c3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.038180:0:19250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f26a8c0/0x2aac941e5f4a8c3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.038200:0:19250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788541287.038366:0:19546:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788541287.038529:0:19546:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f26a8c0/0x2aac941e5f4a8c3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.038539:0:19546:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68043cde00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:2.0:1788541287.038543:0:19546:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f26a8c0/0x2aac941e5f4a8c3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.038551:0:19546:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f26a8c0/0x2aac941e5f4a8c3c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.038568:0:19546:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f26a8c0/0x2aac941e5f4a8c3c lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.038576:0:19546:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f26a8c0/0x2aac941e5f4a8c3c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.038590:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541287.038592:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541287.038594:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541287.038928:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788541287.038952:0:19250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788541287.038958:0:19250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000780bba4f/0x2aac941e5f4a8c43 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.038968:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=567s v=(0 0) 00010000:00010000:3.0:1788541287.038971:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541287.038976:0:19250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000780bba4f/0x2aac941e5f4a8c43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788541287.038981:0:18717:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788541287.038986:0:19250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000780bba4f/0x2aac941e5f4a8c43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.038986:0:18717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af111ead/0x2aac941e5f4a8c4a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.038994:0:19250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000780bba4f/0x2aac941e5f4a8c43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.038998:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=567s v=(0 0) 00010000:00010000:3.0:1788541287.039001:0:19250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000780bba4f/0x2aac941e5f4a8c43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.039001:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541287.039005:0:18717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af111ead/0x2aac941e5f4a8c4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.039015:0:18717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af111ead/0x2aac941e5f4a8c4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.039022:0:18717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af111ead/0x2aac941e5f4a8c4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.039030:0:19250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788541287.039031:0:18717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af111ead/0x2aac941e5f4a8c4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.039040:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541287.039044:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000780bba4f/0x2aac941e5f4a8c43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.039050:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68043cc800 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788541287.039053:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000780bba4f/0x2aac941e5f4a8c43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.039060:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000780bba4f/0x2aac941e5f4a8c43 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.039080:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000780bba4f/0x2aac941e5f4a8c43 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.039087:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000780bba4f/0x2aac941e5f4a8c43 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.039101:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541287.039103:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541287.039105:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541287.039117:0:18717:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788541287.039124:0:19546:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541287.039127:0:19546:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af111ead/0x2aac941e5f4a8c4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.039135:0:19546:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75f600 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788541287.039138:0:19546:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af111ead/0x2aac941e5f4a8c4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.039145:0:19546:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af111ead/0x2aac941e5f4a8c4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.039155:0:19546:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af111ead/0x2aac941e5f4a8c4a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.039162:0:19546:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af111ead/0x2aac941e5f4a8c4a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.039186:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541287.039187:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541287.039189:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788541287.039658:0:19530:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1788541287.039689:0:19530:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788541287.039694:0:19530:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788541287.039925:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17941:x1875420981172992:12345-0@lo:5:osp-pre-1-1.0 Request processed in 23366us (32823us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788541287.039946:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788541287.039992:0:17941:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788541287.040000:0:17941:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67082fb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17941:1875420981172992:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1788541287.040014:0:17941:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1788541287.040061:0:17941:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17941:1875420981173120:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1788541287.040098:0:17941:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541287.040121:0:17941:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68394b5240 going to sleep for 11 seconds 00000100:00100000:3.0:1788541287.040139:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981173120 00000100:00100000:3.0:1788541287.040145:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981173120 00000100:00100000:3.0:1788541287.040180:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788541287.040188:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17941:x1875420981173120:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1788541287.040245:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17941:x1875420981173120:12345-0@lo:900:osp-pre-1-1.0 Request processed in 57us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541287.040252:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788541287.040281:0:17941:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6705aa5180 x1875420981173120/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788541303 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541287.040290:0:17941:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17941:1875420981173120:0@lo:900:osp-pre-1-1.0 00002000:00010000:2.0:1788541287.040480:0:19250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788541287.040488:0:19250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ce360d0/0x2aac941e5f4a8c51 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.040499:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=567s v=(0 0) 00010000:00010000:2.0:1788541287.040502:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541287.040508:0:19250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ce360d0/0x2aac941e5f4a8c51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.040519:0:19250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ce360d0/0x2aac941e5f4a8c51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.040528:0:19250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ce360d0/0x2aac941e5f4a8c51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.040546:0:19250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ce360d0/0x2aac941e5f4a8c51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.040566:0:19250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788541287.040945:0:19250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788541287.040951:0:19250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006273aee1/0x2aac941e5f4a8c58 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.040959:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=567s v=(0 0) 00010000:00010000:2.0:1788541287.040963:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541287.040966:0:19250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006273aee1/0x2aac941e5f4a8c58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.040976:0:19250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006273aee1/0x2aac941e5f4a8c58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.040984:0:19250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006273aee1/0x2aac941e5f4a8c58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.040991:0:19250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006273aee1/0x2aac941e5f4a8c58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.041010:0:19250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788541287.041243:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788541287.041250:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ce360d0/0x2aac941e5f4a8c51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.041267:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551ba00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:3.0:1788541287.041271:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ce360d0/0x2aac941e5f4a8c51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.041279:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ce360d0/0x2aac941e5f4a8c51 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.041291:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ce360d0/0x2aac941e5f4a8c51 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.041298:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ce360d0/0x2aac941e5f4a8c51 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.041312:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788541287.041316:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006273aee1/0x2aac941e5f4a8c58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.041321:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551a400 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:3.0:1788541287.041324:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006273aee1/0x2aac941e5f4a8c58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.041330:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006273aee1/0x2aac941e5f4a8c58 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.041338:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006273aee1/0x2aac941e5f4a8c58 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.041350:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006273aee1/0x2aac941e5f4a8c58 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.041362:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541287.041364:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541287.041366:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788541287.041481:0:19250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788541287.041487:0:19250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9ec6a63/0x2aac941e5f4a8c5f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.041500:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=567s v=(0 0) 00010000:00010000:2.0:1788541287.041503:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541287.041504:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541287.041507:0:19250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9ec6a63/0x2aac941e5f4a8c5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.041516:0:19250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9ec6a63/0x2aac941e5f4a8c5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.041524:0:19250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9ec6a63/0x2aac941e5f4a8c5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.041531:0:19250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9ec6a63/0x2aac941e5f4a8c5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.041549:0:19250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788541287.041550:0:18717:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788541287.041555:0:18717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084d2274b/0x2aac941e5f4a8c66 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.041564:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=567s v=(0 0) 00010000:00010000:0.0:1788541287.041566:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541287.041571:0:18717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084d2274b/0x2aac941e5f4a8c66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788541287.041842:0:19250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788541287.041848:0:19250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c561d3e/0x2aac941e5f4a8c6d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.041856:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=567s v=(0 0) 00010000:00010000:2.0:1788541287.041858:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541287.041862:0:19250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c561d3e/0x2aac941e5f4a8c6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.041913:0:19250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c561d3e/0x2aac941e5f4a8c6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.041941:0:19250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c561d3e/0x2aac941e5f4a8c6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.041949:0:19250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c561d3e/0x2aac941e5f4a8c6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.041962:0:19250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788541287.042147:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788541287.042152:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9ec6a63/0x2aac941e5f4a8c5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.042159:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551b800 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:3.0:1788541287.042162:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9ec6a63/0x2aac941e5f4a8c5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.042170:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9ec6a63/0x2aac941e5f4a8c5f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.042182:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9ec6a63/0x2aac941e5f4a8c5f lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.042189:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9ec6a63/0x2aac941e5f4a8c5f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.042199:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788541287.042202:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c561d3e/0x2aac941e5f4a8c6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.042213:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551ae00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:3.0:1788541287.042216:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c561d3e/0x2aac941e5f4a8c6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.042223:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c561d3e/0x2aac941e5f4a8c6d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.042232:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c561d3e/0x2aac941e5f4a8c6d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.042238:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c561d3e/0x2aac941e5f4a8c6d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.042250:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541287.042251:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541287.042253:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788541287.042365:0:19250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788541287.042443:0:19250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003ed1e60/0x2aac941e5f4a8c74 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.042453:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=567s v=(0 0) 00010000:00010000:2.0:1788541287.042456:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541287.042460:0:19250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003ed1e60/0x2aac941e5f4a8c74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.042468:0:19250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003ed1e60/0x2aac941e5f4a8c74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.042476:0:19250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003ed1e60/0x2aac941e5f4a8c74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.042483:0:19250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003ed1e60/0x2aac941e5f4a8c74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.042507:0:19250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788541287.042943:0:19250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788541287.042950:0:19250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a0a6b27/0x2aac941e5f4a8c7b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.042958:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=567s v=(0 0) 00010000:00010000:2.0:1788541287.042961:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541287.042965:0:19250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a0a6b27/0x2aac941e5f4a8c7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.042974:0:19250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a0a6b27/0x2aac941e5f4a8c7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.042982:0:19250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a0a6b27/0x2aac941e5f4a8c7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.042989:0:19250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a0a6b27/0x2aac941e5f4a8c7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.043003:0:19250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788541287.043224:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788541287.043230:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003ed1e60/0x2aac941e5f4a8c74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.043237:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551b200 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:3.0:1788541287.043240:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003ed1e60/0x2aac941e5f4a8c74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.043247:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003ed1e60/0x2aac941e5f4a8c74 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.043265:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003ed1e60/0x2aac941e5f4a8c74 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.043272:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003ed1e60/0x2aac941e5f4a8c74 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.043286:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788541287.043289:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a0a6b27/0x2aac941e5f4a8c7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.043295:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551a800 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:3.0:1788541287.043298:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a0a6b27/0x2aac941e5f4a8c7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.043305:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a0a6b27/0x2aac941e5f4a8c7b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.043313:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a0a6b27/0x2aac941e5f4a8c7b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.043319:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a0a6b27/0x2aac941e5f4a8c7b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.043329:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541287.043331:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541287.043337:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788541287.043479:0:19250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788541287.043485:0:19250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7e15114/0x2aac941e5f4a8c82 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.043494:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=567s v=(0 0) 00010000:00010000:2.0:1788541287.043502:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541287.043507:0:19250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7e15114/0x2aac941e5f4a8c82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.043516:0:19250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7e15114/0x2aac941e5f4a8c82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.043524:0:19250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7e15114/0x2aac941e5f4a8c82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.043532:0:19250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7e15114/0x2aac941e5f4a8c82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.043537:0:18717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084d2274b/0x2aac941e5f4a8c66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.043545:0:18717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084d2274b/0x2aac941e5f4a8c66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.043552:0:18717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084d2274b/0x2aac941e5f4a8c66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541287.043578:0:19250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1788541287.043613:0:19250:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:2.0:1788541287.043695:0:19250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706831500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17223:x1875420981171840:12345-0@lo:5:osp-pre-0-0.0 Request processed in 51870us (52794us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541287.043704:0:19250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788541287.043829:0:17223:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17223:1875420981171840:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788541287.043844:0:17223:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:2.0:1788541287.043912:0:17223:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706831f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17223:1875420981173248:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788541287.043954:0:17223:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541287.043976:0:17223:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a67083070c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788541287.043993:0:19664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981173248 00000100:00100000:2.0:1788541287.043998:0:19664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981173248 00000100:00100000:2.0:1788541287.044040:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788541287.044049:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17223:x1875420981173248:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788541287.044086:0:18718:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00010000:00010000:0.0:1788541287.048328:0:19546:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788541287.048343:0:19546:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7e15114/0x2aac941e5f4a8c82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.048371:0:19546:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551bc00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788541287.048377:0:19546:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7e15114/0x2aac941e5f4a8c82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.048388:0:19546:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7e15114/0x2aac941e5f4a8c82 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.048408:0:19546:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7e15114/0x2aac941e5f4a8c82 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.048416:0:19546:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7e15114/0x2aac941e5f4a8c82 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.048437:0:19546:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541287.048442:0:19546:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084d2274b/0x2aac941e5f4a8c66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.048448:0:19546:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75fc00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788541287.048452:0:19546:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084d2274b/0x2aac941e5f4a8c66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.048459:0:19546:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084d2274b/0x2aac941e5f4a8c66 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.048470:0:19546:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084d2274b/0x2aac941e5f4a8c66 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.048484:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541287.048486:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541287.048487:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541287.048495:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788541287.048779:0:18713:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:2.0:1788541287.048829:0:18713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788541287.049122:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541287.050709:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17223:x1875420981173248:12345-0@lo:5:osp-pre-0-0.0 Request processed in 6652us (6745us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788541287.050722:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788541287.050725:0:17223:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1788541287.050732:0:17223:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706831f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17223:1875420981173248:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788541287.050747:0:17223:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:1.0:1788541287.051181:0:18717:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788541287.051191:0:18717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084d2274b/0x2aac941e5f4a8c66 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.051498:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788541287.051859:0:18717:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788541287.051867:0:18717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0614114/0x2aac941e5f4a8c89 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.051900:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1788541287.051904:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541287.051911:0:18717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0614114/0x2aac941e5f4a8c89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.051925:0:18717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0614114/0x2aac941e5f4a8c89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.051946:0:18717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0614114/0x2aac941e5f4a8c89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.051954:0:18717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0614114/0x2aac941e5f4a8c89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.051971:0:18717:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788541287.052017:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541287.052024:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0614114/0x2aac941e5f4a8c89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.052032:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706956e00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788541287.052038:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0614114/0x2aac941e5f4a8c89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.052047:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0614114/0x2aac941e5f4a8c89 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.052064:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0614114/0x2aac941e5f4a8c89 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.052072:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0614114/0x2aac941e5f4a8c89 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.052086:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541287.052094:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541287.052096:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788541287.052241:0:18717:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788541287.052251:0:18717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007954e8dc/0x2aac941e5f4a8c90 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.052260:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1788541287.052263:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541287.052268:0:18717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007954e8dc/0x2aac941e5f4a8c90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.052277:0:18717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007954e8dc/0x2aac941e5f4a8c90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.052286:0:18717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007954e8dc/0x2aac941e5f4a8c90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.052293:0:18717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007954e8dc/0x2aac941e5f4a8c90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.052309:0:18717:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788541287.052548:0:18717:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788541287.052554:0:18717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001974258/0x2aac941e5f4a8c97 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.052562:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1788541287.052565:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541287.052570:0:18717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001974258/0x2aac941e5f4a8c97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.052579:0:18717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001974258/0x2aac941e5f4a8c97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.052591:0:18717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001974258/0x2aac941e5f4a8c97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.052599:0:18717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001974258/0x2aac941e5f4a8c97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.052619:0:18717:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788541287.052845:0:18717:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788541287.052851:0:18717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001205e250/0x2aac941e5f4a8c9e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.052859:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1788541287.052861:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541287.052865:0:18717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001205e250/0x2aac941e5f4a8c9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.052893:0:18717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001205e250/0x2aac941e5f4a8c9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.052902:0:18717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001205e250/0x2aac941e5f4a8c9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.052909:0:18717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001205e250/0x2aac941e5f4a8c9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.052942:0:18717:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788541287.053087:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788541287.053094:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007954e8dc/0x2aac941e5f4a8c90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.053102:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706956c00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:3.0:1788541287.053106:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007954e8dc/0x2aac941e5f4a8c90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.053114:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007954e8dc/0x2aac941e5f4a8c90 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.053128:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007954e8dc/0x2aac941e5f4a8c90 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.053136:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007954e8dc/0x2aac941e5f4a8c90 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.053152:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788541287.053155:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001974258/0x2aac941e5f4a8c97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.053162:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706957e00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:3.0:1788541287.053165:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001974258/0x2aac941e5f4a8c97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.053215:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001974258/0x2aac941e5f4a8c97 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788541287.053223:0:18717:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788541287.053229:0:18717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009412ebd7/0x2aac941e5f4a8ca5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.053234:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001974258/0x2aac941e5f4a8c97 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.053237:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1788541287.053240:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788541287.053242:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001974258/0x2aac941e5f4a8c97 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.053245:0:18717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009412ebd7/0x2aac941e5f4a8ca5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.053254:0:18717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009412ebd7/0x2aac941e5f4a8ca5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.053256:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788541287.053260:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001205e250/0x2aac941e5f4a8c9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.053262:0:18717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009412ebd7/0x2aac941e5f4a8ca5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.053267:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706957800 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:3.0:1788541287.053271:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001205e250/0x2aac941e5f4a8c9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.053271:0:18717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009412ebd7/0x2aac941e5f4a8ca5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.053278:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001205e250/0x2aac941e5f4a8c9e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.053279:0:18717:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788541287.053287:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001205e250/0x2aac941e5f4a8c9e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.053294:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001205e250/0x2aac941e5f4a8c9e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.053316:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788541287.053320:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009412ebd7/0x2aac941e5f4a8ca5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.053326:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706956600 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:3.0:1788541287.053329:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009412ebd7/0x2aac941e5f4a8ca5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.053337:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009412ebd7/0x2aac941e5f4a8ca5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.053347:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009412ebd7/0x2aac941e5f4a8ca5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.053354:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009412ebd7/0x2aac941e5f4a8ca5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.053366:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541287.053368:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541287.053370:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541287.053493:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788541287.053499:0:18717:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788541287.053499:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541287.053504:0:18717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc017dc7/0x2aac941e5f4a8cac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.053512:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1788541287.053521:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541287.053525:0:18717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc017dc7/0x2aac941e5f4a8cac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.053534:0:18717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc017dc7/0x2aac941e5f4a8cac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.053542:0:18717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc017dc7/0x2aac941e5f4a8cac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.053549:0:18717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc017dc7/0x2aac941e5f4a8cac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.053571:0:18717:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788541287.053685:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788541287.053690:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc017dc7/0x2aac941e5f4a8cac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.053697:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706957a00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:3.0:1788541287.053705:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc017dc7/0x2aac941e5f4a8cac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.053714:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc017dc7/0x2aac941e5f4a8cac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.053725:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc017dc7/0x2aac941e5f4a8cac lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.053732:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc017dc7/0x2aac941e5f4a8cac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541287.053746:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541287.053747:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541287.053749:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788541287.053949:0:18717:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788541287.053955:0:18717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000944a934e/0x2aac941e5f4a8cb3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.053965:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=567s v=(0 0) 00010000:00010000:1.0:1788541287.053967:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541287.053970:0:18717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000944a934e/0x2aac941e5f4a8cb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.053979:0:18717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000944a934e/0x2aac941e5f4a8cb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.053987:0:18717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000944a934e/0x2aac941e5f4a8cb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.054000:0:18717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000944a934e/0x2aac941e5f4a8cb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541287.054024:0:18717:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1788541287.054056:0:18717:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:1.0:1788541287.054150:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707818380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17225:x1875420981172480:12345-0@lo:5:osp-pre-1-0.0 Request processed in 61640us (61697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541287.054160:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1788541287.054217:0:19546:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541287.054222:0:19546:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000944a934e/0x2aac941e5f4a8cb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.054230:0:19546:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706957200 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788541287.054233:0:19546:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000944a934e/0x2aac941e5f4a8cb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.054242:0:19546:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000944a934e/0x2aac941e5f4a8cb3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.054254:0:19546:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000944a934e/0x2aac941e5f4a8cb3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.054262:0:19546:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000944a934e/0x2aac941e5f4a8cb3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541287.054277:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541287.054278:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541287.054280:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541287.054437:0:17225:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707818a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17225:1875420981172480:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788541287.054454:0:17225:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:3.0:1788541287.054508:0:17225:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6705aa5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17225:1875420981173376:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788541287.054553:0:17225:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541287.054594:0:17225:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68394b5240 going to sleep for 11 seconds 00000100:00100000:0.0:1788541287.054646:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981173376 00000100:00100000:0.0:1788541287.054653:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981173376 00000100:00100000:0.0:1788541287.054707:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788541287.054716:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17225:x1875420981173376:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788541287.054761:0:18716:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:1.0:1788541287.058425:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17225:x1875420981173376:12345-0@lo:5:osp-pre-1-0.0 Request processed in 3703us (3866us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788541287.058439:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788541287.059221:0:17225:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6705aa5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17225:1875420981173376:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788541287.059238:0:17225:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:0.0:1788541287.249632:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788541287.947041:0:17950:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788541288.269343:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541289.291054:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788541290.314701:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541290.442215:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788541290.442719:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67080d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981173504:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788541290.442819:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541290.442932:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981173504 00000100:00100000:3.0:1788541290.442942:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981173504 00000100:00100000:3.0:1788541290.443000:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788541290.443008:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68052e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981173504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788541290.443039:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788541290.443088:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68052e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981173504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541290.443095:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788541290.443118:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788541290.443156:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67080d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981173504:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788541290.956391:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788541290.956458:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981173632:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788541290.956568:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541290.956962:0:18270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981173632 00000100:00100000:1.0:1788541290.956971:0:18270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981173632 00000100:00100000:1.0:1788541290.957019:0:18270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788541290.957029:0:18270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68052e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981173632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788541290.957065:0:18270:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788541290.957120:0:18270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68052e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981173632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541290.957129:0:18270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788541290.957181:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981173632:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788541290.957523:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67082f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981173760:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788541290.957575:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541290.957660:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981173760 00000100:00100000:1.0:1788541290.957665:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981173760 00000100:00100000:1.0:1788541290.957711:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788541290.957719:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981173760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788541290.957747:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788541290.957782:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981173760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 64us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541290.957788:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788541290.957857:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67082f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981173760:0@lo:41:osp-pre-1-0.0 00000001:02000400:1.0:1788541290.971464:0:19888:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg256-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788541291.338693:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788541291.838434:0:19940:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788541291.839149:0:19940:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788541292.363813:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541292.491050:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68052e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981173888:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788541292.491130:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541292.491188:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788541292.491194:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68052e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981174016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788541292.491216:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541292.491251:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981173888 00000100:00100000:3.0:1788541292.491259:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981173888 00000100:00100000:3.0:1788541292.491313:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981174016 00000100:00100000:3.0:1788541292.491317:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981174016 00000100:00100000:3.0:1788541292.491336:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788541292.491358:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68052e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981173888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788541292.491389:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788541292.491448:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68052e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981173888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541292.491470:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788541292.491488:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788541292.491494:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68052e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875420981174016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788541292.491504:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788541292.491539:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68052e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3643:x1875420981174016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541292.491545:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1788541292.491562:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788541292.491616:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68052e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981174016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788541292.491631:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68052e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981173888:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788541292.491913:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788541292.491925:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981174144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788541292.491957:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541292.491985:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981174144 00000100:00100000:2.0:1788541292.491989:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981174144 00000100:00100000:2.0:1788541292.492016:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788541292.492022:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706830700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981174144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788541292.492040:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788541292.492070:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706830700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981174144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541292.492076:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788541292.492105:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981174144:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788541292.492119:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788541292.493420:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707818700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4746c063-6c88-4476-b99b-02bb8e8d54f7:3642:1875420981174272:0@lo:400:kworker.0 00000100:00100000:0.0:1788541292.493479:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541292.493520:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707818000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981174784:0@lo:400:kworker.0 00000100:00100000:0.0:1788541292.493550:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541292.493566:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875420981175296:0@lo:400:kworker.0 00000100:00100000:0.0:1788541292.493589:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541292.493614:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788541292.493620:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707819500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981174656:0@lo:400:kworker.0 00000100:00100000:0.0:1788541292.493684:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541292.493837:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981174272 00000100:00100000:2.0:1788541292.493853:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981174272 00000100:00100000:2.0:1788541292.493929:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788541292.493938:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68378a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+24:3642:x1875420981174272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541292.493983:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68378a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+24:3642:x1875420981174272:12345-0@lo:400:kworker.0 Request processed in 47us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541292.493990:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788541292.494034:0:19250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981174784 00000100:00100000:2.0:1788541292.494038:0:19250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981174784 00000100:00100000:2.0:1788541292.494074:0:19250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788541292.494080:0:19250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981174784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541292.494112:0:19250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981174784:12345-0@lo:400:kworker.0 Request processed in 32us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541292.494118:0:19250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788541292.494134:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788541292.495228:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981174400:0@lo:400:kworker.0 00000100:00100000:3.0:1788541292.495289:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541292.495323:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670781b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875420981174912:0@lo:400:kworker.0 00000100:00100000:0.0:1788541292.495342:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875420981175168:0@lo:400:kworker.0 00000100:00100000:3.0:1788541292.495347:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541292.495364:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875420981175424:0@lo:400:kworker.0 00000100:00100000:0.0:1788541292.495370:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541292.495385:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541292.495401:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707818700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4746c063-6c88-4476-b99b-02bb8e8d54f7:3642:1875420981174272:0@lo:400:kworker.0 00000100:00100000:3.0:1788541292.495403:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788541292.495409:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707818a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875420981174528:0@lo:400:kworker.0 00000100:00100000:0.0:1788541292.495416:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707818000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981174784:0@lo:400:kworker.0 00000100:00100000:3.0:1788541292.495440:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541292.495453:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875420981175040:0@lo:400:kworker.0 00000100:00100000:0.0:1788541292.495462:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981175296 00000100:00100000:0.0:1788541292.495467:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981175296 00000100:00100000:3.0:1788541292.495474:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541292.495493:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981174656 00000100:00100000:3.0:1788541292.495496:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981174656 00000100:00100000:0.0:1788541292.495504:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981174912 00000100:00100000:0.0:1788541292.495507:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981174912 00000100:00100000:0.0:1788541292.495517:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981175168 00000100:00100000:0.0:1788541292.495519:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981175168 00000100:00100000:3.0:1788541292.495520:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981174400 00000100:00100000:0.0:1788541292.495530:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981175424 00000100:00100000:3.0:1788541292.495536:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981174400 00000100:00100000:0.0:1788541292.495537:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981175424 00000100:00100000:0.0:1788541292.495548:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981174528 00000100:00100000:3.0:1788541292.495551:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788541292.495551:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981174528 00000100:00100000:3.0:1788541292.495559:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981174656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541292.495559:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981175040 00000100:00100000:0.0:1788541292.495561:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981175040 00000100:00100000:0.0:1788541292.495573:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788541292.495578:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875420981175296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541292.495614:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875420981175296:12345-0@lo:400:kworker.0 Request processed in 35us (2024us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541292.495616:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981174656:12345-0@lo:400:kworker.0 Request processed in 58us (1932us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541292.495621:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788541292.495622:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788541292.495636:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788541292.495636:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788541292.495643:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68052e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981174400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541292.495643:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68052e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875420981174912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541292.496358:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68052e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875420981174912:12345-0@lo:400:kworker.0 Request processed in 712us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541292.496366:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788541292.496383:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788541292.496392:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835589f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875420981175168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541292.496432:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835589f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1875420981175168:12345-0@lo:400:kworker.0 Request processed in 43us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541292.496438:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1788541292.496449:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788541292.496449:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1788541292.496453:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788541292.496455:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68052e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875420981175424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541292.496481:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68052e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875420981175424:12345-0@lo:400:kworker.0 Request processed in 27us (1095us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541292.496486:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788541292.496495:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788541292.496500:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68052e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875420981174528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541292.496537:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68052e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875420981174528:12345-0@lo:400:kworker.0 Request processed in 36us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541292.496543:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788541292.496554:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788541292.496560:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68052e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875420981175040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541292.496586:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68052e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1875420981175040:12345-0@lo:400:kworker.0 Request processed in 26us (1110us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541292.496591:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788541292.496635:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707819500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981174656:0@lo:400:kworker.0 00010000:00080000:0.0:1788541292.496650:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670831c700 x1875420981175168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541292.496660:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3642:1875420981175168:0@lo:400:kworker.0 00010000:00080000:0.0:1788541292.496671:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670831df80 x1875420981175296/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788541292.496679:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875420981175296:0@lo:400:kworker.0 00000100:00100000:3.0:1788541292.497110:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68052e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981174400:12345-0@lo:400:kworker.0 Request processed in 29us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541292.497118:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1788541292.497159:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707818a80 x1875420981174528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541292.497169:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707818a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875420981174528:0@lo:400:kworker.0 00010000:00080000:3.0:1788541292.497180:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670831d880 x1875420981175040/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541292.497188:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3643:1875420981175040:0@lo:400:kworker.0 00000100:00100000:3.0:1788541292.497200:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981174400:0@lo:400:kworker.0 00010000:00080000:3.0:1788541292.497210:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670781b100 x1875420981174912/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541292.497219:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670781b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875420981174912:0@lo:400:kworker.0 00010000:00080000:3.0:1788541292.497231:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670831f480 x1875420981175424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541292.497239:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875420981175424:0@lo:400:kworker.0 00000020:00000004:3.0:1788541292.865430:0:19990:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788541292.866225:0:19990:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1788541292.877385:0:17231:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:0.0:1788541293.012920:0:19530:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:3.0:1788541293.159423:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541293.160523:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955922048 00000100:00100000:1.0:1788541293.160537:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955922048 00000100:00100000:1.0:1788541293.160600:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 114 00000100:00100000:1.0:1788541293.160609:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68378a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2393:x1875420955922048:12345-192.168.202.56@tcp:250:mount.lustre.0 00010000:00080000:1.0:1788541293.160647:0:17193:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from b8172f99-f71c-41fa-8527-cb3efe1827fc@192.168.202.56@tcp t0 exp 0000000000000000 cur 574 last 0 00000020:00000080:1.0:1788541293.160680:0:17193:0:(genops.c:1385:class_connect()) connect: client b8172f99-f71c-41fa-8527-cb3efe1827fc, cookie 0x2aac941e5f4a8cba 00000100:00080000:1.0:1788541293.160819:0:17193:0:(import.c:65:import_set_state_nolock()) ffff9a682e792800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788541293.160947:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68378a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8172f99-f71c-41fa-8527-cb3efe1827fc+5:2393:x1875420955922048:12345-192.168.202.56@tcp:250:mount.lustre.0 Request processed in 337us (1533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541293.160955:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 114 00000100:00100000:2.0:1788541293.179653:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541293.179924:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955922176 00000100:00100000:1.0:1788541293.179936:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955922176 00000100:00100000:1.0:1788541293.179997:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 115 00000100:00100000:1.0:1788541293.180008:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68378a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8172f99-f71c-41fa-8527-cb3efe1827fc+5:14911:x1875420955922176:12345-192.168.202.56@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788541293.180026:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541293.180045:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6706956e00/0x2aac941e5f4a8cc1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16473202a3315b7 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541293.180072:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6706956e00/0x2aac941e5f4a8cc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3315b7 expref: 6 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541293.180104:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6706956e00/0x2aac941e5f4a8cc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3315b7 expref: 6 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541293.180113:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6706956e00, rc 0) 00000100:00100000:1.0:1788541293.180179:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68378a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8172f99-f71c-41fa-8527-cb3efe1827fc+6:14911:x1875420955922176:12345-192.168.202.56@tcp:101:mount.lustre.0 Request processed in 173us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541293.180187:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 115 00000100:00100000:3.0:1788541293.189965:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541293.191532:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955922304 00000100:00100000:2.0:1788541293.191546:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955922304 00000100:00100000:2.0:1788541293.191620:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 116 00000100:00100000:2.0:1788541293.191631:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68378a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8172f99-f71c-41fa-8527-cb3efe1827fc+6:14911:x1875420955922304:12345-192.168.202.56@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788541293.191993:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68378a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8172f99-f71c-41fa-8527-cb3efe1827fc+6:14911:x1875420955922304:12345-192.168.202.56@tcp:501:mount.lustre.0 Request processed in 362us (2037us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788541293.192002:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 116 00000100:00100000:3.0:1788541293.199174:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541293.199437:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955922432 00000100:00100000:2.0:1788541293.199448:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955922432 00000100:00100000:1.0:1788541293.199589:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 117 00000100:00100000:1.0:1788541293.199602:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68378a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8172f99-f71c-41fa-8527-cb3efe1827fc+6:14911:x1875420955922432:12345-192.168.202.56@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788541293.199620:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541293.199638:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6706957200/0x2aac941e5f4a8cc8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16473202a3315be expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541293.199679:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6706957200/0x2aac941e5f4a8cc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3315be expref: 7 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541293.199692:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6706957200/0x2aac941e5f4a8cc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3315be expref: 7 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541293.199701:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6706957200, rc 0) 00000100:00100000:1.0:1788541293.199765:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68378a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8172f99-f71c-41fa-8527-cb3efe1827fc+7:14911:x1875420955922432:12345-192.168.202.56@tcp:101:mount.lustre.0 Request processed in 166us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541293.199772:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 117 00000100:00100000:3.0:1788541293.201617:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541293.201767:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955922560 00000100:00100000:2.0:1788541293.201775:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955922560 00000100:00100000:2.0:1788541293.201840:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 118 00000100:00100000:2.0:1788541293.201850:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68378a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8172f99-f71c-41fa-8527-cb3efe1827fc+7:14911:x1875420955922560:12345-192.168.202.56@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788541293.202030:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68378a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8172f99-f71c-41fa-8527-cb3efe1827fc+8:14911:x1875420955922560:12345-192.168.202.56@tcp:501:mount.lustre.0 Request processed in 181us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541293.202038:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 118 00000100:00100000:3.0:1788541293.209487:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541293.210324:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955922688 00000100:00100000:1.0:1788541293.210336:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955922688 00000100:00100000:1.0:1788541293.210410:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 119 00000100:00100000:1.0:1788541293.210434:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68378a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8172f99-f71c-41fa-8527-cb3efe1827fc+8:14911:x1875420955922688:12345-192.168.202.56@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788541293.210601:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68378a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8172f99-f71c-41fa-8527-cb3efe1827fc+8:14911:x1875420955922688:12345-192.168.202.56@tcp:503:mount.lustre.0 Request processed in 168us (1123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541293.210609:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 119 00000100:00100000:1.0:1788541293.219269:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541293.219348:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955922816 00000100:00100000:2.0:1788541293.219359:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955922816 00000100:00100000:2.0:1788541293.219427:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 120 00000100:00100000:2.0:1788541293.219438:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68378a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8172f99-f71c-41fa-8527-cb3efe1827fc+8:14930:x1875420955922816:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788541293.219606:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68378a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8172f99-f71c-41fa-8527-cb3efe1827fc+8:14930:x1875420955922816:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 170us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541293.219615:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 120 00000100:00100000:0.0:1788541293.245345:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541293.245516:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955922944 00000100:00100000:3.0:1788541293.245526:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955922944 00000100:00100000:3.0:1788541293.245587:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 121 00000100:00100000:3.0:1788541293.245598:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68378a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8172f99-f71c-41fa-8527-cb3efe1827fc+8:14930:x1875420955922944:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788541293.245790:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68378a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8172f99-f71c-41fa-8527-cb3efe1827fc+8:14930:x1875420955922944:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 193us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541293.245797:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 121 00000100:00100000:3.0:1788541293.261144:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541293.261250:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955923072 00000100:00100000:1.0:1788541293.261261:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955923072 00000100:00100000:1.0:1788541293.261317:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 122 00000100:00100000:1.0:1788541293.261327:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68378a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8172f99-f71c-41fa-8527-cb3efe1827fc+8:14930:x1875420955923072:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788541293.261517:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68378a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8172f99-f71c-41fa-8527-cb3efe1827fc+8:14930:x1875420955923072:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 190us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541293.261526:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 122 00000100:00100000:1.0:1788541293.269274:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541293.269372:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955923200 00000100:00100000:2.0:1788541293.269383:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955923200 00000100:00100000:2.0:1788541293.269450:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 123 00000100:00100000:2.0:1788541293.269461:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68378a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8172f99-f71c-41fa-8527-cb3efe1827fc+8:14911:x1875420955923200:12345-192.168.202.56@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788541293.269480:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541293.269510:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a683551ac00/0x2aac941e5f4a8ccf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16473202a3315ef expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541293.269539:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a683551ac00/0x2aac941e5f4a8ccf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3315ef expref: 9 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541293.269551:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a683551ac00/0x2aac941e5f4a8ccf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3315ef expref: 9 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541293.269561:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a683551ac00, rc 0) 00000100:00100000:2.0:1788541293.269637:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68378a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8172f99-f71c-41fa-8527-cb3efe1827fc+9:14911:x1875420955923200:12345-192.168.202.56@tcp:101:mount.lustre.0 Request processed in 177us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541293.269645:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 123 00000100:00100000:0.0:1788541293.284105:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541293.284193:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955923328 00000100:00100000:3.0:1788541293.284203:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955923328 00000100:00100000:3.0:1788541293.284268:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 124 00000100:00100000:3.0:1788541293.284278:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68378a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8172f99-f71c-41fa-8527-cb3efe1827fc+9:14911:x1875420955923328:12345-192.168.202.56@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788541293.284304:0:17192:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788541293.284327:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788541293.284331:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788541293.284335:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788541293.284338:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788541293.284341:0:17192:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1788541293.286118:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68378a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8172f99-f71c-41fa-8527-cb3efe1827fc+9:14911:x1875420955923328:12345-192.168.202.56@tcp:256:mount.lustre.0 Request processed in 1832us (2015us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541293.286133:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 124 00000100:00100000:1.0:1788541293.296338:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541293.296444:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955923456 00000100:00100000:2.0:1788541293.296454:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955923456 00000100:00100000:1.0:1788541293.296657:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 125 00000100:00100000:1.0:1788541293.296669:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68378a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8172f99-f71c-41fa-8527-cb3efe1827fc+9:14911:x1875420955923456:12345-192.168.202.56@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788541293.296687:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541293.296714:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a6706957800/0x2aac941e5f4a8cd6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16473202a3315f6 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541293.296743:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a6706957800/0x2aac941e5f4a8cd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3315f6 expref: 10 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541293.296755:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a6706957800/0x2aac941e5f4a8cd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3315f6 expref: 10 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541293.296783:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6706957800, rc 0) 00000100:00100000:1.0:1788541293.296839:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68378a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8172f99-f71c-41fa-8527-cb3efe1827fc+10:14911:x1875420955923456:12345-192.168.202.56@tcp:101:mount.lustre.0 Request processed in 174us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541293.296845:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 125 00000100:00100000:0.0:1788541293.299658:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541293.300136:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955923584 00000100:00100000:2.0:1788541293.300145:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955923584 00000100:00100000:2.0:1788541293.300201:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 126 00000100:00100000:2.0:1788541293.300210:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68378a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8172f99-f71c-41fa-8527-cb3efe1827fc+10:14911:x1875420955923584:12345-192.168.202.56@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788541293.300358:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68378a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8172f99-f71c-41fa-8527-cb3efe1827fc+10:14911:x1875420955923584:12345-192.168.202.56@tcp:501:mount.lustre.0 Request processed in 148us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541293.300366:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 126 00000100:00100000:3.0:1788541293.302940:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541293.305119:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955923712 00000100:00100000:2.0:1788541293.305132:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955923712 00000100:00100000:2.0:1788541293.305197:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 127 00000100:00100000:2.0:1788541293.305207:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68378a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8172f99-f71c-41fa-8527-cb3efe1827fc+10:14911:x1875420955923712:12345-192.168.202.56@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788541293.305353:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68378a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8172f99-f71c-41fa-8527-cb3efe1827fc+10:14911:x1875420955923712:12345-192.168.202.56@tcp:503:mount.lustre.0 Request processed in 146us (2422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541293.305361:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 127 00000100:00100000:3.0:1788541293.308031:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541293.308569:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955923840 00000100:00100000:1.0:1788541293.308579:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955923840 00000100:00100000:1.0:1788541293.308688:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 128 00000100:00100000:1.0:1788541293.308819:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8172f99-f71c-41fa-8527-cb3efe1827fc+10:14936:x1875420955923840:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788541293.309057:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8172f99-f71c-41fa-8527-cb3efe1827fc+10:14936:x1875420955923840:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 359us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541293.309066:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 128 00000100:00100000:0.0:1788541293.323398:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541293.323481:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955923968 00000100:00100000:2.0:1788541293.323490:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955923968 00000100:00100000:2.0:1788541293.323547:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 129 00000100:00100000:2.0:1788541293.323557:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8172f99-f71c-41fa-8527-cb3efe1827fc+10:14936:x1875420955923968:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788541293.323733:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8172f99-f71c-41fa-8527-cb3efe1827fc+10:14936:x1875420955923968:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 177us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541293.323741:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 129 00000100:00100000:0.0:1788541293.339402:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541293.339543:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541293.341078:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955924096 00000100:00100000:3.0:1788541293.341091:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955924096 00000100:00100000:3.0:1788541293.341172:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955924352 00000100:00100000:3.0:1788541293.341176:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955924352 00000100:00100000:3.0:1788541293.341203:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 7 00000100:00100000:3.0:1788541293.341211:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835589180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2393:x1875420955924096:12345-192.168.202.56@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788541293.341275:0:17198:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 16a226c0-f2f2-449b-91c5-316ce9e9c327@192.168.202.56@tcp t0 exp 0000000000000000 cur 574 last 0 00000020:00000080:3.0:1788541293.341330:0:17198:0:(genops.c:1385:class_connect()) connect: client 16a226c0-f2f2-449b-91c5-316ce9e9c327, cookie 0x2aac941e5f4a8cdd 00000004:00100000:3.0:1788541293.341355:0:17198:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1788541293.341618:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 8 00000100:00100000:1.0:1788541293.341625:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835588700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2393:x1875420955924352:12345-192.168.202.56@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788541293.341645:0:17200:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 16a226c0-f2f2-449b-91c5-316ce9e9c327@192.168.202.56@tcp t0 exp 0000000000000000 cur 574 last 0 00000020:00000080:1.0:1788541293.341705:0:17200:0:(genops.c:1385:class_connect()) connect: client 16a226c0-f2f2-449b-91c5-316ce9e9c327, cookie 0x2aac941e5f4a8ce4 00000004:00100000:1.0:1788541293.341720:0:17200:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788541293.341942:0:17200:0:(import.c:65:import_set_state_nolock()) ffff9a6839113800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788541293.342011:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835588700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16a226c0-f2f2-449b-91c5-316ce9e9c327+6:2393:x1875420955924352:12345-192.168.202.56@tcp:38:mount.lustre.0 Request processed in 385us (2468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541293.342019:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 8 00000100:00080000:3.0:1788541293.343397:0:17198:0:(import.c:65:import_set_state_nolock()) ffff9a682fede000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788541293.343473:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835589180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16a226c0-f2f2-449b-91c5-316ce9e9c327+6:2393:x1875420955924096:12345-192.168.202.56@tcp:38:mount.lustre.0 Request processed in 2260us (4081us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541293.343482:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 7 00000100:00100000:0.0:1788541293.360077:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541293.360120:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541293.360175:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541293.360264:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955924608 00000100:00100000:1.0:1788541293.360274:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955924608 00000100:00100000:1.0:1788541293.360345:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955924480 00000100:00100000:1.0:1788541293.360348:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955924480 00000100:00100000:1.0:1788541293.360370:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955924224 00000100:00100000:1.0:1788541293.360372:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955924224 00000100:00100000:1.0:1788541293.360388:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 9 00000100:00100000:1.0:1788541293.360398:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683558b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16a226c0-f2f2-449b-91c5-316ce9e9c327+7:14911:x1875420955924608:12345-192.168.202.56@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788541293.360446:0:17200:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788541293.360539:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683558b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16a226c0-f2f2-449b-91c5-316ce9e9c327+7:14911:x1875420955924608:12345-192.168.202.56@tcp:41:mount.lustre.0 Request processed in 142us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541293.360547:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 9 00000100:00100000:1.0:1788541293.360565:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 10 00000100:00100000:1.0:1788541293.360571:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16a226c0-f2f2-449b-91c5-316ce9e9c327+6:0:x1875420955924480:12345-192.168.202.56@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788541293.360586:0:17200:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788541293.360673:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16a226c0-f2f2-449b-91c5-316ce9e9c327+6:0:x1875420955924480:12345-192.168.202.56@tcp:41:mount.lustre.0 Request processed in 101us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541293.360691:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 10 00000100:00100000:1.0:1788541293.360710:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 11 00000100:00100000:1.0:1788541293.360717:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16a226c0-f2f2-449b-91c5-316ce9e9c327+6:0:x1875420955924224:12345-192.168.202.56@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788541293.360728:0:17200:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788541293.360749:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16a226c0-f2f2-449b-91c5-316ce9e9c327+6:0:x1875420955924224:12345-192.168.202.56@tcp:41:mount.lustre.0 Request processed in 32us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541293.360755:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 11 00000100:00080000:0.0:1788541293.362126:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788541293.362139:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788541293.365196:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541293.365297:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955924736 00000100:00100000:2.0:1788541293.365307:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955924736 00000100:00100000:2.0:1788541293.365371:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 12 00000100:00100000:2.0:1788541293.365381:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16a226c0-f2f2-449b-91c5-316ce9e9c327+6:14911:x1875420955924736:12345-192.168.202.56@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788541293.365469:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16a226c0-f2f2-449b-91c5-316ce9e9c327+6:14911:x1875420955924736:12345-192.168.202.56@tcp:40:mount.lustre.0 Request processed in 89us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541293.365476:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 12 00000100:00100000:0.0:1788541293.371067:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541293.371358:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955925120 00000100:00100000:3.0:1788541293.371368:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955925120 00000100:00100000:3.0:1788541293.371430:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 3 00000100:00100000:3.0:1788541293.371440:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683558a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:16a226c0-f2f2-449b-91c5-316ce9e9c327+6:14911:x1875420955925120:12345-192.168.202.56@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788541293.371684:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683558a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:16a226c0-f2f2-449b-91c5-316ce9e9c327+6:14911:x1875420955925120:12345-192.168.202.56@tcp:900:mount.lustre.0 Request processed in 244us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541293.371694:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 3 00000100:00100000:0.0:1788541293.375259:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541293.375303:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541293.375400:0:19664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955924864 00000100:00100000:2.0:1788541293.375410:0:19664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955924864 00000100:00100000:2.0:1788541293.375452:0:19664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955924992 00000100:00100000:2.0:1788541293.375456:0:19664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955924992 00000100:00100000:2.0:1788541293.375476:0:19664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 16 00000100:00100000:2.0:1788541293.375484:0:19664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835588380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2393:x1875420955924864:12345-192.168.202.56@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788541293.375527:0:19664:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 16a226c0-f2f2-449b-91c5-316ce9e9c327@192.168.202.56@tcp t0 exp 0000000000000000 cur 574 last 0 00000020:00000080:2.0:1788541293.375610:0:19664:0:(genops.c:1385:class_connect()) connect: client 16a226c0-f2f2-449b-91c5-316ce9e9c327, cookie 0x2aac941e5f4a8ceb 00002000:00100000:2.0:1788541293.375624:0:19664:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 16a226c0-f2f2-449b-91c5-316ce9e9c327/ffff9a670667f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788541293.375636:0:19664:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1788541293.376187:0:19250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 17 00000100:00100000:3.0:1788541293.376195:0:19250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835588e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2393:x1875420955924992:12345-192.168.202.56@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788541293.376218:0:19250:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 16a226c0-f2f2-449b-91c5-316ce9e9c327@192.168.202.56@tcp t0 exp 0000000000000000 cur 574 last 0 00000020:00000080:3.0:1788541293.376243:0:19250:0:(genops.c:1385:class_connect()) connect: client 16a226c0-f2f2-449b-91c5-316ce9e9c327, cookie 0x2aac941e5f4a8cf2 00002000:00100000:3.0:1788541293.376249:0:19250:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 16a226c0-f2f2-449b-91c5-316ce9e9c327/ffff9a682fed8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788541293.376267:0:19250:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788541293.376424:0:19250:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788541293.376455:0:19250:0:(import.c:65:import_set_state_nolock()) ffff9a682fedc000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788541293.376534:0:19250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835588e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:16a226c0-f2f2-449b-91c5-316ce9e9c327+6:2393:x1875420955924992:12345-192.168.202.56@tcp:8:mount.lustre.0 Request processed in 337us (1229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541293.376542:0:19250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 17 00002000:00080000:2.0:1788541293.377142:0:19664:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788541293.377165:0:19664:0:(import.c:65:import_set_state_nolock()) ffff9a670667a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788541293.377198:0:19664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835588380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16a226c0-f2f2-449b-91c5-316ce9e9c327+6:2393:x1875420955924864:12345-192.168.202.56@tcp:8:mount.lustre.0 Request processed in 1713us (1951us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541293.377206:0:19664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 16 00000100:00100000:1.0:1788541293.385547:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541293.385737:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955925248 00000100:00100000:2.0:1788541293.385748:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955925248 00000100:00100000:2.0:1788541293.385813:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 0 00010000:00010000:0.0:1788541293.386109:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541293.386462:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:16a226c0-f2f2-449b-91c5-316ce9e9c327+6:14911:x1875420955925248:12345-192.168.202.56@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788541293.388072:0:17201:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1506us 00000004:00200000:2.0:1788541293.434702:0:17201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788541293.435029:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:16a226c0-f2f2-449b-91c5-316ce9e9c327+6:14911:x1875420955925248:12345-192.168.202.56@tcp:33:mount.lustre.0 Request processed in 48567us (49487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541293.435046:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 0 00000100:00100000:0.0:1788541293.661653:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541293.662300:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955925376 00000100:00100000:2.0:1788541293.662311:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955925376 00000100:00100000:2.0:1788541293.662409:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 13 00000100:00100000:2.0:1788541293.662427:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+6:14959:x1875420955925376:12345-192.168.202.56@tcp:101:mkdir.0 00010000:00010000:2.0:1788541293.662447:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541293.662472:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a8cf9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331627 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541293.662536:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a8d00 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541293.662550:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a8d00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541293.662565:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a8d00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541293.662612:0:17199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788541293.662617:0:17199:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788541293.662650:0:17199:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a8d00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541293.662689:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b000/0x2aac941e5f4a8cf9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331627 expref: 8 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541293.662733:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a8d00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331627 expref: 7 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541293.662742:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68350c0700) 00010000:00010000:2.0:1788541293.662744:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788541293.662748:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a683551b400, rc 0) 00000100:00100000:2.0:1788541293.662973:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+7:14959:x1875420955925376:12345-192.168.202.56@tcp:101:mkdir.0 Request processed in 554us (1328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541293.662981:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 13 00010000:00010000:0.0:1788541294.413230:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541295.434192:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541295.495114:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541295.495345:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955925504 00000100:00100000:2.0:1788541295.495355:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955925504 00000100:00100000:2.0:1788541295.495439:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 14 00000100:00100000:2.0:1788541295.495461:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68052e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16a226c0-f2f2-449b-91c5-316ce9e9c327+7:15011:x1875420955925504:12345-192.168.202.56@tcp:41:lfs.0 00000100:00080000:0.0:1788541295.495597:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:2.0:1788541295.495716:0:17200:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788541295.495804:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68052e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16a226c0-f2f2-449b-91c5-316ce9e9c327+7:15011:x1875420955925504:12345-192.168.202.56@tcp:41:lfs.0 Request processed in 356us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541295.495811:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 14 00000100:00100000:1.0:1788541295.498254:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541295.498425:0:19663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955925632 00000100:00100000:0.0:1788541295.498434:0:19663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955925632 00000100:00100000:0.0:1788541295.498561:0:19663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 15 00000100:00100000:0.0:1788541295.498572:0:19663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16a226c0-f2f2-449b-91c5-316ce9e9c327+6:15011:x1875420955925632:12345-192.168.202.56@tcp:41:lfs.0 00000004:00000024:0.0:1788541295.498607:0:19663:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788541295.498924:0:19663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16a226c0-f2f2-449b-91c5-316ce9e9c327+6:15011:x1875420955925632:12345-192.168.202.56@tcp:41:lfs.0 Request processed in 353us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541295.498933:0:19663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 15 00000100:00080000:2.0:1788541295.499745:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788541295.505229:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541295.505401:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955925760 00000100:00100000:2.0:1788541295.505412:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955925760 00000100:00100000:2.0:1788541295.505501:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 9 00000100:00100000:2.0:1788541295.505512:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683558aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:16a226c0-f2f2-449b-91c5-316ce9e9c327+6:15011:x1875420955925760:12345-192.168.202.56@tcp:13:lfs.0 00002000:00000024:2.0:1788541295.505566:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788541295.505652:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683558aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:16a226c0-f2f2-449b-91c5-316ce9e9c327+6:15011:x1875420955925760:12345-192.168.202.56@tcp:13:lfs.0 Request processed in 142us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541295.505671:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 9 00000100:00080000:0.0:1788541295.506002:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788541295.509656:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541295.509779:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955925888 00000100:00100000:2.0:1788541295.509788:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955925888 00000100:00100000:2.0:1788541295.509847:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 10 00000100:00100000:2.0:1788541295.509865:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:16a226c0-f2f2-449b-91c5-316ce9e9c327+6:15011:x1875420955925888:12345-192.168.202.56@tcp:13:lfs.0 00002000:00000024:2.0:1788541295.509922:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788541295.510066:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:16a226c0-f2f2-449b-91c5-316ce9e9c327+6:15011:x1875420955925888:12345-192.168.202.56@tcp:13:lfs.0 Request processed in 203us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541295.510073:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 10 00000100:00080000:0.0:1788541295.510781:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788541295.562423:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788541295.562461:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68052e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981175552:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788541295.562531:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541295.562678:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981175552 00000100:00100000:3.0:1788541295.562689:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981175552 00000100:00100000:3.0:1788541295.562756:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788541295.562766:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981175552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788541295.562789:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788541295.562836:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981175552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541295.562843:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788541295.563119:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788541295.563154:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68052e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981175552:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788541295.704625:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541295.713460:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955926016 00000100:00100000:2.0:1788541295.713485:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955926016 00000100:00100000:2.0:1788541295.713578:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 130 00000100:00100000:2.0:1788541295.713589:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8172f99-f71c-41fa-8527-cb3efe1827fc+10:15042:x1875420955926016:12345-192.168.202.56@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788541295.713607:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541295.713626:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a683551b000/0x2aac941e5f4a8d07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16473202a33162e expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541295.713658:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a683551b000/0x2aac941e5f4a8d07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33162e expref: 11 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541295.713670:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a683551b000/0x2aac941e5f4a8d07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33162e expref: 11 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541295.713681:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a683551b000, rc 0) 00000100:00100000:2.0:1788541295.713753:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8172f99-f71c-41fa-8527-cb3efe1827fc+11:15042:x1875420955926016:12345-192.168.202.56@tcp:101:mount.lustre.0 Request processed in 166us (9138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541295.713780:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 130 00000100:00100000:1.0:1788541295.720057:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541295.720145:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955926144 00000100:00100000:3.0:1788541295.720155:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955926144 00000100:00100000:3.0:1788541295.720214:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 131 00000100:00100000:3.0:1788541295.720223:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707a9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8172f99-f71c-41fa-8527-cb3efe1827fc+11:15042:x1875420955926144:12345-192.168.202.56@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788541295.720390:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707a9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8172f99-f71c-41fa-8527-cb3efe1827fc+11:15042:x1875420955926144:12345-192.168.202.56@tcp:501:mount.lustre.0 Request processed in 167us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541295.720419:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 131 00000100:00100000:3.0:1788541295.730779:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541295.730986:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955926272 00000100:00100000:1.0:1788541295.730997:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955926272 00000100:00100000:1.0:1788541295.731053:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 132 00000100:00100000:1.0:1788541295.731063:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708146c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8172f99-f71c-41fa-8527-cb3efe1827fc+11:15042:x1875420955926272:12345-192.168.202.56@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788541295.731273:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708146c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8172f99-f71c-41fa-8527-cb3efe1827fc+11:15042:x1875420955926272:12345-192.168.202.56@tcp:503:mount.lustre.0 Request processed in 211us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541295.731282:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 132 00000100:00100000:1.0:1788541295.758702:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541295.758801:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955926400 00000100:00100000:2.0:1788541295.758812:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955926400 00000100:00100000:2.0:1788541295.758921:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 133 00000100:00100000:2.0:1788541295.758932:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708144c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8172f99-f71c-41fa-8527-cb3efe1827fc+11:15051:x1875420955926400:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788541295.759077:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708144c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8172f99-f71c-41fa-8527-cb3efe1827fc+11:15051:x1875420955926400:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 147us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541295.759086:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 133 00000100:00100000:0.0:1788541295.782365:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541295.782455:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955926528 00000100:00100000:3.0:1788541295.782466:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955926528 00000100:00100000:3.0:1788541295.782543:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 134 00000100:00100000:3.0:1788541295.782555:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708145450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8172f99-f71c-41fa-8527-cb3efe1827fc+11:15051:x1875420955926528:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788541295.782709:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708145450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8172f99-f71c-41fa-8527-cb3efe1827fc+11:15051:x1875420955926528:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 155us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541295.782717:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 134 00000100:00100000:3.0:1788541295.784651:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541295.786700:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955926656 00000100:00100000:1.0:1788541295.786713:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955926656 00000100:00100000:1.0:1788541295.786768:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 135 00000100:00100000:1.0:1788541295.786776:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708147450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8172f99-f71c-41fa-8527-cb3efe1827fc+11:15051:x1875420955926656:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788541295.787025:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708147450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8172f99-f71c-41fa-8527-cb3efe1827fc+11:15051:x1875420955926656:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 248us (2384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541295.787034:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 135 00000100:00100000:1.0:1788541295.793941:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541295.794033:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955926784 00000100:00100000:2.0:1788541295.794044:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955926784 00000100:00100000:2.0:1788541295.794103:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 136 00000100:00100000:2.0:1788541295.794113:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708147c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8172f99-f71c-41fa-8527-cb3efe1827fc+11:15042:x1875420955926784:12345-192.168.202.56@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788541295.794139:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541295.794161:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a683551be00/0x2aac941e5f4a8d0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16473202a33165f expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541295.794196:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a683551be00/0x2aac941e5f4a8d0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33165f expref: 12 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541295.794208:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a683551be00/0x2aac941e5f4a8d0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33165f expref: 12 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541295.794218:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a683551be00, rc 0) 00000100:00100000:2.0:1788541295.794278:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708147c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8172f99-f71c-41fa-8527-cb3efe1827fc+12:15042:x1875420955926784:12345-192.168.202.56@tcp:101:mount.lustre.0 Request processed in 167us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541295.794285:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 136 00000100:00100000:0.0:1788541295.798044:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541295.798151:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955926912 00000100:00100000:3.0:1788541295.798161:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955926912 00000100:00100000:3.0:1788541295.798220:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 137 00000100:00100000:3.0:1788541295.798230:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708144450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8172f99-f71c-41fa-8527-cb3efe1827fc+12:15042:x1875420955926912:12345-192.168.202.56@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788541295.798259:0:17192:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788541295.798284:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788541295.798288:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788541295.798291:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788541295.798294:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788541295.798296:0:17192:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1788541295.799976:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708144450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8172f99-f71c-41fa-8527-cb3efe1827fc+12:15042:x1875420955926912:12345-192.168.202.56@tcp:256:mount.lustre.0 Request processed in 1737us (1931us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541295.799989:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 137 00000100:00100000:1.0:1788541295.802173:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541295.802262:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955927040 00000100:00100000:2.0:1788541295.802271:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955927040 00000100:00100000:2.0:1788541295.802327:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 138 00000100:00100000:2.0:1788541295.802338:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708147850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8172f99-f71c-41fa-8527-cb3efe1827fc+12:15042:x1875420955927040:12345-192.168.202.56@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788541295.802357:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541295.802374:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a683551ba00/0x2aac941e5f4a8d15 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16473202a331666 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541295.802411:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a683551ba00/0x2aac941e5f4a8d15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331666 expref: 13 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541295.802423:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a683551ba00/0x2aac941e5f4a8d15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331666 expref: 13 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541295.802432:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a683551ba00, rc 0) 00000100:00100000:2.0:1788541295.802479:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708147850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8172f99-f71c-41fa-8527-cb3efe1827fc+13:15042:x1875420955927040:12345-192.168.202.56@tcp:101:mount.lustre.0 Request processed in 143us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541295.802486:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 138 00000100:00100000:1.0:1788541295.804973:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541295.805049:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955927168 00000100:00100000:2.0:1788541295.805058:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955927168 00000100:00100000:2.0:1788541295.805124:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 139 00000100:00100000:2.0:1788541295.805132:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708144850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8172f99-f71c-41fa-8527-cb3efe1827fc+13:15042:x1875420955927168:12345-192.168.202.56@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788541295.805252:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708144850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8172f99-f71c-41fa-8527-cb3efe1827fc+13:15042:x1875420955927168:12345-192.168.202.56@tcp:501:mount.lustre.0 Request processed in 120us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541295.805260:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 139 00000100:00100000:3.0:1788541295.808099:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541295.808157:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955927296 00000100:00100000:0.0:1788541295.808174:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955927296 00000100:00100000:0.0:1788541295.808214:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 140 00000100:00100000:0.0:1788541295.808223:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8172f99-f71c-41fa-8527-cb3efe1827fc+13:15042:x1875420955927296:12345-192.168.202.56@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788541295.808348:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708144050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8172f99-f71c-41fa-8527-cb3efe1827fc+13:15042:x1875420955927296:12345-192.168.202.56@tcp:503:mount.lustre.0 Request processed in 125us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541295.808355:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 140 00000100:00100000:3.0:1788541295.810581:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541295.810663:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955927424 00000100:00100000:2.0:1788541295.810670:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955927424 00000100:00100000:2.0:1788541295.810761:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 141 00000100:00100000:2.0:1788541295.810770:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708146850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8172f99-f71c-41fa-8527-cb3efe1827fc+13:15056:x1875420955927424:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788541295.810974:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708146850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8172f99-f71c-41fa-8527-cb3efe1827fc+13:15056:x1875420955927424:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 199us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541295.810982:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 141 00000100:00100000:1.0:1788541295.821467:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541295.821562:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955927552 00000100:00100000:0.0:1788541295.821571:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955927552 00000100:00100000:0.0:1788541295.821623:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 142 00000100:00100000:0.0:1788541295.821633:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708146050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8172f99-f71c-41fa-8527-cb3efe1827fc+13:15056:x1875420955927552:12345-192.168.202.56@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788541295.821797:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708146050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8172f99-f71c-41fa-8527-cb3efe1827fc+13:15056:x1875420955927552:12345-192.168.202.56@tcp:502:llog_process_th.0 Request processed in 164us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541295.821806:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 142 00000100:00100000:3.0:1788541295.824912:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541295.825005:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541295.825978:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955927680 00000100:00100000:0.0:1788541295.825991:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955927680 00000100:00100000:0.0:1788541295.826046:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955927936 00000100:00100000:0.0:1788541295.826050:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955927936 00000100:00100000:0.0:1788541295.826085:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 16 00000100:00100000:0.0:1788541295.826095:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68052e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2393:x1875420955927680:12345-192.168.202.56@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788541295.826131:0:17198:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 74d244c9-cb0c-4783-8214-d6a87bde15a9@192.168.202.56@tcp t0 exp 0000000000000000 cur 576 last 0 00000020:00000080:0.0:1788541295.826183:0:17198:0:(genops.c:1385:class_connect()) connect: client 74d244c9-cb0c-4783-8214-d6a87bde15a9, cookie 0x2aac941e5f4a8d1c 00000004:00100000:0.0:1788541295.826218:0:17198:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788541295.826348:0:17198:0:(import.c:65:import_set_state_nolock()) ffff9a681e530000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788541295.826429:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68052e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74d244c9-cb0c-4783-8214-d6a87bde15a9+6:2393:x1875420955927680:12345-192.168.202.56@tcp:38:mount.lustre.0 Request processed in 335us (1556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541295.826436:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 16 00000100:00100000:0.0:1788541295.826467:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 17 00000100:00100000:0.0:1788541295.826473:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68052e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2393:x1875420955927936:12345-192.168.202.56@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788541295.826489:0:17198:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 74d244c9-cb0c-4783-8214-d6a87bde15a9@192.168.202.56@tcp t0 exp 0000000000000000 cur 576 last 0 00000020:00000080:0.0:1788541295.826508:0:17198:0:(genops.c:1385:class_connect()) connect: client 74d244c9-cb0c-4783-8214-d6a87bde15a9, cookie 0x2aac941e5f4a8d23 00000004:00100000:0.0:1788541295.826519:0:17198:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788541295.826563:0:17198:0:(import.c:65:import_set_state_nolock()) ffff9a681e537000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788541295.826587:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68052e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74d244c9-cb0c-4783-8214-d6a87bde15a9+6:2393:x1875420955927936:12345-192.168.202.56@tcp:38:mount.lustre.0 Request processed in 113us (1582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541295.826594:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 17 00000100:00100000:3.0:1788541295.834775:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541295.834839:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541295.835025:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955928064 00000100:00100000:2.0:1788541295.835035:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955928064 00000100:00100000:2.0:1788541295.835106:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955927808 00000100:00100000:2.0:1788541295.835110:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955927808 00000100:00100000:2.0:1788541295.835142:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 18 00000100:00100000:2.0:1788541295.835150:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68052e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74d244c9-cb0c-4783-8214-d6a87bde15a9+6:0:x1875420955928064:12345-192.168.202.56@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788541295.835184:0:17200:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788541295.835249:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68052e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74d244c9-cb0c-4783-8214-d6a87bde15a9+6:0:x1875420955928064:12345-192.168.202.56@tcp:41:mount.lustre.0 Request processed in 99us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541295.835256:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 18 00000100:00100000:2.0:1788541295.835273:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 19 00000100:00100000:2.0:1788541295.835279:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68052e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74d244c9-cb0c-4783-8214-d6a87bde15a9+6:0:x1875420955927808:12345-192.168.202.56@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788541295.835291:0:17200:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788541295.835319:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68052e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74d244c9-cb0c-4783-8214-d6a87bde15a9+6:0:x1875420955927808:12345-192.168.202.56@tcp:41:mount.lustre.0 Request processed in 39us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541295.835324:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 19 00000100:00080000:1.0:1788541295.835420:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788541295.835430:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788541295.838408:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541295.838499:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955928192 00000100:00100000:2.0:1788541295.838509:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955928192 00000100:00100000:2.0:1788541295.838566:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 20 00000100:00100000:2.0:1788541295.838584:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74d244c9-cb0c-4783-8214-d6a87bde15a9+6:15042:x1875420955928192:12345-192.168.202.56@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788541295.838633:0:17200:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788541295.838933:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74d244c9-cb0c-4783-8214-d6a87bde15a9+6:15042:x1875420955928192:12345-192.168.202.56@tcp:41:mount.lustre.0 Request processed in 350us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541295.838941:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 20 00000100:00100000:3.0:1788541295.841446:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541295.843036:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955928320 00000100:00100000:0.0:1788541295.843049:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955928320 00000100:00100000:0.0:1788541295.843116:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 21 00000100:00100000:0.0:1788541295.843127:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68052e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74d244c9-cb0c-4783-8214-d6a87bde15a9+6:15042:x1875420955928320:12345-192.168.202.56@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788541295.843218:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68052e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74d244c9-cb0c-4783-8214-d6a87bde15a9+6:15042:x1875420955928320:12345-192.168.202.56@tcp:40:mount.lustre.0 Request processed in 92us (1780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541295.843226:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 21 00000100:00100000:3.0:1788541295.848660:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541295.848752:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541295.848790:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541295.848920:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955928704 00000100:00100000:1.0:1788541295.848930:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955928704 00000100:00100000:1.0:1788541295.848975:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 4 00000100:00100000:1.0:1788541295.848984:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68052e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:74d244c9-cb0c-4783-8214-d6a87bde15a9+6:15042:x1875420955928704:12345-192.168.202.56@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788541295.849056:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68052e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:74d244c9-cb0c-4783-8214-d6a87bde15a9+6:15042:x1875420955928704:12345-192.168.202.56@tcp:900:mount.lustre.0 Request processed in 72us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541295.849064:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 4 00000100:00100000:2.0:1788541295.849133:0:19250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955928448 00000100:00100000:2.0:1788541295.849139:0:19250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955928448 00000100:00100000:2.0:1788541295.849167:0:19250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955928576 00000100:00100000:2.0:1788541295.849171:0:19250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955928576 00000100:00100000:2.0:1788541295.849190:0:19250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 18 00000100:00100000:2.0:1788541295.849195:0:19250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68052e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2393:x1875420955928448:12345-192.168.202.56@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788541295.849221:0:19250:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 74d244c9-cb0c-4783-8214-d6a87bde15a9@192.168.202.56@tcp t0 exp 0000000000000000 cur 576 last 0 00000020:00000080:2.0:1788541295.849251:0:19250:0:(genops.c:1385:class_connect()) connect: client 74d244c9-cb0c-4783-8214-d6a87bde15a9, cookie 0x2aac941e5f4a8d2a 00002000:00100000:2.0:1788541295.849263:0:19250:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 74d244c9-cb0c-4783-8214-d6a87bde15a9/ffff9a670190d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788541295.849274:0:19250:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788541295.849363:0:19250:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788541295.849387:0:19250:0:(import.c:65:import_set_state_nolock()) ffff9a6701908800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788541295.849421:0:19250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68052e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74d244c9-cb0c-4783-8214-d6a87bde15a9+6:2393:x1875420955928448:12345-192.168.202.56@tcp:8:mount.lustre.0 Request processed in 224us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541295.849428:0:19250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 18 00000100:00100000:2.0:1788541295.849443:0:19250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 19 00000100:00100000:2.0:1788541295.849448:0:19250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68052e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2393:x1875420955928576:12345-192.168.202.56@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788541295.849919:0:19250:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 74d244c9-cb0c-4783-8214-d6a87bde15a9@192.168.202.56@tcp t0 exp 0000000000000000 cur 576 last 0 00000020:00000080:2.0:1788541295.849935:0:19250:0:(genops.c:1385:class_connect()) connect: client 74d244c9-cb0c-4783-8214-d6a87bde15a9, cookie 0x2aac941e5f4a8d31 00002000:00100000:2.0:1788541295.849940:0:19250:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 74d244c9-cb0c-4783-8214-d6a87bde15a9/ffff9a6701909000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788541295.849958:0:19250:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788541295.849996:0:19250:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788541295.850010:0:19250:0:(import.c:65:import_set_state_nolock()) ffff9a6701909800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788541295.850032:0:19250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68052e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74d244c9-cb0c-4783-8214-d6a87bde15a9+6:2393:x1875420955928576:12345-192.168.202.56@tcp:8:mount.lustre.0 Request processed in 582us (1279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541295.850038:0:19250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 19 00000100:00100000:1.0:1788541295.852276:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541295.852467:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955928832 00000100:00100000:2.0:1788541295.852481:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955928832 00000100:00100000:2.0:1788541295.852535:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1 00000100:00100000:2.0:1788541295.852544:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74d244c9-cb0c-4783-8214-d6a87bde15a9+6:15042:x1875420955928832:12345-192.168.202.56@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788541295.852627:0:17202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788541295.852797:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74d244c9-cb0c-4783-8214-d6a87bde15a9+6:15042:x1875420955928832:12345-192.168.202.56@tcp:33:mount.lustre.0 Request processed in 253us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541295.852805:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1 00000100:00100000:3.0:1788541295.983954:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541295.984098:0:19663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955928960 00000100:00100000:1.0:1788541295.984108:0:19663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955928960 00000100:00100000:1.0:1788541295.984168:0:19663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 22 00000100:00100000:1.0:1788541295.984178:0:19663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67080d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74d244c9-cb0c-4783-8214-d6a87bde15a9+6:15079:x1875420955928960:12345-192.168.202.56@tcp:101:mkdir.0 00010000:00010000:1.0:1788541295.984200:0:19663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541295.984222:0:19663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8d38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331697 expref: -99 pid: 19663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541295.984293:0:19663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a8d3f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541295.984315:0:19663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a8d3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541295.984330:0:19663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a8d3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788541295.984374:0:19663:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788541295.984377:0:19663:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788541295.984421:0:19663:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a8d3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541295.984447:0:19663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8d38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331697 expref: 8 pid: 19663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541295.984463:0:19663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a8d3f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331697 expref: 7 pid: 19663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541295.984472:0:19663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68350c0700) 00010000:00010000:1.0:1788541295.984475:0:19663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788541295.984478:0:19663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6706957e00, rc 0) 00000100:00100000:1.0:1788541295.984542:0:19663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67080d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74d244c9-cb0c-4783-8214-d6a87bde15a9+7:15079:x1875420955928960:12345-192.168.202.56@tcp:101:mkdir.0 Request processed in 365us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541295.984549:0:19663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 22 00000100:00100000:3.0:1788541296.074271:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67082faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981175680:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788541296.074357:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541296.074699:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981175680 00000100:00100000:1.0:1788541296.074707:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981175680 00000100:00100000:1.0:1788541296.074754:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788541296.074763:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981175680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788541296.074787:0:17203:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788541296.074844:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981175680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541296.074860:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788541296.075014:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67082faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981175680:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788541296.075330:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6835589880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981175808:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788541296.075365:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541296.075433:0:18270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981175808 00000100:00100000:3.0:1788541296.075437:0:18270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981175808 00000100:00100000:3.0:1788541296.075473:0:18270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788541296.075481:0:18270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981175808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788541296.075496:0:18270:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788541296.081546:0:18270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981175808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 6056us (6169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541296.081560:0:18270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788541296.081684:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6835589880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981175808:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788541296.459004:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788541297.163964:0:17950:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788541297.482102:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541297.610533:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683558ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981176064:0@lo:400:kworker.0 00000100:00100000:3.0:1788541297.610608:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541297.610677:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6835588000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981176576:0@lo:400:kworker.0 00000100:00100000:3.0:1788541297.610701:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541297.610716:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875420981177088:0@lo:400:kworker.0 00000100:00100000:3.0:1788541297.610739:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541297.610762:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1788541297.610768:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683558a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4746c063-6c88-4476-b99b-02bb8e8d54f7:3644:1875420981175936:0@lo:400:kworker.0 00000100:00100000:3.0:1788541297.610796:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541297.610942:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981177088 00000100:00100000:0.0:1788541297.610950:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981177088 00000100:00100000:0.0:1788541297.610998:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788541297.611008:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875420981177088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541297.611053:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875420981177088:12345-0@lo:400:kworker.0 Request processed in 47us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541297.611060:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788541297.611108:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981176064 00000100:00100000:0.0:1788541297.611112:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981176064 00000100:00100000:0.0:1788541297.611133:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981176576 00000100:00100000:0.0:1788541297.611136:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981176576 00000100:00100000:0.0:1788541297.611148:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788541297.611154:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981176064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541297.611187:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981176064:12345-0@lo:400:kworker.0 Request processed in 34us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541297.611193:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788541297.611203:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788541297.611209:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981176576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541297.611233:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981176576:12345-0@lo:400:kworker.0 Request processed in 25us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541297.611238:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788541297.611503:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683558b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875420981176448:0@lo:400:kworker.0 00000100:00100000:3.0:1788541297.611529:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541297.611564:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875420981176960:0@lo:400:kworker.0 00000100:00100000:3.0:1788541297.611586:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541297.611602:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875420981177472:0@lo:400:kworker.0 00000100:00100000:3.0:1788541297.611622:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541297.611653:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683558ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981176064:0@lo:400:kworker.0 00000100:00100000:3.0:1788541297.611675:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6835588000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981176576:0@lo:400:kworker.0 00000100:00100000:3.0:1788541297.611686:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3644:1875420981177088:0@lo:400:kworker.0 00000100:00100000:3.0:1788541297.611708:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707818a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981177600:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788541297.611730:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541297.611760:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981177600 00000100:00100000:3.0:1788541297.611764:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981177600 00000100:00100000:3.0:1788541297.611792:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788541297.611799:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981177600:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788541297.611930:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683558b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981176192:0@lo:400:kworker.0 00000100:00100000:2.0:1788541297.611941:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683558bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981176320:0@lo:400:kworker.0 00000100:00100000:1.0:1788541297.611968:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541297.611989:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981175936 00000100:00100000:2.0:1788541297.611994:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981175936 00000100:00100000:1.0:1788541297.612002:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6835589880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981176704:0@lo:400:kworker.0 00000100:00100000:2.0:1788541297.612025:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788541297.612031:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541297.612038:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708145050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+24:3644:x1875420981175936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541297.612065:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875420981177216:0@lo:400:kworker.0 00000100:00100000:2.0:1788541297.612088:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708145050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+24:3644:x1875420981175936:12345-0@lo:400:kworker.0 Request processed in 52us (1290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541297.612096:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541297.612107:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788541297.612118:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707819500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981177728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788541297.612143:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541297.612146:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981176448 00000100:00100000:2.0:1788541297.612151:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981176448 00000100:00100000:2.0:1788541297.612171:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981176960 00000100:00080000:1.0:1788541297.612175:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788541297.612181:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788541297.612182:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981176960 00000100:00100000:1.0:1788541297.612196:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981176192 00000100:00100000:2.0:1788541297.612200:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981177472 00000100:00100000:1.0:1788541297.612201:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981176192 00000100:00100000:2.0:1788541297.612205:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981177472 00000100:00100000:2.0:1788541297.612230:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981177216 00000100:00100000:2.0:1788541297.612233:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981177216 00000100:00100000:1.0:1788541297.612249:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981176704 00000100:00100000:2.0:1788541297.612256:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788541297.612262:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875420981176448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541297.612269:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981176704 00000100:00100000:2.0:1788541297.612298:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875420981176448:12345-0@lo:400:kworker.0 Request processed in 36us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541297.612305:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788541297.612318:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788541297.612323:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788541297.612328:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981176192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541297.612334:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875420981176960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541297.612372:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981176192:12345-0@lo:400:kworker.0 Request processed in 46us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541297.612379:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875420981176960:12345-0@lo:400:kworker.0 Request processed in 46us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541297.612385:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788541297.612395:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788541297.612401:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875420981177472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541297.612439:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875420981177472:12345-0@lo:400:kworker.0 Request processed in 39us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541297.612446:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788541297.612458:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788541297.612463:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875420981177216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541297.612497:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875420981177216:12345-0@lo:400:kworker.0 Request processed in 33us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541297.612502:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00002000:00000024:3.0:1788541297.612526:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788541297.612570:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981177600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 770us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541297.612575:0:19250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788541297.612583:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788541297.612588:0:19250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981176704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541297.612598:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981177728 00000100:00100000:3.0:1788541297.612602:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981177728 00000100:00100000:2.0:1788541297.612623:0:19250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981176704:12345-0@lo:400:kworker.0 Request processed in 38us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541297.612624:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788541297.612635:0:19250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788541297.612637:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981177728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788541297.612650:0:18720:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788541297.612677:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981177728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541297.612684:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788541297.612706:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707818a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981177600:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788541297.612721:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683558a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4746c063-6c88-4476-b99b-02bb8e8d54f7:3644:1875420981175936:0@lo:400:kworker.0 00000100:00100000:3.0:1788541297.612729:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541297.612736:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683558b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875420981176448:0@lo:400:kworker.0 00000100:00100000:2.0:1788541297.612752:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875420981176960:0@lo:400:kworker.0 00000100:00100000:3.0:1788541297.612757:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981176832:0@lo:400:kworker.0 00010000:00080000:2.0:1788541297.612769:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707819f80 x1875420981177472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541297.612782:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3644:1875420981177472:0@lo:400:kworker.0 00000100:00100000:3.0:1788541297.612786:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541297.612811:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670781b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875420981177344:0@lo:400:kworker.0 00000100:00100000:2.0:1788541297.612829:0:19250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981176320 00000100:00100000:2.0:1788541297.612846:0:19250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981176320 00000100:00100000:2.0:1788541297.612866:0:19250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981176832 00000100:00100000:2.0:1788541297.612888:0:19250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981176832 00000100:00100000:2.0:1788541297.612906:0:19250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788541297.612912:0:19250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981176320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541297.612922:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788541297.612941:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788541297.612947:0:19250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981176320:12345-0@lo:400:kworker.0 Request processed in 34us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541297.612951:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981176832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541297.612958:0:19250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788541297.612989:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981176832:12345-0@lo:400:kworker.0 Request processed in 41us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541297.612996:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1788541297.613001:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788541297.613006:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788541297.613009:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788541297.613034:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683558b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981176192:0@lo:400:kworker.0 00000100:00100000:1.0:1788541297.613044:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6835589880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981176704:0@lo:400:kworker.0 00010000:00080000:1.0:1788541297.613055:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670831c700 x1875420981177216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788541297.613064:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875420981177216:0@lo:400:kworker.0 00000100:00100000:1.0:1788541297.613083:0:3641:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1788541297.613099:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707819500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981177728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788541297.613113:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788541297.613120:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981177856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788541297.613140:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541297.613525:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541297.613563:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683558bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981176320:0@lo:400:kworker.0 00000100:00100000:3.0:1788541297.613574:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981176832:0@lo:400:kworker.0 00000100:00100000:2.0:1788541297.613590:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981177856 00000100:00100000:2.0:1788541297.613596:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981177856 00000100:00100000:2.0:1788541297.613635:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788541297.613643:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981177856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788541297.613663:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788541297.613663:0:19663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981177344 00000100:00100000:0.0:1788541297.613669:0:19663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981177344 00000100:00100000:2.0:1788541297.613704:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981177856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541297.613711:0:19663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788541297.613718:0:19663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875420981177344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541297.613724:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788541297.613759:0:19663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1875420981177344:12345-0@lo:400:kworker.0 Request processed in 41us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541297.613767:0:19663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1788541297.613772:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788541297.613929:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670781b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3642:1875420981177344:0@lo:400:kworker.0 00000100:00100000:1.0:1788541297.614051:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981177856:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788541298.507109:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788541298.557078:0:20088:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:2.0:1788541299.150037:0:18713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 74d244c9-cb0c-4783-8214-d6a87bde15a9 00000001:00100000:2.0:1788541299.150051:0:18713:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 16a226c0-f2f2-449b-91c5-316ce9e9c327 00000001:00100000:1.0:1788541299.150239:0:17178:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 74d244c9-cb0c-4783-8214-d6a87bde15a9 00000001:00100000:1.0:1788541299.150247:0:17178:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 16a226c0-f2f2-449b-91c5-316ce9e9c327 00000001:00100000:3.0:1788541299.151035:0:17930:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 74d244c9-cb0c-4783-8214-d6a87bde15a9 00000001:00100000:3.0:1788541299.151042:0:17930:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 16a226c0-f2f2-449b-91c5-316ce9e9c327 00000001:00100000:0.0:1788541299.158700:0:19530:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 74d244c9-cb0c-4783-8214-d6a87bde15a9 00000001:00100000:0.0:1788541299.158713:0:19530:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 16a226c0-f2f2-449b-91c5-316ce9e9c327 00010000:00010000:1.0:1788541299.531146:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541300.554183:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541300.682180:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788541300.682216:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981177984:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788541300.682281:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541300.683527:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981177984 00000100:00100000:1.0:1788541300.683539:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981177984 00000100:00100000:1.0:1788541300.683615:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788541300.683625:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981177984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788541300.685170:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788541300.685334:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981177984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1708us (3050us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541300.685342:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788541300.685714:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788541300.685763:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981177984:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788541301.026562:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541301.026921:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955929216 00000100:00100000:2.0:1788541301.026931:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955929216 00000100:00100000:1.0:1788541301.027096:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541301.027126:0:19250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955929472 00000100:00100000:0.0:1788541301.027131:0:19250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955929472 00000100:00100000:1.0:1788541301.027263:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541301.027305:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541301.027336:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541301.027356:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541301.027377:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541301.027421:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541301.027444:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541301.027463:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955929984 00000100:00100000:1.0:1788541301.027467:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955929984 00000100:00100000:2.0:1788541301.027641:0:19663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955929728 00000100:00100000:2.0:1788541301.027645:0:19663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955929728 00000100:00080000:3.0:1788541301.027914:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788541301.027919:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788541301.031199:0:19664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955930112 00000100:00100000:0.0:1788541301.031199:0:19250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955929600 00000100:00100000:3.0:1788541301.031211:0:19664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955930112 00000100:00100000:0.0:1788541301.031211:0:19250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955929600 00000100:00100000:3.0:1788541301.031253:0:19664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 7 00000100:00100000:3.0:1788541301.031268:0:19664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16a226c0-f2f2-449b-91c5-316ce9e9c327+5:2394:x1875420955929472:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541301.031363:0:19664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16a226c0-f2f2-449b-91c5-316ce9e9c327+5:2394:x1875420955929472:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 96us (4268us total) trans 0 rc 0/0 00000100:00080000:2.0:1788541301.033151:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788541301.035112:0:19250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 8 00000100:00100000:0.0:1788541301.035134:0:19250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708311180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74d244c9-cb0c-4783-8214-d6a87bde15a9+5:2394:x1875420955930112:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541301.035143:0:19664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 7 00000100:00100000:3.0:1788541301.035165:0:19664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 9 00000100:00100000:3.0:1788541301.035173:0:19664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708835c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16a226c0-f2f2-449b-91c5-316ce9e9c327+5:2394:x1875420955929600:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541301.035221:0:19664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708835c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16a226c0-f2f2-449b-91c5-316ce9e9c327+5:2394:x1875420955929600:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 48us (7842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541301.035221:0:19250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708311180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74d244c9-cb0c-4783-8214-d6a87bde15a9+5:2394:x1875420955930112:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 97us (7774us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541301.035228:0:19664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 9 00000100:00100000:3.0:1788541301.035271:0:19663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955929344 00000100:00100000:3.0:1788541301.035278:0:19663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955929344 00000100:00100000:3.0:1788541301.035317:0:19663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955929856 00000100:00100000:3.0:1788541301.035321:0:19663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955929856 00000100:00100000:3.0:1788541301.035336:0:19663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 41 00000100:00100000:3.0:1788541301.035342:0:19663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74d244c9-cb0c-4783-8214-d6a87bde15a9+6:2394:x1875420955929728:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541301.035371:0:19663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74d244c9-cb0c-4783-8214-d6a87bde15a9+6:2394:x1875420955929728:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 29us (8109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541301.035379:0:19663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 41 00000100:00100000:3.0:1788541301.035391:0:19663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 42 00000100:00100000:3.0:1788541301.035397:0:19663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16a226c0-f2f2-449b-91c5-316ce9e9c327+5:2394:x1875420955929344:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541301.035421:0:19663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16a226c0-f2f2-449b-91c5-316ce9e9c327+5:2394:x1875420955929344:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 24us (8064us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541301.035427:0:19663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 42 00000100:00100000:3.0:1788541301.035438:0:19663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 43 00000100:00100000:3.0:1788541301.035444:0:19663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708312a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74d244c9-cb0c-4783-8214-d6a87bde15a9+5:2394:x1875420955929856:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541301.035464:0:19663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708312a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74d244c9-cb0c-4783-8214-d6a87bde15a9+5:2394:x1875420955929856:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 20us (8042us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541301.035470:0:19663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 43 00000100:00080000:3.0:1788541301.035484:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788541301.035813:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 10 00000100:00100000:1.0:1788541301.035831:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74d244c9-cb0c-4783-8214-d6a87bde15a9+5:2394:x1875420955929984:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1788541301.035858:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74d244c9-cb0c-4783-8214-d6a87bde15a9+5:2394:x1875420955929984:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 38us (8553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541301.035864:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 10 00000100:00100000:1.0:1788541301.037487:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 44 00000100:00100000:0.0:1788541301.037562:0:19250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 8 00000100:00100000:1.0:1788541301.037746:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16a226c0-f2f2-449b-91c5-316ce9e9c327+6:2394:x1875420955929216:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1788541301.037813:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16a226c0-f2f2-449b-91c5-316ce9e9c327+6:2394:x1875420955929216:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 307us (11252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541301.037821:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 44 00000100:00100000:1.0:1788541301.039413:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955929088 00000100:00100000:1.0:1788541301.039428:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955929088 00000100:00100000:1.0:1788541301.039482:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 144 00000100:00100000:1.0:1788541301.039491:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708145c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8172f99-f71c-41fa-8527-cb3efe1827fc+13:2394:x1875420955929088:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1788541301.039562:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708145c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8172f99-f71c-41fa-8527-cb3efe1827fc+13:2394:x1875420955929088:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 72us (12224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541301.039570:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 144 00000100:00100000:0.0:1788541301.196777:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707818000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981178112:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788541301.196860:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541301.197057:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981178112 00000100:00100000:0.0:1788541301.197076:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981178112 00000100:00100000:0.0:1788541301.197127:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788541301.197137:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707818700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981178112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788541301.197181:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788541301.197228:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707818700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981178112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541301.197235:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788541301.197284:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707818000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981178112:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788541301.198018:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788541301.198030:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981178240:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788541301.198089:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541301.198127:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981178240 00000100:00100000:3.0:1788541301.198132:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981178240 00000100:00100000:3.0:1788541301.198161:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788541301.198167:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981178240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788541301.198184:0:17203:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788541301.198211:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981178240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 45us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541301.198216:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788541301.198246:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981178240:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788541301.578342:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788541302.090539:0:17231:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:1.0:1788541302.214064:0:20235:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff16ce6770 20000000:00000080:1.0:1788541302.214086:0:20235:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a683945dc00 uarg=0000000000000000 20000000:01000000:1.0:1788541302.214141:0:20235:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788541302.214147:0:20235:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788541302.214158:0:20235:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788541302.215615:0:20236:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1788541302.216293:0:20235:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788541302.221070:0:20235:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788541302.221103:0:20235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a68043cca00/0x2aac941e5f4a8d46 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541302.221123:0:20235:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a67075ace00/0x2aac941e5f4a89db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a89d4 expref: 23 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541302.221132:0:20235:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6706956000/0x2aac941e5f4a89e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a89e2 expref: 23 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541302.221139:0:20235:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a67075ad800/0x2aac941e5f4a8a28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a8a21 expref: 23 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541302.221146:0:20235:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a682e75f400/0x2aac941e5f4a8ac2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a8abb expref: 23 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541302.221157:0:20235:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a6706957800/0x2aac941e5f4a8cd6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3315f6 expref: 12 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541302.221177:0:20235:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a683551ba00/0x2aac941e5f4a8d15 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331666 expref: 12 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541302.221186:0:20235:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a68043cca00/0x2aac941e5f4a8d46 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541302.221228:0:20235:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a683551ba00/0x2aac941e5f4a8d15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331666 expref: 12 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541302.221242:0:20235:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a683551ba00/0x2aac941e5f4a8d15 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331666 expref: 12 pid: 17193 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541302.221257:0:20235:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20235:1875420981178368:192.168.202.56@tcp:104: 00010000:00010000:3.0:1788541302.222781:0:20235:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6706957800/0x2aac941e5f4a8cd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3315f6 expref: 12 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541302.222805:0:20235:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6706957800/0x2aac941e5f4a8cd6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3315f6 expref: 12 pid: 17191 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541302.222818:0:20235:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20235:1875420981178496:192.168.202.56@tcp:104: 00010000:00010000:3.0:1788541302.224279:0:20235:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a682e75f400/0x2aac941e5f4a8ac2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a8abb expref: 23 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541302.224295:0:20235:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a682e75f400/0x2aac941e5f4a8ac2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a8abb expref: 23 pid: 17193 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541302.224318:0:20235:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20235:1875420981178624:0@lo:104: 00000100:00100000:3.0:1788541302.224588:0:20235:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541302.224660:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981178624 00000100:00100000:1.0:1788541302.224669:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981178624 00000100:00100000:1.0:1788541302.224729:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788541302.224738:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4746c063-6c88-4476-b99b-02bb8e8d54f7+3:20235:x1875420981178624:12345-0@lo:104: 00010000:00010000:1.0:1788541302.224752:0:17182:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a6706957600/0x2aac941e5f4a8abb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a8ac2 expref: -99 pid: 19529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541302.224861:0:17182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788541302.224886:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4746c063-6c88-4476-b99b-02bb8e8d54f7+3:20235:x1875420981178624:12345-0@lo:104: Request processed in 132us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541302.224894:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1788541302.225012:0:20235:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a67075ad800/0x2aac941e5f4a8a28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a8a21 expref: 23 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541302.225021:0:20235:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a67075ad800/0x2aac941e5f4a8a28 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a8a21 expref: 23 pid: 17191 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541302.225030:0:20235:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20235:1875420981178752:0@lo:104: 00000100:00100000:3.0:1788541302.225055:0:20235:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788541302.225087:0:20235:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a6706956000/0x2aac941e5f4a89e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a89e2 expref: 23 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541302.225095:0:20235:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a6706956000/0x2aac941e5f4a89e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a89e2 expref: 23 pid: 17192 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541302.225104:0:20235:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20235:1875420981178880:0@lo:104: 00000100:00100000:3.0:1788541302.225124:0:20235:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788541302.225195:0:20235:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a67075ace00/0x2aac941e5f4a89db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2aac941e5f4a89d4 expref: 23 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541302.225207:0:20235:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a67075ace00/0x2aac941e5f4a89db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2aac941e5f4a89d4 expref: 23 pid: 17192 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541302.225216:0:20235:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20235:1875420981179008:0@lo:104: 00000100:00100000:3.0:1788541302.225237:0:20235:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788541302.226035:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541302.226045:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a6706957600/0x2aac941e5f4a8abb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a8ac2 expref: -99 pid: 19529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541302.226058:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706957600 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:0.0:1788541302.226062:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a6706957600/0x2aac941e5f4a8abb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a8ac2 expref: -99 pid: 19529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541302.226074:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a6706957600/0x2aac941e5f4a8abb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a8ac2 expref: -99 pid: 19529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788541302.226098:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a6706957600/0x2aac941e5f4a8abb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a8ac2 expref: -99 pid: 19529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788541302.226104:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788541302.226143:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a6706957600/0x2aac941e5f4a8abb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a8ac2 expref: -99 pid: 19529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541302.226149:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788541302.226170:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a6706957600/0x2aac941e5f4a8abb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a8ac2 expref: -99 pid: 19529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541302.226176:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a6706957600/0x2aac941e5f4a8abb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a8ac2 expref: -99 pid: 19529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541302.226191:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541302.226192:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541302.226194:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541302.226217:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707818000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4746c063-6c88-4476-b99b-02bb8e8d54f7:3642:1875420981179136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788541302.226498:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541302.226557:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981179136 00000100:00100000:0.0:1788541302.226566:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981179136 00010000:00010000:0.0:1788541302.226597:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a682e75f400/0x2aac941e5f4a8ac2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a8abb expref: 24 pid: 17193 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541302.226679:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788541302.226688:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670781b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4746c063-6c88-4476-b99b-02bb8e8d54f7+24:3642:x1875420981179136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788541302.226699:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541302.226704:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a682e75f400/0x2aac941e5f4a8ac2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a8abb expref: 24 pid: 17193 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541302.226784:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a682e75f400/0x2aac941e5f4a8ac2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a8abb expref: 24 pid: 17193 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541302.226811:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541302.227335:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670781b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4746c063-6c88-4476-b99b-02bb8e8d54f7+24:3642:x1875420981179136:12345-0@lo:103:ldlm_bl.0 Request processed in 645us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541302.227354:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788541302.228297:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707818000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4746c063-6c88-4476-b99b-02bb8e8d54f7:3642:1875420981179136:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788541302.230846:0:20235:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a680431c780 going to sleep for 11 seconds 00000100:00100000:2.0:1788541302.230996:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981178752 00000100:00100000:2.0:1788541302.231004:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981178752 00000100:00100000:2.0:1788541302.231053:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981178880 00000100:00100000:2.0:1788541302.231056:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981178880 00000100:00100000:2.0:1788541302.231066:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981179008 00000100:00100000:2.0:1788541302.231069:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981179008 00000100:00100000:2.0:1788541302.231088:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788541302.231098:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4746c063-6c88-4476-b99b-02bb8e8d54f7+5:20235:x1875420981178752:12345-0@lo:104: 00010000:00010000:2.0:1788541302.231137:0:17181:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a67075ac200/0x2aac941e5f4a8a21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a8a28 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541302.231191:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00010000:00010000:2.0:1788541302.231200:0:17181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788541302.231207:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4746c063-6c88-4476-b99b-02bb8e8d54f7+5:20235:x1875420981178752:12345-0@lo:104: Request processed in 111us (6151us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541302.231214:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788541302.231231:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788541302.231237:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4746c063-6c88-4476-b99b-02bb8e8d54f7+4:20235:x1875420981178880:12345-0@lo:104: 00010000:00010000:2.0:1788541302.231245:0:17181:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a6706957c00/0x2aac941e5f4a89e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a89e9 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541302.231264:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00010000:00010000:2.0:1788541302.231277:0:17181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788541302.231281:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4746c063-6c88-4476-b99b-02bb8e8d54f7+4:20235:x1875420981178880:12345-0@lo:104: Request processed in 45us (6157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541302.231286:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788541302.231287:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955930240 00000100:00100000:0.0:1788541302.231291:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955930240 00000100:00100000:2.0:1788541302.231296:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788541302.231301:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683558bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4746c063-6c88-4476-b99b-02bb8e8d54f7+3:20235:x1875420981179008:12345-0@lo:104: 00000100:00100000:3.0:1788541302.231401:0:20235:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20235:1875420981178496:192.168.202.56@tcp:104: 00010000:00010000:3.0:1788541302.231419:0:20235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a682e75f400/0x2aac941e5f4a8ac2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a8abb expref: 23 pid: 17193 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541302.231432:0:20235:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20235:1875420981178624:0@lo:104: 00000100:00100000:3.0:1788541302.231451:0:20235:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20235:1875420981178752:0@lo:104: 00000100:00100000:3.0:1788541302.231458:0:20235:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20235:1875420981178880:0@lo:104: 00000100:00100000:3.0:1788541302.231466:0:20235:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20235:1875420981178368:192.168.202.56@tcp:104: 00010000:00010000:0.0:1788541302.231961:0:17183:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6706957800/0x2aac941e5f4a8cd6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3315f6 expref: 13 pid: 17191 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541302.231986:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955930368 00000100:00100000:0.0:1788541302.231991:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955930368 00010000:00010000:0.0:1788541302.232006:0:17183:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a683551ba00/0x2aac941e5f4a8d15 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331666 expref: 14 pid: 17193 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541302.232019:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 10 00000100:00100000:0.0:1788541302.232026:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707818000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8172f99-f71c-41fa-8527-cb3efe1827fc+14:2396:x1875420955930240:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788541302.232038:0:17183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541302.232044:0:17183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6706957800/0x2aac941e5f4a8cd6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3315f6 expref: 14 pid: 17191 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541302.232054:0:17183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6706957800/0x2aac941e5f4a8cd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3315f6 expref: 14 pid: 17191 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541302.232081:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6706957800/0x2aac941e5f4a8cd6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3315f6 expref: 14 pid: 17191 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541302.232088:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788541302.232095:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a67075ac200/0x2aac941e5f4a8a21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a8a28 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541302.232096:0:17183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788541302.232101:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a67075ac200 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:3.0:1788541302.232105:0:17186:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a67075ac200/0x2aac941e5f4a8a21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a8a28 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541302.232114:0:17186:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a67075ac200/0x2aac941e5f4a8a21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a8a28 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788541302.232120:0:17186:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a67075ac200/0x2aac941e5f4a8a21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a8a28 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541302.232125:0:17186:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1788541302.232141:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707818000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8172f99-f71c-41fa-8527-cb3efe1827fc+13:2396:x1875420955930240:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 116us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541302.232148:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 10 00000100:00100000:0.0:1788541302.232162:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 11 00010000:00010000:3.0:1788541302.232164:0:17186:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a67075ac200/0x2aac941e5f4a8a21 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a8a28 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541302.232168:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707819500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8172f99-f71c-41fa-8527-cb3efe1827fc+12:2396:x1875420955930368:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541302.232170:0:17186:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788541302.232174:0:17183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541302.232178:0:17183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a683551ba00/0x2aac941e5f4a8d15 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331666 expref: 12 pid: 17193 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541302.232186:0:17183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a683551ba00/0x2aac941e5f4a8d15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331666 expref: 12 pid: 17193 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541302.232193:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a67075ac200/0x2aac941e5f4a8a21 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a8a28 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541302.232196:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a683551ba00/0x2aac941e5f4a8d15 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331666 expref: 12 pid: 17193 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541302.232200:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a67075ac200/0x2aac941e5f4a8a21 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a8a28 expref: -99 pid: 18712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541302.232204:0:17183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788541302.232209:0:17186:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788541302.232218:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a6706957c00/0x2aac941e5f4a89e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a89e9 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541302.232219:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707819500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8172f99-f71c-41fa-8527-cb3efe1827fc+11:2396:x1875420955930368:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 51us (955us total) trans 0 rc 0/0 00010000:00010000:3.0:1788541302.232225:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706957c00 already unused, calling callback (ffffffffc150fc20) 00000100:00100000:0.0:1788541302.232225:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 11 10000000:00010000:3.0:1788541302.232228:0:17186:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a6706957c00/0x2aac941e5f4a89e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a89e9 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541302.232234:0:17186:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a6706957c00/0x2aac941e5f4a89e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a89e9 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788541302.232240:0:17186:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a6706957c00/0x2aac941e5f4a89e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a89e9 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541302.232245:0:17186:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788541302.232257:0:17186:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a6706957c00/0x2aac941e5f4a89e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a89e9 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541302.232262:0:17186:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788541302.232268:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a6706957c00/0x2aac941e5f4a89e2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a89e9 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541302.232275:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a6706957c00/0x2aac941e5f4a89e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a89e9 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541302.232283:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541302.232285:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541302.232287:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788541302.232405:0:17181:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.156@tcp lock: ffff9a6706957400/0x2aac941e5f4a89d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a89db expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541302.232747:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6835589880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4746c063-6c88-4476-b99b-02bb8e8d54f7:3643:1875420981179264:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788541302.232783:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541302.232832:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788541302.232846:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683558b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4746c063-6c88-4476-b99b-02bb8e8d54f7:3643:1875420981179392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788541302.232891:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541302.232914:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981179264 00000100:00100000:0.0:1788541302.232918:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981179264 00010000:00010000:0.0:1788541302.232935:0:17183:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a67075ad800/0x2aac941e5f4a8a28 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a8a21 expref: 23 pid: 17191 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541302.232949:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981179392 00000100:00100000:0.0:1788541302.232952:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981179392 00010000:00010000:0.0:1788541302.232961:0:17183:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a6706956000/0x2aac941e5f4a89e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a89e2 expref: 24 pid: 17192 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541302.232973:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788541302.232979:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707819f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4746c063-6c88-4476-b99b-02bb8e8d54f7+24:3643:x1875420981179264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788541302.232988:0:17183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541302.232992:0:17183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a67075ad800/0x2aac941e5f4a8a28 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a8a21 expref: 24 pid: 17191 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541302.233002:0:17183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a67075ad800/0x2aac941e5f4a8a28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a8a21 expref: 24 pid: 17191 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541302.233013:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a67075ad800/0x2aac941e5f4a8a28 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a8a21 expref: 24 pid: 17191 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541302.233023:0:17183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541302.233048:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707819f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4746c063-6c88-4476-b99b-02bb8e8d54f7+23:3643:x1875420981179264:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541302.233055:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788541302.233067:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788541302.233072:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68378a9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4746c063-6c88-4476-b99b-02bb8e8d54f7+22:3643:x1875420981179392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788541302.233085:0:17183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541302.233090:0:17183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a6706956000/0x2aac941e5f4a89e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a89e2 expref: 22 pid: 17192 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541302.233098:0:17183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a6706956000/0x2aac941e5f4a89e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a89e2 expref: 22 pid: 17192 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541302.233107:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a6706956000/0x2aac941e5f4a89e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a89e2 expref: 22 pid: 17192 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541302.233116:0:17183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541302.233136:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68378a9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4746c063-6c88-4476-b99b-02bb8e8d54f7+21:3643:x1875420981179392:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541302.233141:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788541302.233190:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683558b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4746c063-6c88-4476-b99b-02bb8e8d54f7:3643:1875420981179392:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788541302.233242:0:17181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788541302.233249:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683558bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4746c063-6c88-4476-b99b-02bb8e8d54f7+3:20235:x1875420981179008:12345-0@lo:104: Request processed in 1947us (8011us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541302.233257:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788541302.233607:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6835589880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4746c063-6c88-4476-b99b-02bb8e8d54f7:3643:1875420981179264:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788541302.233692:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788541302.233699:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.156@tcp lock: ffff9a6706957400/0x2aac941e5f4a89d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2aac941e5f4a89db expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541302.233706:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706957400 already unused, calling callback (ffffffffc150fc20) 10000000:00010000:0.0:1788541302.233711:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.156@tcp lock: ffff9a6706957400/0x2aac941e5f4a89d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2aac941e5f4a89db expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541302.233720:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.156@tcp lock: ffff9a6706957400/0x2aac941e5f4a89d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2aac941e5f4a89db expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788541302.233728:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.156@tcp lock: ffff9a6706957400/0x2aac941e5f4a89d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2aac941e5f4a89db expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788541302.233741:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788541302.233763:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.156@tcp lock: ffff9a6706957400/0x2aac941e5f4a89d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a89db expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541302.233769:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788541302.233831:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670781b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4746c063-6c88-4476-b99b-02bb8e8d54f7:3641:1875420981179520:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788541302.233863:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788541302.233948:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.156@tcp lock: ffff9a6706957400/0x2aac941e5f4a89d4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a89db expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541302.233957:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.156@tcp lock: ffff9a6706957400/0x2aac941e5f4a89d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2aac941e5f4a89db expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541302.233972:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541302.233974:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788541302.233976:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541302.233987:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981179520 00000100:00100000:0.0:1788541302.233991:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981179520 00010000:00010000:0.0:1788541302.234009:0:17183:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a67075ace00/0x2aac941e5f4a89db lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a89d4 expref: 21 pid: 17192 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541302.234024:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788541302.234029:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706832d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4746c063-6c88-4476-b99b-02bb8e8d54f7+21:3641:x1875420981179520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788541302.234037:0:17183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541302.234041:0:17183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a67075ace00/0x2aac941e5f4a89db lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2aac941e5f4a89d4 expref: 21 pid: 17192 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541302.234050:0:17183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a67075ace00/0x2aac941e5f4a89db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2aac941e5f4a89d4 expref: 21 pid: 17192 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541302.234064:0:17183:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a68043cca00/0x2aac941e5f4a8d46 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541302.234078:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68043cca00/0x2aac941e5f4a8d46 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541302.234094:0:17183:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a68043cca00/0x2aac941e5f4a8d46 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541302.234102:0:17183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a68043cca00/0x2aac941e5f4a8d46 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541302.234110:0:17183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a68043cca00/0x2aac941e5f4a8d46 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541302.234117:0:17183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a68043cca00/0x2aac941e5f4a8d46 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541302.234123:0:17183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a68043cca00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:0.0:1788541302.234128:0:17183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a68043cca00/0x2aac941e5f4a8d46 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541302.234136:0:17183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a68043cca00/0x2aac941e5f4a8d46 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541302.234145:0:17183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a68043cca00/0x2aac941e5f4a8d46 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541302.234154:0:17183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788541302.234377:0:20235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a67075ace00/0x2aac941e5f4a89db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2aac941e5f4a89d4 expref: 21 pid: 17192 timeout: 683 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541302.234388:0:20235:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20235:1875420981179008:0@lo:104: 00010000:00010000:3.0:1788541302.234424:0:20235:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a68043cca00/0x2aac941e5f4a8d46 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541302.234432:0:20235:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a68043cca00/0x2aac941e5f4a8d46 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541302.234438:0:20235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a68043cca00/0x2aac941e5f4a8d46 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541302.234444:0:20235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a68043cca00/0x2aac941e5f4a8d46 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541302.237549:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788541302.239025:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706832d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4746c063-6c88-4476-b99b-02bb8e8d54f7+20:3641:x1875420981179520:12345-0@lo:103:ldlm_bl.0 Request processed in 4989us (5155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541302.239038:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788541302.247464:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670781b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4746c063-6c88-4476-b99b-02bb8e8d54f7:3641:1875420981179520:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788541302.603536:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788541302.731996:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708313800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981179648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788541302.732063:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541302.732112:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981179648 00000100:00100000:1.0:1788541302.732118:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981179648 00000100:00100000:1.0:1788541302.732165:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788541302.732172:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708311c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981179648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788541302.732199:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788541302.732235:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708311c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981179648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541302.732240:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788541302.732290:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708313800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981179648:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788541302.732388:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788541302.732395:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788541302.732403:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683558b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981179776:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788541302.732427:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541302.732833:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981179776 00000100:00100000:1.0:1788541302.732838:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981179776 00000100:00100000:1.0:1788541302.732887:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788541302.732894:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683558a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981179776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788541302.732918:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788541302.732951:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683558a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981179776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541302.732957:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788541302.732983:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683558b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981179776:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788541302.733100:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788541302.736277:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788541302.736306:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707818000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981179904:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788541302.736383:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541302.736432:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981179904 00000100:00100000:1.0:1788541302.736439:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981179904 00000100:00100000:1.0:1788541302.736491:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788541302.736500:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708313800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981179904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788541302.736520:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788541302.736559:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708313800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981179904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541302.736567:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788541302.736711:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707818000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981179904:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788541302.736735:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788541302.737535:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6835588000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981180032:0@lo:400:kworker.0 00000100:00100000:1.0:1788541302.737576:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541302.737608:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683558b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875420981180544:0@lo:400:kworker.0 00000100:00100000:1.0:1788541302.737639:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541302.737656:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875420981181056:0@lo:400:kworker.0 00000100:00100000:1.0:1788541302.737673:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541302.737706:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788541302.737712:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683558ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875420981180160:0@lo:400:kworker.0 00000100:00100000:1.0:1788541302.737730:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541302.737744:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875420981180672:0@lo:400:kworker.0 00000100:00100000:1.0:1788541302.737760:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541302.737798:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981180544 00000100:00100000:1.0:1788541302.737803:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981180544 00000100:00100000:1.0:1788541302.737827:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981181056 00000100:00100000:1.0:1788541302.737830:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981181056 00000100:00100000:1.0:1788541302.737849:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981180160 00000100:00100000:1.0:1788541302.737852:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981180160 00000100:00100000:1.0:1788541302.737861:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981180672 00000100:00100000:1.0:1788541302.737894:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981180672 00000100:00100000:1.0:1788541302.737911:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788541302.737919:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708310700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875420981180544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541302.737959:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708310700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1875420981180544:12345-0@lo:400:kworker.0 Request processed in 41us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541302.737967:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788541302.737981:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788541302.737987:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708311880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875420981181056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541302.738013:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708311880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1875420981181056:12345-0@lo:400:kworker.0 Request processed in 27us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541302.738019:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788541302.738030:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788541302.738035:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708313b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875420981180160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541302.738060:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708313b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1875420981180160:12345-0@lo:400:kworker.0 Request processed in 25us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541302.738073:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788541302.738084:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788541302.738090:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708311f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875420981180672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541302.738114:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708311f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875420981180672:12345-0@lo:400:kworker.0 Request processed in 24us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541302.738119:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1788541302.738142:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788541302.738145:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788541302.738153:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6835589880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981180416:0@lo:400:kworker.0 00000100:00100000:1.0:1788541302.738178:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541302.738196:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875420981180928:0@lo:400:kworker.0 00000100:00100000:1.0:1788541302.738217:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541302.738230:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788541302.738235:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683558b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981180288:0@lo:400:kworker.0 00000100:00100000:1.0:1788541302.738252:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541302.738267:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a670831c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875420981180800:0@lo:400:kworker.0 00000100:00100000:1.0:1788541302.738284:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541302.738303:0:19664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981180416 00000100:00100000:1.0:1788541302.738306:0:19664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981180416 00000100:00100000:3.0:1788541302.738541:0:18270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981180032 00000100:00100000:3.0:1788541302.738545:0:18270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981180032 00000100:00100000:3.0:1788541302.738568:0:18270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981180288 00000100:00100000:3.0:1788541302.738571:0:18270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981180288 00000100:00100000:3.0:1788541302.738583:0:18270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788541302.738589:0:18270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708313100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981180032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541302.738966:0:18270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708313100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981180032:12345-0@lo:400:kworker.0 Request processed in 375us (1388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541302.738972:0:18270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788541302.738992:0:18270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788541302.738997:0:18270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708312680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981180288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541302.739040:0:18270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708312680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981180288:12345-0@lo:400:kworker.0 Request processed in 43us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541302.739046:0:18270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788541302.739417:0:19664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788541302.739426:0:19664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708312300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981180416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788541302.739458:0:19664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708312300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3644:x1875420981180416:12345-0@lo:400:kworker.0 Request processed in 35us (1280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541302.739464:0:19664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788541302.739489:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981180928 00000100:00100000:1.0:1788541302.739501:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981180928 00000100:00100000:1.0:1788541302.739572:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981180800 00000100:00100000:1.0:1788541302.739575:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981180800 00000100:00100000:3.0:1788541302.742766:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788541302.742800:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708310380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875420981180928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541302.749040:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708310380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875420981180928:12345-0@lo:400:kworker.0 Request processed in 6251us (10810us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541302.749056:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788541302.749096:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788541302.749112:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708313480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875420981180800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541302.749177:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708313480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875420981180800:12345-0@lo:400:kworker.0 Request processed in 74us (10892us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541302.749183:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788541302.752778:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683558ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3641:1875420981180160:0@lo:400:kworker.0 00000100:00100000:3.0:1788541302.752808:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875420981180672:0@lo:400:kworker.0 00000100:00100000:3.0:1788541302.752821:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6835588000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981180032:0@lo:400:kworker.0 00000100:00100000:3.0:1788541302.752832:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683558b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3641:1875420981180544:0@lo:400:kworker.0 00010000:00080000:3.0:1788541302.752846:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a68045f7800 x1875420981181056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541302.752857:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3641:1875420981181056:0@lo:400:kworker.0 00000100:00080000:3.0:1788541302.753019:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788541302.753024:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788541302.753028:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788541302.753066:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683558b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981180288:0@lo:400:kworker.0 00010000:00080000:3.0:1788541302.753080:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a670831c700 x1875420981180800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541302.753089:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a670831c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3644:1875420981180800:0@lo:400:kworker.0 00000100:00100000:3.0:1788541302.753101:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6835589880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3644:1875420981180416:0@lo:400:kworker.0 00000100:00100000:3.0:1788541302.753112:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3644:1875420981180928:0@lo:400:kworker.0 00010000:00010000:1.0:1788541303.626811:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788541304.012005:0:17196:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788541304.012014:0:17196:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a6839114000 from 13 10000000:01000000:3.0:1788541304.012019:0:17196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788541304.012065:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68043cca00/0x2aac941e5f4a8d4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541304.012077:0:17196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a68043cca00/0x2aac941e5f4a8d4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541304.012089:0:17196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a68043cca00/0x2aac941e5f4a8d4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541304.012113:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981181184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788541304.012174:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541304.012222:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6808989c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788541304.012366:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981181184 00000100:00100000:2.0:1788541304.012374:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981181184 00000100:00100000:2.0:1788541304.012436:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788541304.012446:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708145850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+20:17196:x1875420981181184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788541304.012458:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541304.012471:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a683551a800/0x2aac941e5f4a8d54 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a8d4d expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541304.012493:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a683551a800/0x2aac941e5f4a8d54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a8d4d expref: 21 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541304.012504:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a683551a800/0x2aac941e5f4a8d54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a8d4d expref: 21 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541304.012514:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a683551a800, rc 0) 00000100:00100000:2.0:1788541304.012563:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708145850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+21:17196:x1875420981181184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541304.012570:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788541304.012643:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981181184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788541304.012668:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a68043cca00/0x2aac941e5f4a8d4d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8d54 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541304.012679:0:17196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a68043cca00/0x2aac941e5f4a8d4d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a8d54 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541304.012739:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707819500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981181312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788541304.012767:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541304.012799:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6835519180 going to sleep for 11 seconds 00000100:00100000:2.0:1788541304.012839:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981181312 00000100:00100000:2.0:1788541304.012843:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981181312 00000100:00100000:2.0:1788541304.012894:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788541304.012902:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835708c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+21:17196:x1875420981181312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788541304.013006:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835708c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+21:17196:x1875420981181312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 105us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541304.013014:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788541304.013044:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707819500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981181312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788541304.013080:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706831180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981181440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788541304.013115:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541304.013135:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6807619540 going to sleep for 11 seconds 00000100:00100000:2.0:1788541304.013146:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981181440 00000100:00100000:2.0:1788541304.013149:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981181440 00000100:00100000:2.0:1788541304.013167:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788541304.013173:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683570b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+21:17196:x1875420981181440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788541304.013245:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683570b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+21:17196:x1875420981181440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541304.013252:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788541304.013287:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706831180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981181440:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788541304.013964:0:20334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788541304.014016:0:17196:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788541304.014032:0:17196:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788541304.014039:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68043cca00/0x2aac941e5f4a8d4d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8d54 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541304.014048:0:17196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a68043cca00/0x2aac941e5f4a8d4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8d54 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788541304.014059:0:17196:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788541304.014062:0:17196:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a67067e0800 from 13 10000000:01000000:2.0:1788541304.014065:0:17196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788541304.014090:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551b200/0x2aac941e5f4a8d5b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541304.014098:0:17196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a683551b200/0x2aac941e5f4a8d5b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541304.014115:0:17196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a683551b200/0x2aac941e5f4a8d5b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541304.014133:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706831180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981181568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788541304.014170:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541304.014194:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68076193c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788541304.014208:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981181568 00000100:00100000:2.0:1788541304.014212:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981181568 00000100:00100000:2.0:1788541304.014235:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788541304.014242:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683570b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+21:17196:x1875420981181568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788541304.014250:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541304.014260:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a683551aa00/0x2aac941e5f4a8d62 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a8d5b expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541304.014279:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a683551aa00/0x2aac941e5f4a8d62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a8d5b expref: 22 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541304.014289:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a683551aa00/0x2aac941e5f4a8d62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a8d5b expref: 22 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541304.014298:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a683551aa00, rc 0) 00000100:00100000:2.0:1788541304.014328:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683570b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+22:17196:x1875420981181568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541304.014334:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788541304.014368:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706831180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981181568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788541304.014379:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a683551b200/0x2aac941e5f4a8d5b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8d62 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541304.014394:0:17196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a683551b200/0x2aac941e5f4a8d5b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a8d62 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541304.014434:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706831180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981181696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788541304.014458:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541304.014469:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68076193c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788541304.014478:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981181696 00000100:00100000:2.0:1788541304.014481:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981181696 00000100:00100000:2.0:1788541304.014494:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788541304.014499:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683570a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+22:17196:x1875420981181696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788541304.014571:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683570a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+22:17196:x1875420981181696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 71us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541304.014577:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788541304.014600:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706831180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981181696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788541304.014622:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706831180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981181824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788541304.014657:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541304.014669:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68076193c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788541304.014680:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981181824 00000100:00100000:2.0:1788541304.014683:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981181824 00000100:00100000:2.0:1788541304.014700:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788541304.014705:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835709450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+22:17196:x1875420981181824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788541304.014770:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835709450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+22:17196:x1875420981181824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 64us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541304.014791:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788541304.014832:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706831180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981181824:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788541304.025457:0:20335:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788541304.026053:0:17196:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788541304.026077:0:17196:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788541304.026088:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a683551b200/0x2aac941e5f4a8d5b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8d62 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541304.026174:0:17196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a683551b200/0x2aac941e5f4a8d5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8d62 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788541304.026198:0:17196:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788541304.026201:0:17196:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a683f356800 from 13 10000000:01000000:3.0:1788541304.026203:0:17196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788541304.026240:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68043cd600/0x2aac941e5f4a8d69 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541304.026247:0:17196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a68043cd600/0x2aac941e5f4a8d69 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541304.026257:0:17196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a68043cd600/0x2aac941e5f4a8d69 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541304.026281:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981181952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788541304.026350:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541304.026395:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6808989f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788541304.026446:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981181952 00000100:00100000:0.0:1788541304.026453:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981181952 00000100:00100000:0.0:1788541304.026504:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788541304.026513:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683570ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+22:17196:x1875420981181952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788541304.026524:0:17191:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541304.026536:0:17191:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a682e75f200/0x2aac941e5f4a8d70 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a8d69 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541304.026559:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a682e75f200/0x2aac941e5f4a8d70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a8d69 expref: 23 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541304.026568:0:17191:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a682e75f200/0x2aac941e5f4a8d70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a8d69 expref: 23 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541304.026576:0:17191:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75f200, rc 0) 00000100:00100000:0.0:1788541304.026614:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683570ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+23:17196:x1875420981181952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541304.026620:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788541304.026668:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981181952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788541304.026681:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a68043cd600/0x2aac941e5f4a8d69 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8d70 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541304.026689:0:17196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a68043cd600/0x2aac941e5f4a8d69 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a8d70 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541304.026735:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707819f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981182080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788541304.026757:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541304.026770:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68355193c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788541304.026797:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981182080 00000100:00100000:0.0:1788541304.026801:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981182080 00000100:00100000:0.0:1788541304.026820:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788541304.026825:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835709850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+23:17196:x1875420981182080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788541304.026947:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835709850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+23:17196:x1875420981182080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541304.026955:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788541304.026981:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707819f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981182080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788541304.027005:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707819f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981182208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788541304.027042:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541304.027055:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68355193c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788541304.027066:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981182208 00000100:00100000:0.0:1788541304.027069:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981182208 00000100:00100000:0.0:1788541304.027089:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788541304.027095:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683570b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+23:17196:x1875420981182208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788541304.027163:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683570b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+23:17196:x1875420981182208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541304.027175:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788541304.027212:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707819f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981182208:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788541304.031741:0:20336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788541304.032055:0:17196:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788541304.032077:0:17196:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788541304.032090:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a68043cd600/0x2aac941e5f4a8d69 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8d70 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541304.032102:0:17196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a68043cd600/0x2aac941e5f4a8d69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8d70 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788541304.032113:0:17196:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788541304.032116:0:17196:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9a67082f3800 from 13 10000000:01000000:0.0:1788541304.032118:0:17196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788541304.032155:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75fe00/0x2aac941e5f4a8d77 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541304.032163:0:17196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.156@tcp lock: ffff9a682e75fe00/0x2aac941e5f4a8d77 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541304.032174:0:17196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.156@tcp lock: ffff9a682e75fe00/0x2aac941e5f4a8d77 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541304.032202:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707819f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981182336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788541304.032268:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541304.032309:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68355193c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788541304.032447:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981182336 00000100:00100000:2.0:1788541304.032456:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981182336 00000100:00100000:2.0:1788541304.032507:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788541304.032517:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683570a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+23:17196:x1875420981182336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788541304.032531:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541304.032543:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a683551bc00/0x2aac941e5f4a8d7e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2aac941e5f4a8d77 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541304.032566:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a683551bc00/0x2aac941e5f4a8d7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2aac941e5f4a8d77 expref: 24 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541304.032577:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a683551bc00/0x2aac941e5f4a8d7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2aac941e5f4a8d77 expref: 24 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541304.032585:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a683551bc00, rc 0) 00000100:00100000:2.0:1788541304.032635:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683570a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4746c063-6c88-4476-b99b-02bb8e8d54f7+24:17196:x1875420981182336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541304.032641:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788541304.033087:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707819f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981182336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788541304.033102:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.156@tcp lock: ffff9a682e75fe00/0x2aac941e5f4a8d77 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8d7e expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541304.033111:0:17196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.156@tcp lock: ffff9a682e75fe00/0x2aac941e5f4a8d77 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2aac941e5f4a8d7e expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541304.033171:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981182464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788541304.033199:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541304.033229:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6808989b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788541304.033269:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981182464 00000100:00100000:0.0:1788541304.033273:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981182464 00000100:00100000:0.0:1788541304.033305:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788541304.033313:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835709050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+24:17196:x1875420981182464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788541304.033429:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835709050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4746c063-6c88-4476-b99b-02bb8e8d54f7+24:17196:x1875420981182464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541304.033436:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788541304.033520:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981182464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788541304.033551:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981182592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788541304.033589:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541304.033609:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6808989b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788541304.033645:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981182592 00000100:00100000:0.0:1788541304.033649:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981182592 00000100:00100000:0.0:1788541304.033677:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788541304.033683:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835708450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+24:17196:x1875420981182592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788541304.035743:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835708450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+24:17196:x1875420981182592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2051us (2144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541304.035758:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788541304.041560:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4746c063-6c88-4476-b99b-02bb8e8d54f7:17196:1875420981182592:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788541304.044541:0:20337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788541304.060228:0:17196:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788541304.060267:0:17196:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.156@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788541304.060279:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.156@tcp lock: ffff9a682e75fe00/0x2aac941e5f4a8d77 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8d7e expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541304.060291:0:17196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.156@tcp lock: ffff9a682e75fe00/0x2aac941e5f4a8d77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2aac941e5f4a8d7e expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541304.172344:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541304.172374:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955930496 00000100:00100000:3.0:1788541304.172384:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955930496 00000100:00100000:3.0:1788541304.172438:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 157 00000100:00100000:3.0:1788541304.172448:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835709c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8172f99-f71c-41fa-8527-cb3efe1827fc+11:14925:x1875420955930496:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788541304.172465:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541304.172486:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a68043cc200/0x2aac941e5f4a8d85 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16473202a33169e expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541304.172515:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a68043cc200/0x2aac941e5f4a8d85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33169e expref: 12 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541304.172527:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a68043cc200/0x2aac941e5f4a8d85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33169e expref: 12 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541304.172536:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68043cc200, rc 0) 00000100:00100000:3.0:1788541304.172605:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835709c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8172f99-f71c-41fa-8527-cb3efe1827fc+12:14925:x1875420955930496:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 Request processed in 148us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541304.172624:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 157 00000100:00100000:1.0:1788541304.195493:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541304.198163:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955930624 00000100:00100000:0.0:1788541304.198181:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955930624 00000100:00100000:0.0:1788541304.198270:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 158 00000100:00100000:0.0:1788541304.198281:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683570bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8172f99-f71c-41fa-8527-cb3efe1827fc+12:14925:x1875420955930624:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788541304.199710:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683570bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8172f99-f71c-41fa-8527-cb3efe1827fc+12:14925:x1875420955930624:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 Request processed in 1422us (4221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541304.199723:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 158 00000100:00100000:0.0:1788541304.219280:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541304.219567:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955930752 00000100:00100000:2.0:1788541304.219577:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955930752 00000100:00100000:2.0:1788541304.219641:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 159 00000100:00100000:2.0:1788541304.219651:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683570a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8172f99-f71c-41fa-8527-cb3efe1827fc+12:14925:x1875420955930752:12345-192.168.202.56@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788541304.219805:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683570a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8172f99-f71c-41fa-8527-cb3efe1827fc+12:14925:x1875420955930752:12345-192.168.202.56@tcp:503:ll_cfg_requeue.0 Request processed in 154us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541304.219824:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 159 00000100:00100000:0.0:1788541304.223514:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541304.223579:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955930880 00000100:00100000:2.0:1788541304.223588:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955930880 00000100:00100000:2.0:1788541304.223643:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 160 00000100:00100000:2.0:1788541304.223653:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8172f99-f71c-41fa-8527-cb3efe1827fc+12:14925:x1875420955930880:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788541304.223670:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541304.223688:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a683551ba00/0x2aac941e5f4a8d8c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa16473202a3316a5 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541304.223715:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a683551ba00/0x2aac941e5f4a8d8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3316a5 expref: 13 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541304.223726:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a683551ba00/0x2aac941e5f4a8d8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3316a5 expref: 13 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541304.223734:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a683551ba00, rc 0) 00000100:00100000:2.0:1788541304.223795:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8172f99-f71c-41fa-8527-cb3efe1827fc+13:14925:x1875420955930880:12345-192.168.202.56@tcp:101:ll_cfg_requeue.0 Request processed in 143us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541304.223802:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 160 00000100:00100000:1.0:1788541304.238320:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541304.238401:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955931008 00000100:00100000:3.0:1788541304.238412:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955931008 00000100:00100000:3.0:1788541304.238471:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 161 00000100:00100000:3.0:1788541304.238482:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8172f99-f71c-41fa-8527-cb3efe1827fc+13:14925:x1875420955931008:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788541304.238640:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8172f99-f71c-41fa-8527-cb3efe1827fc+13:14925:x1875420955931008:12345-192.168.202.56@tcp:501:ll_cfg_requeue.0 Request processed in 160us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541304.238649:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 161 00000100:00100000:1.0:1788541304.240799:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541304.247288:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955931136 00000100:00100000:3.0:1788541304.247303:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955931136 00000100:00100000:3.0:1788541304.247379:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 162 00000100:00100000:3.0:1788541304.247389:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8172f99-f71c-41fa-8527-cb3efe1827fc+13:14925:x1875420955931136:12345-192.168.202.56@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788541304.247540:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8172f99-f71c-41fa-8527-cb3efe1827fc+13:14925:x1875420955931136:12345-192.168.202.56@tcp:503:ll_cfg_requeue.0 Request processed in 152us (6769us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541304.247547:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 162 00010000:00010000:3.0:1788541304.650206:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788541305.440195:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541305.440469:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955931264 00000100:00100000:1.0:1788541305.440479:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955931264 00000100:00100000:1.0:1788541305.440555:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 23 00000100:00100000:1.0:1788541305.440568:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+6:15594:x1875420955931264:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788541305.440600:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541305.440622:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957c00/0x2aac941e5f4a8d93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3316ac expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.440692:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8d9a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.440706:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8d9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.440719:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8d9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.440733:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8da1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.440740:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8da1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.440776:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8da1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.440860:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957a00/0x2aac941e5f4a8da8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.440868:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957a00/0x2aac941e5f4a8da8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.440910:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957a00/0x2aac941e5f4a8da8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788541305.440939:0:17199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788541305.440942:0:17199:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788541305.440981:0:17199:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957a00/0x2aac941e5f4a8da8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.440992:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8d9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.440998:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8d9a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.441005:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8d9a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.441011:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706956c00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541305.441015:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8d9a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.441022:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8d9a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.441041:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68350c0700) 00010000:00010000:1.0:1788541305.441043:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541305.441048:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8d9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.441055:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8d9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.441068:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8da1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.441073:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8da1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.441079:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8da1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.441083:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706956600 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541305.441086:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8da1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.441093:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8da1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.441100:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9a6803869100) 00010000:00010000:1.0:1788541305.441102:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541305.441105:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8da1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.441111:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8da1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.441158:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957c00/0x2aac941e5f4a8d93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3316ac expref: 8 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.441173:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957a00/0x2aac941e5f4a8da8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3316ac expref: 7 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.441181:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a6803869b00) 00010000:00010000:1.0:1788541305.441183:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788541305.441185:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6706957a00, rc 0) 00000100:00100000:1.0:1788541305.441251:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+7:15594:x1875420955931264:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 686us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541305.441259:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 23 00000100:00080000:3.0:1788541305.442183:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788541305.444366:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541305.444449:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955931392 00000100:00100000:3.0:1788541305.444459:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955931392 00000100:00100000:3.0:1788541305.444515:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 5 00000100:00100000:3.0:1788541305.444525:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708312d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:16a226c0-f2f2-449b-91c5-316ce9e9c327+7:15594:x1875420955931392:12345-192.168.202.56@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788541305.444617:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708312d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:16a226c0-f2f2-449b-91c5-316ce9e9c327+7:15594:x1875420955931392:12345-192.168.202.56@tcp:900:lhsmtool_posix.0 Request processed in 93us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541305.444624:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 5 00000100:00100000:1.0:1788541305.455514:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541305.455620:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955931648 00000100:00100000:2.0:1788541305.455632:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955931648 00000100:00100000:2.0:1788541305.455694:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 24 00000100:00100000:2.0:1788541305.455704:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708310e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16a226c0-f2f2-449b-91c5-316ce9e9c327+7:15594:x1875420955931648:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788541305.455726:0:17200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788541305.455747:0:17200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a400/0x2aac941e5f4a8daf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3316b3 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541305.455914:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a8db6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541305.455929:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a8db6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541305.455941:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a8db6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541305.455995:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551ae00/0x2aac941e5f4a8dbd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541305.456002:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551ae00/0x2aac941e5f4a8dbd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541305.456009:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551ae00/0x2aac941e5f4a8dbd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541305.456145:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049800/0x2aac941e5f4a8dc4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541305.456155:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049800/0x2aac941e5f4a8dc4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541305.456162:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049800/0x2aac941e5f4a8dc4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541305.456172:0:17200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788541305.456323:0:17200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a8db6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541305.456342:0:17200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a8db6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541305.456349:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a8db6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541305.456355:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551b800 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:2.0:1788541305.456359:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a8db6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541305.456368:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a8db6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541305.456381:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a6803869b00) 00010000:00010000:2.0:1788541305.456384:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541305.456389:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a8db6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541305.456395:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b800/0x2aac941e5f4a8db6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541305.456408:0:17200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551ae00/0x2aac941e5f4a8dbd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541305.456414:0:17200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551ae00/0x2aac941e5f4a8dbd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541305.456420:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551ae00/0x2aac941e5f4a8dbd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541305.456425:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a683551ae00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:2.0:1788541305.456434:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551ae00/0x2aac941e5f4a8dbd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541305.456441:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551ae00/0x2aac941e5f4a8dbd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541305.456449:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a68350c0e00) 00010000:00010000:2.0:1788541305.456452:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541305.456455:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551ae00/0x2aac941e5f4a8dbd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541305.456460:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551ae00/0x2aac941e5f4a8dbd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541305.457478:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551a400/0x2aac941e5f4a8daf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3316b3 expref: 10 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541305.457498:0:17200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049800/0x2aac941e5f4a8dc4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3316b3 expref: 9 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541305.457505:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a68350c0000) 00010000:00010000:2.0:1788541305.457508:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788541305.457510:0:17200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6842049800, rc 0) 00000100:00100000:2.0:1788541305.457585:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708310e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16a226c0-f2f2-449b-91c5-316ce9e9c327+9:15594:x1875420955931648:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 1881us (2080us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788541305.458453:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 24 00000100:00100000:2.0:1788541305.467791:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541305.467908:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955931776 00000100:00100000:1.0:1788541305.467918:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955931776 00000100:00100000:1.0:1788541305.467981:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 25 00000100:00100000:1.0:1788541305.467992:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+9:15594:x1875420955931776:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788541305.468116:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+9:15594:x1875420955931776:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 Request processed in 125us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541305.468124:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 25 00000100:00100000:1.0:1788541305.471131:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541305.471226:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955931904 00000100:00100000:2.0:1788541305.471236:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955931904 00000100:00100000:1.0:1788541305.471421:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 26 00000100:00100000:1.0:1788541305.471433:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708310a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16a226c0-f2f2-449b-91c5-316ce9e9c327+5:15594:x1875420955931904:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 00000004:00080000:1.0:1788541305.472289:0:17200:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 813us 00000100:00080000:3.0:1788541305.475744:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788541305.511127:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708310a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16a226c0-f2f2-449b-91c5-316ce9e9c327+5:15594:x1875420955931904:12345-192.168.202.56@tcp:59:lhsmtool_posix.0 Request processed in 39685us (39995us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541305.511143:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 26 00000100:00100000:2.0:1788541305.543568:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541305.543681:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955932032 00000100:00100000:1.0:1788541305.543691:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955932032 00000100:00100000:1.0:1788541305.543756:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 27 00000100:00100000:1.0:1788541305.543776:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+9:15600:x1875420955932032:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1788541305.543798:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541305.543820:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8dd2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3316ba expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.543935:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8dd9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.543949:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8dd9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.543960:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8dd9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.543975:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957800/0x2aac941e5f4a8de0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.543982:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957800/0x2aac941e5f4a8de0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.543988:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957800/0x2aac941e5f4a8de0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.544026:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8dd9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.544033:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8dd9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.544052:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8dd9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.544058:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706956c00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541305.544062:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8dd9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.544070:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8dd9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.544083:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68350c0700) 00010000:00010000:1.0:1788541305.544086:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541305.544091:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8dd9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.544097:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8dd9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.544110:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957800/0x2aac941e5f4a8de0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.544116:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957800/0x2aac941e5f4a8de0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.544121:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957800/0x2aac941e5f4a8de0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.544126:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706957800 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541305.544128:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957800/0x2aac941e5f4a8de0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.544143:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957800/0x2aac941e5f4a8de0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.544150:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a6803869100) 00010000:00010000:1.0:1788541305.544153:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541305.544155:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957800/0x2aac941e5f4a8de0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.544160:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957800/0x2aac941e5f4a8de0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.544191:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8dd2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3316ba expref: 10 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.544202:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68350c0700) 00010000:00010000:1.0:1788541305.544205:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541305.544208:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8dd2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3316ba expref: 10 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.544217:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6706956600, rc 0) 00000100:00100000:1.0:1788541305.544272:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+9:15600:x1875420955932032:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 507us (712us total) trans 0 rc 301/301 00000100:00100000:1.0:1788541305.544279:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 27 00000100:00100000:2.0:1788541305.549427:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541305.551052:0:17207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955932160 00000100:00100000:2.0:1788541305.551064:0:17207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955932160 00000100:00100000:2.0:1788541305.551157:0:17207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 0 00000100:00100000:2.0:1788541305.551166:0:17207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:16a226c0-f2f2-449b-91c5-316ce9e9c327+9:15600:x1875420955932160:12345-192.168.202.56@tcp:700:lfs.0 00000100:00100000:2.0:1788541305.551260:0:17207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:16a226c0-f2f2-449b-91c5-316ce9e9c327+9:15600:x1875420955932160:12345-192.168.202.56@tcp:700:lfs.0 Request processed in 94us (1841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541305.551268:0:17207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 0 00000100:00100000:2.0:1788541305.555410:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541305.555518:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955932416 00000100:00100000:1.0:1788541305.555529:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955932416 00000100:00100000:1.0:1788541305.555650:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 28 00000100:00100000:1.0:1788541305.555662:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16a226c0-f2f2-449b-91c5-316ce9e9c327+9:15600:x1875420955932416:12345-192.168.202.56@tcp:36:lfs.0 00010000:00010000:1.0:1788541305.555744:0:17198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541305.555802:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a683551b400/0x2aac941e5f4a8d00 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331627 expref: 9 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.555823:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68350c0700) 00010000:00010000:1.0:1788541305.555829:0:17198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788541305.555938:0:17198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8de7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.555952:0:17198:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a8d3f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331697 expref: 5 pid: 19663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.555961:0:17198:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8de7 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.555995:0:17198:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a8d3f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331697 expref: 5 pid: 19663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.556009:0:17198:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a8d3f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331697 expref: 5 pid: 19663 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541305.556024:0:17198:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6708311500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17198:1875420981182720:192.168.202.56@tcp:104: 00000100:00100000:1.0:1788541305.556118:0:17198:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68083db000 going to sleep for 11 seconds 00000100:00100000:2.0:1788541305.560242:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541305.560330:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955932544 00000100:00100000:3.0:1788541305.560339:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955932544 00010000:00010000:3.0:1788541305.560398:0:17184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a8d3f lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331697 expref: 6 pid: 19663 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541305.560441:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 15 00000100:00100000:3.0:1788541305.560451:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74d244c9-cb0c-4783-8214-d6a87bde15a9+6:2397:x1875420955932544:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541305.560465:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541305.560473:0:17184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a8d3f lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331697 expref: 6 pid: 19663 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541305.560486:0:17184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a8d3f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331697 expref: 6 pid: 19663 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541305.560510:0:17184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68350c0700) 00010000:00010000:3.0:1788541305.560516:0:17184:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8de7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541305.560526:0:17184:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8de7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541305.560533:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8de7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541305.560551:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:0.0:1788541305.560709:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788541305.561067:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74d244c9-cb0c-4783-8214-d6a87bde15a9+6:2397:x1875420955932544:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 615us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541305.561076:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 15 00010000:00010000:1.0:1788541305.562224:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a8d3f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331697 expref: 5 pid: 19663 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541305.562248:0:17198:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6708311500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17198:1875420981182720:192.168.202.56@tcp:104: 00010000:00010000:1.0:1788541305.562272:0:17198:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8de7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.562374:0:17198:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8de7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.562382:0:17198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8de7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.562411:0:17198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a8dee lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.562430:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a8dee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.562441:0:17198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a8dee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.564195:0:17198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f600/0x2aac941e5f4a8df5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.564217:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f600/0x2aac941e5f4a8df5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.564227:0:17198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f600/0x2aac941e5f4a8df5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788541305.564244:0:17198:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d440b154 reply state 00000000fa997837 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f600/0x2aac941e5f4a8df5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.564255:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f600/0x2aac941e5f4a8df5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.564261:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a6835327100) 00010000:00010000:0.0:1788541305.564264:0:17198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788541305.564268:0:17198:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788541305.564273:0:17198:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788541305.564281:0:17198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8de7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.564287:0:17198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8de7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.564293:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8de7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.564315:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706956600 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541305.564319:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8de7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.564327:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8de7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.564338:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a68350c0700) 00010000:00010000:0.0:1788541305.564341:0:17198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541305.564344:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8de7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.564351:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8de7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788541305.564373:0:17198:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d440b154 reply state 00000000fa997837 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a8dee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.564380:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a8dee lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.564386:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a6835327600) 00010000:00010000:0.0:1788541305.564388:0:17198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788541305.564390:0:17198:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788541305.564473:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16a226c0-f2f2-449b-91c5-316ce9e9c327+10:15600:x1875420955932416:12345-192.168.202.56@tcp:36:lfs.0 Request processed in 8809us (9069us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788541305.564482:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 28 00000100:00100000:2.0:1788541305.633601:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541305.633705:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955932672 00000100:00100000:1.0:1788541305.633716:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955932672 00000100:00100000:1.0:1788541305.633787:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 29 00000100:00100000:1.0:1788541305.633798:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+10:15608:x1875420955932672:12345-192.168.202.56@tcp:101:lctl.0 00010000:00010000:1.0:1788541305.633824:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541305.633858:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a8dfc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3316c1 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.633958:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957800/0x2aac941e5f4a8e03 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.633975:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957800/0x2aac941e5f4a8e03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.633988:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957800/0x2aac941e5f4a8e03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788541305.634030:0:17199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788541305.634035:0:17199:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788541305.634073:0:17199:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957800/0x2aac941e5f4a8e03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.634097:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a8dfc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3316c1 expref: 12 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.634115:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957800/0x2aac941e5f4a8e03 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3316c1 expref: 11 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.634123:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6803869100) 00010000:00010000:1.0:1788541305.634141:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788541305.634145:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6706957800, rc 0) 00000100:00100000:1.0:1788541305.634209:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+11:15608:x1875420955932672:12345-192.168.202.56@tcp:101:lctl.0 Request processed in 412us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541305.634216:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 29 00000100:00100000:2.0:1788541305.656981:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541305.657131:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955932800 00000100:00100000:3.0:1788541305.657142:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955932800 00000100:00100000:3.0:1788541305.657204:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 30 00000100:00100000:3.0:1788541305.657214:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74d244c9-cb0c-4783-8214-d6a87bde15a9+5:15610:x1875420955932800:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:3.0:1788541305.657236:0:17200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541305.657259:0:17200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68043cdc00/0x2aac941e5f4a8e0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3316c8 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541305.657341:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68043cd200/0x2aac941e5f4a8e11 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541305.657359:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68043cd200/0x2aac941e5f4a8e11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541305.657374:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68043cd200/0x2aac941e5f4a8e11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788541305.657426:0:17200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788541305.657430:0:17200:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788541305.657452:0:17200:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a68043cd200/0x2aac941e5f4a8e11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541305.657478:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68043cdc00/0x2aac941e5f4a8e0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3316c8 expref: 7 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541305.657499:0:17200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68043cd200/0x2aac941e5f4a8e11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3316c8 expref: 6 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541305.657526:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6803869100) 00010000:00010000:3.0:1788541305.657529:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788541305.657533:0:17200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68043cd200, rc 0) 00000100:00100000:3.0:1788541305.657791:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74d244c9-cb0c-4783-8214-d6a87bde15a9+6:15610:x1875420955932800:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 577us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541305.657798:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 30 00000100:00100000:3.0:1788541305.661217:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541305.661423:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955932928 00000100:00100000:1.0:1788541305.661434:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955932928 00000100:00100000:1.0:1788541305.661498:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 31 00000100:00100000:1.0:1788541305.661509:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74d244c9-cb0c-4783-8214-d6a87bde15a9+6:15610:x1875420955932928:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1788541305.661531:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541305.661552:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a8e18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3316cf expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.661626:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8e1f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.661640:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8e1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.661652:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8e1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.661662:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956000/0x2aac941e5f4a8e26 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.661669:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956000/0x2aac941e5f4a8e26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.661675:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956000/0x2aac941e5f4a8e26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.661774:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957400/0x2aac941e5f4a8e2d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.661782:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957400/0x2aac941e5f4a8e2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.661788:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957400/0x2aac941e5f4a8e2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788541305.661829:0:17199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788541305.661843:0:17199:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788541305.661863:0:17199:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957400/0x2aac941e5f4a8e2d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.661909:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8e1f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.661916:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8e1f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.661923:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8e1f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.661929:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706956c00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541305.661934:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8e1f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.661942:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8e1f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.661953:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6803869100) 00010000:00010000:1.0:1788541305.661960:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541305.661966:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8e1f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.661972:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8e1f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.661986:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956000/0x2aac941e5f4a8e26 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.661992:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956000/0x2aac941e5f4a8e26 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.661998:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956000/0x2aac941e5f4a8e26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.662002:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706956000 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541305.662005:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956000/0x2aac941e5f4a8e26 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.662011:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956000/0x2aac941e5f4a8e26 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.662018:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a6835327600) 00010000:00010000:1.0:1788541305.662021:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541305.662023:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956000/0x2aac941e5f4a8e26 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.662029:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956000/0x2aac941e5f4a8e26 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.662052:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a8e18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3316cf expref: 8 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.662078:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957400/0x2aac941e5f4a8e2d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3316cf expref: 7 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.662084:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a6835327100) 00010000:00010000:1.0:1788541305.662086:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788541305.662089:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6706957400, rc 0) 00000100:00100000:1.0:1788541305.662151:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74d244c9-cb0c-4783-8214-d6a87bde15a9+7:15610:x1875420955932928:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 644us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541305.662158:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 31 00000100:00100000:2.0:1788541305.669043:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541305.669135:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955933056 00000100:00100000:3.0:1788541305.669146:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955933056 00000100:00100000:3.0:1788541305.669224:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 6 00000100:00100000:3.0:1788541305.669234:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:74d244c9-cb0c-4783-8214-d6a87bde15a9+5:15610:x1875420955933056:12345-192.168.202.56@tcp:900:lfs.0 00000100:00100000:3.0:1788541305.669326:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:74d244c9-cb0c-4783-8214-d6a87bde15a9+5:15610:x1875420955933056:12345-192.168.202.56@tcp:900:lfs.0 Request processed in 93us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541305.669334:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 6 00000100:00080000:0.0:1788541305.669502:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788541305.672776:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541305.672906:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955933312 00000100:00100000:0.0:1788541305.672915:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955933312 00000100:00100000:0.0:1788541305.672982:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 32 00000100:00100000:0.0:1788541305.672992:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74d244c9-cb0c-4783-8214-d6a87bde15a9+7:15610:x1875420955933312:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1788541305.673011:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541305.673030:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a8e34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3316d6 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541305.673127:0:17198:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788541305.673215:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a8e34 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3316d6 expref: 9 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.673227:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6803869100) 00010000:00010000:0.0:1788541305.673230:0:17198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788541305.673234:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a8e34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3316d6 expref: 9 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.673247:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75ee00, rc 0) 00000100:00100000:0.0:1788541305.673311:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74d244c9-cb0c-4783-8214-d6a87bde15a9+8:15610:x1875420955933312:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 314us (551us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1788541305.673318:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 32 00010000:00010000:3.0:1788541305.675014:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541305.679297:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541305.679403:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955933568 00000100:00100000:1.0:1788541305.679415:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955933568 00000100:00100000:1.0:1788541305.679476:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 33 00000100:00100000:1.0:1788541305.679487:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74d244c9-cb0c-4783-8214-d6a87bde15a9+8:15610:x1875420955933568:12345-192.168.202.56@tcp:36:lfs.0 00010000:00010000:1.0:1788541305.679541:0:17199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541305.679565:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957400/0x2aac941e5f4a8e2d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3316cf expref: 8 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.679583:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a6835327100) 00010000:00010000:1.0:1788541305.679596:0:17199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788541305.679617:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a8e42 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.679631:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a8e42 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.679642:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a8e42 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788541305.679855:0:17199:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002cad8f71 reply state 00000000e8982260 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a8e42 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.679868:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a8e42 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.679916:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a6835327100) 00010000:00010000:1.0:1788541305.679918:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1788541305.679921:0:17199:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788541305.679929:0:17199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788541305.680009:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74d244c9-cb0c-4783-8214-d6a87bde15a9+9:15610:x1875420955933568:12345-192.168.202.56@tcp:36:lfs.0 Request processed in 523us (723us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788541305.680017:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 33 00000100:00100000:2.0:1788541305.682475:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541305.682557:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955933824 00000100:00100000:1.0:1788541305.682566:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955933824 00000100:00100000:1.0:1788541305.682630:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 2 00000100:00100000:1.0:1788541305.682640:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74d244c9-cb0c-4783-8214-d6a87bde15a9+9:15610:x1875420955933824:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:1.0:1788541305.682897:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74d244c9-cb0c-4783-8214-d6a87bde15a9+10:15610:x1875420955933824:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 257us (430us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788541305.682905:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 2 00000100:00100000:2.0:1788541305.686098:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541305.686181:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955934080 00000100:00100000:0.0:1788541305.686191:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955934080 00000100:00100000:0.0:1788541305.686244:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 34 00000100:00100000:0.0:1788541305.686254:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74d244c9-cb0c-4783-8214-d6a87bde15a9+10:15610:x1875420955934080:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:0.0:1788541305.686276:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541305.686295:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a8e49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3316dd expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.686391:0:17198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fa00/0x2aac941e5f4a8e50 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.686405:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fa00/0x2aac941e5f4a8e50 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.686416:0:17198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fa00/0x2aac941e5f4a8e50 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.686427:0:17198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ea00/0x2aac941e5f4a8e57 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.686435:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ea00/0x2aac941e5f4a8e57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.686442:0:17198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ea00/0x2aac941e5f4a8e57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541305.686534:0:17198:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788541305.686611:0:17198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fa00/0x2aac941e5f4a8e50 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.686619:0:17198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fa00/0x2aac941e5f4a8e50 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.686625:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fa00/0x2aac941e5f4a8e50 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.686631:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75fa00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541305.686636:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fa00/0x2aac941e5f4a8e50 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.686654:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fa00/0x2aac941e5f4a8e50 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.686667:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6803869100) 00010000:00010000:0.0:1788541305.686670:0:17198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541305.686674:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fa00/0x2aac941e5f4a8e50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.686681:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fa00/0x2aac941e5f4a8e50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.686695:0:17198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ea00/0x2aac941e5f4a8e57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.686701:0:17198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ea00/0x2aac941e5f4a8e57 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.686707:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ea00/0x2aac941e5f4a8e57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.686712:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75ea00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541305.686715:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ea00/0x2aac941e5f4a8e57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.686721:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ea00/0x2aac941e5f4a8e57 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.686728:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a6835327600) 00010000:00010000:0.0:1788541305.686731:0:17198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541305.686734:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ea00/0x2aac941e5f4a8e57 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.686749:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ea00/0x2aac941e5f4a8e57 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.686795:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a8e49 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3316dd expref: 12 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.686805:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6803869100) 00010000:00010000:0.0:1788541305.686807:0:17198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788541305.686811:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a8e49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3316dd expref: 12 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.686821:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75ee00, rc 0) 00000100:00100000:0.0:1788541305.686936:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74d244c9-cb0c-4783-8214-d6a87bde15a9+11:15610:x1875420955934080:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 683us (847us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1788541305.686943:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 34 00000100:00100000:3.0:1788541305.689827:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541305.690419:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955934208 00000100:00100000:1.0:1788541305.690430:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955934208 00000100:00100000:1.0:1788541305.690511:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 35 00000100:00100000:1.0:1788541305.690521:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74d244c9-cb0c-4783-8214-d6a87bde15a9+11:15610:x1875420955934208:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1788541305.690542:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541305.690559:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957400/0x2aac941e5f4a8e65 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3316e4 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.690672:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956000/0x2aac941e5f4a8e6c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.690686:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956000/0x2aac941e5f4a8e6c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.690697:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956000/0x2aac941e5f4a8e6c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788541305.690720:0:17199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788541305.690723:0:17199:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788541305.690741:0:17199:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956000/0x2aac941e5f4a8e6c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.690776:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957400/0x2aac941e5f4a8e65 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3316e4 expref: 13 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.690794:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956000/0x2aac941e5f4a8e6c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3316e4 expref: 12 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.690802:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a6835327100) 00010000:00010000:1.0:1788541305.690805:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788541305.690808:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6706956000, rc 0) 00000100:00100000:1.0:1788541305.690991:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74d244c9-cb0c-4783-8214-d6a87bde15a9+12:15610:x1875420955934208:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 471us (1173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541305.690998:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 35 00000100:00100000:2.0:1788541305.696156:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541305.696545:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955934336 00000100:00100000:1.0:1788541305.696555:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955934336 00000100:00100000:1.0:1788541305.696679:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 3 00000100:00100000:1.0:1788541305.696690:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74d244c9-cb0c-4783-8214-d6a87bde15a9+12:15610:x1875420955934336:12345-192.168.202.56@tcp:37:lfs.0 00000100:00100000:1.0:1788541305.701229:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74d244c9-cb0c-4783-8214-d6a87bde15a9+12:15610:x1875420955934336:12345-192.168.202.56@tcp:37:lfs.0 Request processed in 4528us (5070us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541305.701244:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 3 00000100:00100000:3.0:1788541305.704626:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541305.704709:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955934592 00000100:00100000:2.0:1788541305.704719:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955934592 00000100:00100000:2.0:1788541305.704794:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 4 00000100:00100000:2.0:1788541305.704804:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68420d8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74d244c9-cb0c-4783-8214-d6a87bde15a9+12:15610:x1875420955934592:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:2.0:1788541305.705045:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68420d8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74d244c9-cb0c-4783-8214-d6a87bde15a9+13:15610:x1875420955934592:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 242us (428us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788541305.705053:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 4 00000100:00100000:2.0:1788541305.753798:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541305.753895:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955934720 00000100:00100000:1.0:1788541305.753905:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955934720 00000100:00100000:1.0:1788541305.753967:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 36 00000100:00100000:1.0:1788541305.753977:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16a226c0-f2f2-449b-91c5-316ce9e9c327+11:15616:x1875420955934720:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:1.0:1788541305.753997:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541305.754018:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957400/0x2aac941e5f4a8e73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3316eb expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.754086:0:17198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8e7a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.754099:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8e7a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.754111:0:17198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8e7a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.754123:0:17198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8e81 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.754130:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8e81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.754136:0:17198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8e81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.754228:0:17198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957c00/0x2aac941e5f4a8e88 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.754237:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957c00/0x2aac941e5f4a8e88 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.754244:0:17198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957c00/0x2aac941e5f4a8e88 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788541305.754275:0:17198:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788541305.754279:0:17198:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788541305.754316:0:17198:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957c00/0x2aac941e5f4a8e88 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.754329:0:17198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8e7a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.754337:0:17198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8e7a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.754343:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8e7a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.754349:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706956c00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541305.754353:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8e7a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.754361:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8e7a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.754372:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6803869100) 00010000:00010000:1.0:1788541305.754380:0:17198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541305.754384:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8e7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.754390:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8e7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.754403:0:17198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8e81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.754409:0:17198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8e81 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.754416:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8e81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.754420:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706956600 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541305.754423:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8e81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.754428:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8e81 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.754434:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a6835327600) 00010000:00010000:1.0:1788541305.754436:0:17198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541305.754438:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8e81 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.754443:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8e81 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.754474:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957400/0x2aac941e5f4a8e73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3316eb expref: 13 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.754499:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957c00/0x2aac941e5f4a8e88 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3316eb expref: 12 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.754506:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a6835327100) 00010000:00010000:1.0:1788541305.754508:0:17198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788541305.754510:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6706957c00, rc 0) 00000100:00100000:1.0:1788541305.754578:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16a226c0-f2f2-449b-91c5-316ce9e9c327+12:15616:x1875420955934720:12345-192.168.202.56@tcp:101:bash.0 Request processed in 602us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541305.754593:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 36 00000100:00100000:0.0:1788541305.761196:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541305.761275:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955934848 00000100:00100000:3.0:1788541305.761285:0:17209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955934848 00000100:00100000:3.0:1788541305.761355:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 7 00000100:00100000:3.0:1788541305.761366:0:17209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707818a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:16a226c0-f2f2-449b-91c5-316ce9e9c327+5:15616:x1875420955934848:12345-192.168.202.56@tcp:900:bash.0 00000100:00100000:3.0:1788541305.761451:0:17209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707818a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:16a226c0-f2f2-449b-91c5-316ce9e9c327+5:15616:x1875420955934848:12345-192.168.202.56@tcp:900:bash.0 Request processed in 86us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541305.761460:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 7 00000100:00100000:2.0:1788541305.763563:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541305.763730:0:19663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955935104 00000100:00100000:0.0:1788541305.763738:0:19663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955935104 00000100:00100000:0.0:1788541305.763801:0:19663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 37 00000100:00100000:0.0:1788541305.763810:0:19663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16a226c0-f2f2-449b-91c5-316ce9e9c327+12:15616:x1875420955935104:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:0.0:1788541305.763829:0:19663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541305.763849:0:19663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ea00/0x2aac941e5f4a8e8f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3316f2 expref: -99 pid: 19663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.763997:0:19663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fa00/0x2aac941e5f4a8e96 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.764024:0:19663:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956000/0x2aac941e5f4a8e6c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3316e4 expref: 12 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.764033:0:19663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fa00/0x2aac941e5f4a8e96 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.764066:0:19663:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956000/0x2aac941e5f4a8e6c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3316e4 expref: 12 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.764080:0:19663:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956000/0x2aac941e5f4a8e6c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3316e4 expref: 12 pid: 17199 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541305.764094:0:19663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707819f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19663:1875420981182848:192.168.202.56@tcp:104: 00000100:00100000:0.0:1788541305.764171:0:19663:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a680431cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788541305.766347:0:19663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707819f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19663:1875420981182848:192.168.202.56@tcp:104: 00010000:00010000:0.0:1788541305.766381:0:19663:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fa00/0x2aac941e5f4a8e96 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541305.767811:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541305.768470:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955935232 00000100:00100000:0.0:1788541305.768479:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955935232 00010000:00010000:0.0:1788541305.768517:0:17183:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956000/0x2aac941e5f4a8e6c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3316e4 expref: 13 pid: 17199 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541305.768559:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 16 00000100:00100000:0.0:1788541305.768569:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74d244c9-cb0c-4783-8214-d6a87bde15a9+13:2397:x1875420955935232:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788541305.768591:0:17183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541305.768611:0:17183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956000/0x2aac941e5f4a8e6c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3316e4 expref: 13 pid: 17199 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.768623:0:17183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956000/0x2aac941e5f4a8e6c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3316e4 expref: 13 pid: 17199 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.768645:0:17183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956000/0x2aac941e5f4a8e6c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3316e4 expref: 13 pid: 17199 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.768660:0:17183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a6835327100) 00010000:00010000:0.0:1788541305.768666:0:17183:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fa00/0x2aac941e5f4a8e96 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.768675:0:17183:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fa00/0x2aac941e5f4a8e96 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.768682:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fa00/0x2aac941e5f4a8e96 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.768769:0:17183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541305.768839:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74d244c9-cb0c-4783-8214-d6a87bde15a9+12:2397:x1875420955935232:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 270us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541305.768847:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 16 00010000:00010000:3.0:1788541305.770157:0:19663:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fa00/0x2aac941e5f4a8e96 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541305.770182:0:19663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fa00/0x2aac941e5f4a8e96 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.770319:0:19663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e200/0x2aac941e5f4a8e9d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.770334:0:19663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e200/0x2aac941e5f4a8e9d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.770343:0:19663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e200/0x2aac941e5f4a8e9d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.770825:0:19663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f800/0x2aac941e5f4a8ea4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.770835:0:19663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f800/0x2aac941e5f4a8ea4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.770843:0:19663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f800/0x2aac941e5f4a8ea4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788541305.770854:0:19663:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788541305.770900:0:19663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fa00/0x2aac941e5f4a8e96 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.770907:0:19663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fa00/0x2aac941e5f4a8e96 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.770914:0:19663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fa00/0x2aac941e5f4a8e96 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.770920:0:19663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75fa00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541305.770925:0:19663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fa00/0x2aac941e5f4a8e96 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.770932:0:19663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fa00/0x2aac941e5f4a8e96 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.770943:0:19663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a6835327100) 00010000:00010000:0.0:1788541305.770946:0:19663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788541305.770950:0:19663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fa00/0x2aac941e5f4a8e96 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.770967:0:19663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fa00/0x2aac941e5f4a8e96 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788541305.770979:0:19663:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c694e0f3 reply state 00000000a26f1eba transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e200/0x2aac941e5f4a8e9d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.770990:0:19663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e200/0x2aac941e5f4a8e9d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.770996:0:19663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a6835327500) 00010000:00010000:0.0:1788541305.770998:0:19663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788541305.771001:0:19663:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788541305.771038:0:19663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ea00/0x2aac941e5f4a8e8f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3316f2 expref: 15 pid: 19663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.771053:0:19663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f800/0x2aac941e5f4a8ea4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3316f2 expref: 14 pid: 19663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541305.771060:0:19663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6835327200) 00010000:00010000:0.0:1788541305.771062:0:19663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788541305.771065:0:19663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75f800, rc 0) 00000100:00100000:0.0:1788541305.771142:0:19663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16a226c0-f2f2-449b-91c5-316ce9e9c327+15:15616:x1875420955935104:12345-192.168.202.56@tcp:101:bash.0 Request processed in 7333us (7586us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788541305.771152:0:19663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 37 00000100:00100000:2.0:1788541305.785257:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541305.785365:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955935360 00000100:00100000:1.0:1788541305.785378:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955935360 00000100:00100000:1.0:1788541305.785447:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 38 00000100:00100000:1.0:1788541305.785459:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16a226c0-f2f2-449b-91c5-316ce9e9c327+15:15616:x1875420955935360:12345-192.168.202.56@tcp:101:bash.0 00010000:00010000:1.0:1788541305.785488:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541305.785514:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8eb2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a3316f9 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.785596:0:17198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8eb9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.785612:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8eb9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.785624:0:17198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8eb9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788541305.785681:0:17198:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788541305.785701:0:17198:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788541305.785724:0:17198:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8eb9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.785736:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8eb9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.785956:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8eb2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3316f9 expref: 17 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.785978:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8eb9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3316f9 expref: 16 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.785987:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6835327200) 00010000:00010000:1.0:1788541305.785990:0:17198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788541305.785994:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6706956c00, rc 0) 00000100:00100000:1.0:1788541305.786062:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16a226c0-f2f2-449b-91c5-316ce9e9c327+16:15616:x1875420955935360:12345-192.168.202.56@tcp:101:bash.0 Request processed in 606us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541305.786069:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 38 00000100:00100000:2.0:1788541305.790685:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541305.790779:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955935616 00000100:00100000:3.0:1788541305.790789:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955935616 00000100:00100000:3.0:1788541305.790846:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 5 00000100:00100000:3.0:1788541305.790856:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:16a226c0-f2f2-449b-91c5-316ce9e9c327+16:15616:x1875420955935616:12345-192.168.202.56@tcp:35:bash.0 00000100:00100000:3.0:1788541305.791204:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:16a226c0-f2f2-449b-91c5-316ce9e9c327+17:15616:x1875420955935616:12345-192.168.202.56@tcp:35:bash.0 Request processed in 348us (530us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1788541305.791214:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 5 00000100:00100000:1.0:1788541305.802650:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68045f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981182976:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788541305.802727:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541305.802923:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981182976 00000100:00100000:2.0:1788541305.802932:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981182976 00000100:00100000:2.0:1788541305.802999:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788541305.803010:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708311500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981182976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788541305.803037:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788541305.803095:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708311500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1875420981182976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541305.803103:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1788541305.803164:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788541305.803347:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68045f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3642:1875420981182976:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788541305.903150:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541305.903280:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955935872 00000100:00100000:1.0:1788541305.903290:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955935872 00000100:00100000:1.0:1788541305.903365:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 39 00000100:00100000:1.0:1788541305.903375:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+17:15626:x1875420955935872:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1788541305.903398:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541305.903418:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8ec0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331700 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788541305.903544:0:17199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788541305.903648:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8ec0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331700 expref: 19 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.903662:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a6803869100) 00010000:00010000:1.0:1788541305.903665:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788541305.903671:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8ec0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331700 expref: 19 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.903684:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6706956600, rc 0) 00000100:00100000:1.0:1788541305.903746:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+18:15626:x1875420955935872:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 373us (607us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1788541305.903753:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 39 00000100:00100000:2.0:1788541305.910478:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541305.910555:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955936128 00000100:00100000:3.0:1788541305.910564:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955936128 00000100:00100000:3.0:1788541305.910623:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 6 00000100:00100000:3.0:1788541305.910633:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:16a226c0-f2f2-449b-91c5-316ce9e9c327+18:15626:x1875420955936128:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:3.0:1788541305.910891:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:16a226c0-f2f2-449b-91c5-316ce9e9c327+19:15626:x1875420955936128:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 236us (398us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1788541305.910900:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 6 00000100:00100000:3.0:1788541305.989053:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541305.989159:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955936384 00000100:00100000:1.0:1788541305.989171:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955936384 00000100:00100000:1.0:1788541305.989237:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 40 00000100:00100000:1.0:1788541305.989247:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68045f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16a226c0-f2f2-449b-91c5-316ce9e9c327+19:15629:x1875420955936384:12345-192.168.202.56@tcp:101:lfs.0 00010000:00010000:1.0:1788541305.989271:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541305.989292:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8ece lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331707 expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.989430:0:17198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957600/0x2aac941e5f4a8ed5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.989445:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957600/0x2aac941e5f4a8ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.989473:0:17198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957600/0x2aac941e5f4a8ed5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788541305.989486:0:17198:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788541305.989599:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8ece lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331707 expref: 22 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.989619:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957600/0x2aac941e5f4a8ed5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331707 expref: 21 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541305.989628:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6835327200) 00010000:00010000:1.0:1788541305.989631:0:17198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788541305.989636:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6706957600, rc 0) 00000100:00100000:1.0:1788541305.989710:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68045f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16a226c0-f2f2-449b-91c5-316ce9e9c327+21:15629:x1875420955936384:12345-192.168.202.56@tcp:101:lfs.0 Request processed in 464us (668us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1788541305.989718:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 40 00000100:00100000:2.0:1788541305.999714:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541305.999939:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955936512 00000100:00100000:1.0:1788541305.999950:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955936512 00000100:00100000:1.0:1788541306.000011:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 41 00000100:00100000:1.0:1788541306.000021:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+21:15629:x1875420955936512:12345-192.168.202.56@tcp:54:lfs.0 00010000:00010000:1.0:1788541306.000089:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8ee3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541306.000106:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541306.000118:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541306.000167:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8ee3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541306.000173:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8ee3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541306.000180:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8ee3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541306.000185:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706956600 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541306.000189:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8ee3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541306.000196:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8ee3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541306.000208:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6835327200) 00010000:00010000:1.0:1788541306.000211:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788541306.000217:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8ee3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541306.000223:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8ee3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541306.000297:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+21:15629:x1875420955936512:12345-192.168.202.56@tcp:54:lfs.0 Request processed in 277us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541306.000305:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 41 00000100:00100000:2.0:1788541306.002574:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541306.002698:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955936640 00000100:00100000:3.0:1788541306.002706:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955936640 00000100:00100000:3.0:1788541306.002792:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 0 00000100:00100000:3.0:1788541306.002802:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+21:2396:x1875420955936640:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788541306.002818:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788541306.003095:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957600/0x2aac941e5f4a8ed5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331707 expref: 21 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541306.003113:0:17184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6835327200) 00010000:00010000:3.0:1788541306.003118:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788541306.003201:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+20:2396:x1875420955936640:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 400us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541306.003209:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 0 00000100:00100000:3.0:1788541306.007311:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541306.007620:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955936896 00000100:00100000:2.0:1788541306.007631:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955936896 00000100:00100000:2.0:1788541306.007720:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 7 00000100:00100000:2.0:1788541306.007731:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:16a226c0-f2f2-449b-91c5-316ce9e9c327+20:15629:x1875420955936896:12345-192.168.202.56@tcp:35:lfs.0 00000100:00100000:2.0:1788541306.007996:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:16a226c0-f2f2-449b-91c5-316ce9e9c327+21:15629:x1875420955936896:12345-192.168.202.56@tcp:35:lfs.0 Request processed in 266us (703us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788541306.008004:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 7 00000100:00100000:0.0:1788541306.152143:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541306.152188:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541306.152226:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541306.152343:0:19250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955937280 00000100:00100000:1.0:1788541306.152343:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955937024 00000100:00100000:3.0:1788541306.152353:0:19250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955937280 00000100:00100000:1.0:1788541306.152353:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955937024 00000100:00100000:3.0:1788541306.152399:0:19250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955937536 00000100:00100000:3.0:1788541306.152402:0:19250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955937536 00000100:00100000:1.0:1788541306.152403:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 163 00000100:00100000:1.0:1788541306.152419:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8172f99-f71c-41fa-8527-cb3efe1827fc+13:2397:x1875420955937024:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:3.0:1788541306.152421:0:19250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 12 00000100:00100000:3.0:1788541306.152427:0:19250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707819f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:16a226c0-f2f2-449b-91c5-316ce9e9c327+5:2397:x1875420955937280:12345-192.168.202.56@tcp:400:kworker.0 00000100:00080000:0.0:1788541306.152495:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788541306.152501:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 13 00000100:00100000:2.0:1788541306.152510:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707819500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74d244c9-cb0c-4783-8214-d6a87bde15a9+5:2397:x1875420955937536:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1788541306.152575:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8172f99-f71c-41fa-8527-cb3efe1827fc+13:2397:x1875420955937024:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 157us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541306.152584:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 163 00000100:00100000:3.0:1788541306.156068:0:19250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707819f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:16a226c0-f2f2-449b-91c5-316ce9e9c327+5:2397:x1875420955937280:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 3627us (3867us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541306.156084:0:19250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 12 00000100:00100000:3.0:1788541306.158182:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541306.158232:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541306.158745:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955937152 00000100:00100000:1.0:1788541306.158766:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955937152 00000100:00100000:1.0:1788541306.158840:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955937408 00000100:00100000:1.0:1788541306.158848:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955937408 00000100:00100000:1.0:1788541306.158897:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 14 00000100:00100000:1.0:1788541306.158905:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670831df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+5:2396:x1875420955937152:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1788541306.158974:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670831df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+5:2396:x1875420955937152:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 70us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541306.158982:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 14 00000100:00100000:1.0:1788541306.158998:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 15 00000100:00100000:1.0:1788541306.159004:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835589880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74d244c9-cb0c-4783-8214-d6a87bde15a9+5:2396:x1875420955937408:12345-192.168.202.56@tcp:400:kworker.0 00000100:00100000:1.0:1788541306.159027:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835589880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74d244c9-cb0c-4783-8214-d6a87bde15a9+5:2396:x1875420955937408:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 24us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541306.159034:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 15 00000100:00080000:3.0:1788541306.159857:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788541306.163713:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707819500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74d244c9-cb0c-4783-8214-d6a87bde15a9+5:2397:x1875420955937536:12345-192.168.202.56@tcp:400:kworker.0 Request processed in 11190us (11471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541306.163747:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 13 00000040:00080000:2.0:1788541306.189942:0:17231:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788541306.314166:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707818000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981183104:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788541306.314258:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541306.314300:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a683558b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981183232:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788541306.314325:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541306.314413:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981183104 00000100:00100000:3.0:1788541306.314414:0:18270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981183232 00000100:00100000:3.0:1788541306.314421:0:18270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981183232 00000100:00100000:0.0:1788541306.314421:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981183104 00000100:00100000:0.0:1788541306.314466:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788541306.314520:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6708310000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981183104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788541306.314554:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788541306.314604:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6708310000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981183104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 130us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541306.314688:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707818000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981183104:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788541306.321086:0:18270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788541306.321114:0:18270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981183232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788541306.321156:0:18270:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788541306.322618:0:18270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981183232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1512us (8285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541306.322642:0:18270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788541306.322894:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a683558b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981183232:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788541306.326561:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788541306.362040:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541306.366057:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955937792 00000100:00100000:1.0:1788541306.366077:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955937792 00000100:00100000:1.0:1788541306.366165:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 42 00000100:00100000:1.0:1788541306.366201:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a670781b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16a226c0-f2f2-449b-91c5-316ce9e9c327+21:15660:x1875420955937792:12345-192.168.202.56@tcp:101:cat.0 00010000:00010000:1.0:1788541306.366227:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541306.366247:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8eea lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a33170e expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541306.366373:0:17198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957600/0x2aac941e5f4a8ef1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541306.366389:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957600/0x2aac941e5f4a8ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541306.366404:0:17198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957600/0x2aac941e5f4a8ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788541306.366415:0:17198:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788541306.366539:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8eea lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33170e expref: 24 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541306.366557:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957600/0x2aac941e5f4a8ef1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33170e expref: 23 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541306.366566:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6835327200) 00010000:00010000:1.0:1788541306.366569:0:17198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788541306.366573:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6706957600, rc 0) 00000100:00100000:1.0:1788541306.366671:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a670781b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16a226c0-f2f2-449b-91c5-316ce9e9c327+23:15660:x1875420955937792:12345-192.168.202.56@tcp:101:cat.0 Request processed in 473us (4643us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1788541306.366678:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 42 00000100:00100000:0.0:1788541306.371632:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541306.371680:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541306.371753:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955938048 00000100:00100000:1.0:1788541306.371774:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955938048 00000100:00100000:1.0:1788541306.371863:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 8 00000100:00100000:1.0:1788541306.371911:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707818000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+23:15660:x1875420955938048:12345-192.168.202.56@tcp:35:cat.0 00000100:00100000:1.0:1788541306.372188:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707818000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+24:15660:x1875420955938048:12345-192.168.202.56@tcp:35:cat.0 Request processed in 303us (561us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1788541306.372196:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 8 00000100:00100000:2.0:1788541306.373204:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955938176 00000100:00100000:2.0:1788541306.373212:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955938176 00000100:00100000:2.0:1788541306.373268:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1 00000100:00100000:2.0:1788541306.373276:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16a226c0-f2f2-449b-91c5-316ce9e9c327+24:2395:x1875420955938176:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541306.373289:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541306.373322:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957600/0x2aac941e5f4a8ef1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33170e expref: 24 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541306.373340:0:17185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6835327200) 00010000:00010000:2.0:1788541306.373345:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541306.374497:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16a226c0-f2f2-449b-91c5-316ce9e9c327+23:2395:x1875420955938176:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 1214us (2808us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541306.374507:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1 00000040:00080000:1.0:1788541306.379241:0:17950:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788541306.453987:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541306.454092:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955938432 00000100:00100000:1.0:1788541306.454104:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955938432 00000100:00100000:1.0:1788541306.454167:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 43 00000100:00100000:1.0:1788541306.454188:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+23:15666:x1875420955938432:12345-192.168.202.56@tcp:101:dd.0 00010000:00010000:1.0:1788541306.454213:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541306.454236:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8eff lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331715 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541306.454350:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956000/0x2aac941e5f4a8f06 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541306.454366:0:17199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f800/0x2aac941e5f4a8ea4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3316f2 expref: 24 pid: 19663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541306.454375:0:17199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8eb9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a3316f9 expref: 24 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541306.454383:0:17199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956000/0x2aac941e5f4a8f06 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541306.454419:0:17199:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8eb9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3316f9 expref: 24 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541306.454454:0:17199:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8eb9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3316f9 expref: 24 pid: 17198 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541306.454469:0:17199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17199:1875420981183360:192.168.202.56@tcp:104: 00010000:00010000:1.0:1788541306.454572:0:17199:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f800/0x2aac941e5f4a8ea4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3316f2 expref: 24 pid: 19663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541306.454581:0:17199:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f800/0x2aac941e5f4a8ea4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3316f2 expref: 24 pid: 19663 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541306.454590:0:17199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17199:1875420981183488:192.168.202.56@tcp:104: 00000100:00100000:1.0:1788541306.454613:0:17199:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683f1a7e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788541306.458561:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541306.459083:0:17199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17199:1875420981183360:192.168.202.56@tcp:104: 00000100:00100000:1.0:1788541306.459099:0:17199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17199:1875420981183488:192.168.202.56@tcp:104: 00010000:00010000:1.0:1788541306.459128:0:17199:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956000/0x2aac941e5f4a8f06 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541306.461987:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541306.465439:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955938560 00000100:00100000:0.0:1788541306.465456:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955938560 00010000:00010000:0.0:1788541306.465518:0:17184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8eb9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3316f9 expref: 25 pid: 17198 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541306.465554:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955938688 00000100:00100000:0.0:1788541306.465557:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955938688 00010000:00010000:0.0:1788541306.465570:0:17184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f800/0x2aac941e5f4a8ea4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3316f2 expref: 26 pid: 19663 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541306.465597:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 17 00000100:00100000:0.0:1788541306.465607:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683558b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+26:2397:x1875420955938560:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788541306.465634:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541306.465641:0:17184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8eb9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3316f9 expref: 26 pid: 17198 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541306.465678:0:17184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8eb9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3316f9 expref: 26 pid: 17198 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541306.465710:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8eb9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3316f9 expref: 26 pid: 17198 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541306.465727:0:17184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6835327200) 00010000:00010000:0.0:1788541306.465732:0:17184:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956000/0x2aac941e5f4a8f06 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541306.465741:0:17184:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956000/0x2aac941e5f4a8f06 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541306.465748:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541306.465826:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683558b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+25:2397:x1875420955938560:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 219us (7274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541306.466035:0:17185:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788541306.466046:0:17185:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1788541306.466243:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 18 00000100:00100000:2.0:1788541306.466253:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68378a9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16a226c0-f2f2-449b-91c5-316ce9e9c327+25:2396:x1875420955938688:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541306.466263:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541306.466269:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f800/0x2aac941e5f4a8ea4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3316f2 expref: 25 pid: 19663 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541306.466294:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f800/0x2aac941e5f4a8ea4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3316f2 expref: 25 pid: 19663 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541306.466318:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f800/0x2aac941e5f4a8ea4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a3316f2 expref: 25 pid: 19663 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541306.466329:0:17185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6835327200) 00010000:00010000:2.0:1788541306.466333:0:17185:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956000/0x2aac941e5f4a8f06 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541306.466340:0:17185:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956000/0x2aac941e5f4a8f06 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541306.466348:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956000/0x2aac941e5f4a8f06 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541306.466372:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541306.466396:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68378a9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16a226c0-f2f2-449b-91c5-316ce9e9c327+24:2396:x1875420955938688:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 145us (4420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541306.466403:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 18 00010000:00010000:2.0:1788541306.466511:0:17199:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956000/0x2aac941e5f4a8f06 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541306.466519:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956000/0x2aac941e5f4a8f06 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788541306.466535:0:17199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788541306.466696:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8eff lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331715 expref: 25 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541306.466721:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956000/0x2aac941e5f4a8f06 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331715 expref: 24 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541306.466727:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6835327200) 00010000:00010000:2.0:1788541306.466730:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788541306.466732:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6706956000, rc 0) 00000100:00100000:2.0:1788541306.466786:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+24:15666:x1875420955938432:12345-192.168.202.56@tcp:101:dd.0 Request processed in 12581us (12782us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1788541306.466798:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 43 00000100:00100000:0.0:1788541306.467432:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 17 00000100:00100000:3.0:1788541306.469820:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541306.470055:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955938816 00000100:00100000:1.0:1788541306.470065:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955938816 00000100:00100000:1.0:1788541306.470130:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 44 00000100:00100000:1.0:1788541306.470142:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6835588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16a226c0-f2f2-449b-91c5-316ce9e9c327+23:15666:x1875420955938816:12345-192.168.202.56@tcp:101:dd.0 00010000:00010000:1.0:1788541306.470166:0:17198:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541306.470187:0:17198:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957400/0x2aac941e5f4a8f14 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a33171c expref: -99 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541306.470240:0:17198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957600/0x2aac941e5f4a8f1b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541306.470253:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957600/0x2aac941e5f4a8f1b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541306.470265:0:17198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957600/0x2aac941e5f4a8f1b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541306.470380:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957400/0x2aac941e5f4a8f14 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33171c expref: 25 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541306.470397:0:17198:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957600/0x2aac941e5f4a8f1b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33171c expref: 24 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541306.470406:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6835327200) 00010000:00010000:1.0:1788541306.470409:0:17198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788541306.470413:0:17198:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6706957600, rc 0) 00000100:00100000:1.0:1788541306.470587:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6835588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16a226c0-f2f2-449b-91c5-316ce9e9c327+24:15666:x1875420955938816:12345-192.168.202.56@tcp:101:dd.0 Request processed in 438us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541306.470594:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 44 00000100:00100000:2.0:1788541306.485286:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541306.485386:0:19663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955939072 00000100:00100000:0.0:1788541306.485399:0:19663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955939072 00000100:00100000:0.0:1788541306.485462:0:19663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 45 00000100:00100000:0.0:1788541306.485473:0:19663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16a226c0-f2f2-449b-91c5-316ce9e9c327+24:15666:x1875420955939072:12345-192.168.202.56@tcp:36:dd.0 00010000:00010000:0.0:1788541306.485740:0:19663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e400/0x2aac941e5f4a8f22 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541306.485769:0:19663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e400/0x2aac941e5f4a8f22 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541306.485782:0:19663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e400/0x2aac941e5f4a8f22 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788541306.485841:0:19663:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1788541306.485863:0:19663:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000037672659 reply state 000000001e8593a2 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e400/0x2aac941e5f4a8f22 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541306.485911:0:19663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e400/0x2aac941e5f4a8f22 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541306.485919:0:19663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6835327200) 00010000:00010000:0.0:1788541306.485921:0:19663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788541306.485925:0:19663:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788541306.486002:0:19663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16a226c0-f2f2-449b-91c5-316ce9e9c327+27:15666:x1875420955939072:12345-192.168.202.56@tcp:36:dd.0 Request processed in 531us (726us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1788541306.486010:0:19663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 45 00000020:00080000:0.0:1788541306.486014:0:19663:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788541306.488806:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541306.488903:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955939200 00000100:00100000:0.0:1788541306.488911:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955939200 00000100:00100000:0.0:1788541306.488961:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 46 00000100:00100000:0.0:1788541306.488971:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16a226c0-f2f2-449b-91c5-316ce9e9c327+27:15666:x1875420955939200:12345-192.168.202.56@tcp:101:dd.0 00010000:00010000:0.0:1788541306.488994:0:17200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541306.489016:0:17200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f800/0x2aac941e5f4a8f29 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331723 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541306.489067:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f800/0x2aac941e5f4a8f29 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331723 expref: 28 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541306.489081:0:17200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f800/0x2aac941e5f4a8f29 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331723 expref: 28 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541306.489120:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6835327200) 00010000:00010000:0.0:1788541306.489123:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788541306.489126:0:17200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75f800, rc 0) 00000100:00100000:0.0:1788541306.489186:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16a226c0-f2f2-449b-91c5-316ce9e9c327+28:15666:x1875420955939200:12345-192.168.202.56@tcp:101:dd.0 Request processed in 216us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541306.489193:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 46 00000100:00100000:3.0:1788541306.502294:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541306.502508:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955939456 00000100:00100000:2.0:1788541306.502518:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955939456 00000100:00100000:2.0:1788541306.502636:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 2 00000100:00100000:2.0:1788541306.502647:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683558ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16a226c0-f2f2-449b-91c5-316ce9e9c327+28:15666:x1875420955939456:12345-192.168.202.56@tcp:103:dd.0 00010000:00010000:2.0:1788541306.502663:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541306.502689:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f800/0x2aac941e5f4a8f29 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331723 expref: 28 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541306.502707:0:17185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6835327200) 00010000:00010000:2.0:1788541306.502711:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541306.502776:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683558ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:16a226c0-f2f2-449b-91c5-316ce9e9c327+27:15666:x1875420955939456:12345-192.168.202.56@tcp:103:dd.0 Request processed in 132us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541306.502784:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 2 00000100:00100000:2.0:1788541306.505396:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541306.505488:0:19663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955939584 00000100:00100000:0.0:1788541306.505496:0:19663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955939584 00000100:00100000:0.0:1788541306.505552:0:19663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 47 00000100:00100000:0.0:1788541306.505562:0:19663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16a226c0-f2f2-449b-91c5-316ce9e9c327+27:15666:x1875420955939584:12345-192.168.202.56@tcp:58:dd.0 00010000:00010000:0.0:1788541306.505681:0:19663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f400/0x2aac941e5f4a8f30 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541306.505698:0:19663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f400/0x2aac941e5f4a8f30 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541306.505710:0:19663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f400/0x2aac941e5f4a8f30 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788541306.507011:0:19663:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788541306.507321:0:19663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1788541306.507449:0:19663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1788541306.507643:0:19663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16a226c0-f2f2-449b-91c5-316ce9e9c327+27:15666:x1875420955939584:12345-192.168.202.56@tcp:58:dd.0 Request processed in 2077us (2251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541306.507655:0:19663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 47 00000100:00100000:3.0:1788541306.512568:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541306.512821:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955939712 00000100:00100000:0.0:1788541306.513037:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955939712 00000100:00100000:0.0:1788541306.513152:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 48 00000100:00100000:0.0:1788541306.513163:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683558b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16a226c0-f2f2-449b-91c5-316ce9e9c327+27:15666:x1875420955939712:12345-192.168.202.56@tcp:101:dd.0 00010000:00010000:0.0:1788541306.513185:0:17200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541306.513206:0:17200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fa00/0x2aac941e5f4a8f37 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a33172a expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541306.513262:0:17200:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f400/0x2aac941e5f4a8f30 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541306.513274:0:17200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fa00/0x2aac941e5f4a8f37 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33172a expref: 28 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541306.513295:0:17200:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f400/0x2aac941e5f4a8f30 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541306.513384:0:17200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fa00/0x2aac941e5f4a8f37 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33172a expref: 28 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541306.513398:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6835327200) 00010000:00010000:0.0:1788541306.513402:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788541306.513406:0:17200:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fa00/0x2aac941e5f4a8f37 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33172a expref: 28 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541306.513415:0:17200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75fa00, rc 0) 00000100:00100000:0.0:1788541306.513515:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683558b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16a226c0-f2f2-449b-91c5-316ce9e9c327+28:15666:x1875420955939712:12345-192.168.202.56@tcp:101:dd.0 Request processed in 354us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541306.513522:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 48 00010000:00010000:1.0:1788541306.698146:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788541307.210459:0:17231:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788541307.210469:0:17231:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788541307.210494:0:17231:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788541307.210504:0:17231:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788541307.210644:0:17231:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67082f8a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17231:1875420981183616:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788541307.210739:0:17231:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6807619e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788541307.214323:0:17231:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67082f8a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17231:1875420981183616:192.168.202.56@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788541307.223553:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541307.224158:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955939840 00000100:00100000:1.0:1788541307.224169:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955939840 00000100:00100000:1.0:1788541307.224249:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 49 00000100:00100000:1.0:1788541307.224260:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+28:15668:x1875420955939840:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788541307.224292:0:17199:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788541307.224433:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+28:15668:x1875420955939840:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 166us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541307.224441:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 49 00000100:00080000:3.0:1788541307.224911:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788541307.232667:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541307.233167:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955939968 00000100:00100000:1.0:1788541307.233177:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955939968 00000100:00100000:1.0:1788541307.233241:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 50 00000100:00100000:1.0:1788541307.233251:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a683558b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16a226c0-f2f2-449b-91c5-316ce9e9c327+28:15668:x1875420955939968:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788541307.233337:0:17198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957400/0x2aac941e5f4a8f3e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.233356:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957400/0x2aac941e5f4a8f3e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.233370:0:17198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957400/0x2aac941e5f4a8f3e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.233440:0:17198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8f45 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.233448:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8f45 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.233455:0:17198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8f45 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.233478:0:17198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8f4c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.233486:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8f4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.233493:0:17198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8f4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788541307.233554:0:17198:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788541307.233559:0:17198:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788541307.233585:0:17198:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8f4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.233596:0:17198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957400/0x2aac941e5f4a8f3e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.233601:0:17198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957400/0x2aac941e5f4a8f3e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.233607:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957400/0x2aac941e5f4a8f3e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.233613:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706957400 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541307.233618:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957400/0x2aac941e5f4a8f3e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.234390:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957400/0x2aac941e5f4a8f3e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.234404:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a68350c0000) 00010000:00010000:1.0:1788541307.234407:0:17198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541307.234412:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957400/0x2aac941e5f4a8f3e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.234419:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957400/0x2aac941e5f4a8f3e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.234433:0:17198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8f45 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.234453:0:17198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8f45 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.234458:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8f45 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.234463:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706956c00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541307.234466:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8f45 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.234472:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8f45 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.234480:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9a6803869c00) 00010000:00010000:1.0:1788541307.234483:0:17198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541307.234486:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8f45 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.234491:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956c00/0x2aac941e5f4a8f45 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.234506:0:17198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8f4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.234512:0:17198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8f4c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.234518:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8f4c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.234523:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706956600 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541307.234532:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8f4c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.234539:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8f4c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.234546:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6835327200) 00010000:00010000:1.0:1788541307.234549:0:17198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541307.234551:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8f4c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.234557:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706956600/0x2aac941e5f4a8f4c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541307.235178:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a683558b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16a226c0-f2f2-449b-91c5-316ce9e9c327+28:15668:x1875420955939968:12345-192.168.202.56@tcp:34:lhsmtool_posix.0 Request processed in 1923us (2515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541307.235189:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 50 00000100:00100000:2.0:1788541307.244160:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541307.244231:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955940224 00000100:00100000:1.0:1788541307.244242:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955940224 00000100:00100000:1.0:1788541307.244305:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 51 00000100:00100000:1.0:1788541307.244315:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67082f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+28:15668:x1875420955940224:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788541307.244339:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541307.244363:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173400/0x2aac941e5f4a8f53 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331731 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.244481:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173c00/0x2aac941e5f4a8f5a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.244497:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173c00/0x2aac941e5f4a8f5a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.244527:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173c00/0x2aac941e5f4a8f5a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788541307.244539:0:17199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788541307.244617:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173c00/0x2aac941e5f4a8f5a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.244639:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173c00/0x2aac941e5f4a8f5a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.244646:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173c00/0x2aac941e5f4a8f5a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.244653:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842173c00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541307.244657:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173c00/0x2aac941e5f4a8f5a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.244665:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173c00/0x2aac941e5f4a8f5a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.244678:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6835327200) 00010000:00010000:1.0:1788541307.244681:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788541307.244685:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173c00/0x2aac941e5f4a8f5a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.244692:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173c00/0x2aac941e5f4a8f5a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.244735:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173400/0x2aac941e5f4a8f53 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331731 expref: 30 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.244769:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a68350c0000) 00010000:00010000:1.0:1788541307.244771:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788541307.244776:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173400/0x2aac941e5f4a8f53 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331731 expref: 30 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.244786:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6842173400, rc 0) 00000100:00100000:1.0:1788541307.244859:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67082f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+29:15668:x1875420955940224:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 544us (708us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1788541307.244867:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 51 00000100:00100000:2.0:1788541307.250603:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541307.250672:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955940352 00000100:00100000:0.0:1788541307.250697:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955940352 00000100:00100000:0.0:1788541307.250767:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 52 00000100:00100000:0.0:1788541307.250778:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16a226c0-f2f2-449b-91c5-316ce9e9c327+29:15668:x1875420955940352:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788541307.250826:0:17200:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788541307.250991:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16a226c0-f2f2-449b-91c5-316ce9e9c327+29:15668:x1875420955940352:12345-192.168.202.56@tcp:53:lhsmtool_posix.0 Request processed in 213us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541307.251000:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 52 00000100:00100000:3.0:1788541307.257103:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541307.257169:0:19663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955940608 00000100:00100000:0.0:1788541307.257180:0:19663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955940608 00000100:00100000:0.0:1788541307.257248:0:19663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 53 00000100:00100000:0.0:1788541307.257260:0:19663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16a226c0-f2f2-449b-91c5-316ce9e9c327+29:15668:x1875420955940608:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788541307.257402:0:19663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541307.257425:0:19663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a8f68 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331738 expref: -99 pid: 19663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788541307.257824:0:19663:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x7:0x0], count =27 00000004:00080000:0.0:1788541307.258096:0:19663:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x7:0x0]+27 in llog 00000004:00080000:0.0:1788541307.258122:0:19663:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:0.0:1788541307.258354:0:19663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a8f6f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.258368:0:19663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a8f6f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.258377:0:19663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a8f6f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.258425:0:19663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a8f68 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331738 expref: 32 pid: 19663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.258455:0:19663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a8f6f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331738 expref: 31 pid: 19663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.258462:0:19663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a6835327e00) 00010000:00010000:0.0:1788541307.258464:0:19663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788541307.258466:0:19663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75ec00, rc 0) 00000100:00100000:0.0:1788541307.258521:0:19663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16a226c0-f2f2-449b-91c5-316ce9e9c327+31:15668:x1875420955940608:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 1262us (1426us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1788541307.258528:0:19663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 53 00000100:00100000:2.0:1788541307.266112:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541307.266211:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955940864 00000100:00100000:1.0:1788541307.266220:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955940864 00000100:00100000:1.0:1788541307.266365:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 54 00000100:00100000:1.0:1788541307.266376:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16a226c0-f2f2-449b-91c5-316ce9e9c327+31:15668:x1875420955940864:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788541307.266437:0:17198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788541307.266462:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ec00/0x2aac941e5f4a8f6f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331738 expref: 31 pid: 19663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.266480:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a6835327e00) 00010000:00010000:1.0:1788541307.266491:0:17198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788541307.266513:0:17198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173400/0x2aac941e5f4a8f7d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.266527:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173400/0x2aac941e5f4a8f7d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.266537:0:17198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173400/0x2aac941e5f4a8f7d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.266565:0:17198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173c00/0x2aac941e5f4a8f84 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x7c489b2d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.266572:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173c00/0x2aac941e5f4a8f84 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7c489b2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.266579:0:17198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173c00/0x2aac941e5f4a8f84 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7c489b2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.266622:0:17198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173400/0x2aac941e5f4a8f7d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.266629:0:17198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173400/0x2aac941e5f4a8f7d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.266635:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173400/0x2aac941e5f4a8f7d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.266641:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842173400 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541307.266645:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173400/0x2aac941e5f4a8f7d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.266654:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173400/0x2aac941e5f4a8f7d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.266662:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a6835327100) 00010000:00010000:1.0:1788541307.266665:0:17198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541307.266669:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173400/0x2aac941e5f4a8f7d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.266675:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173400/0x2aac941e5f4a8f7d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.266693:0:17198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173c00/0x2aac941e5f4a8f84 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7c489b2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.266698:0:17198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173c00/0x2aac941e5f4a8f84 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7c489b2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.266703:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173c00/0x2aac941e5f4a8f84 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7c489b2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.266707:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842173c00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541307.266710:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173c00/0x2aac941e5f4a8f84 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7c489b2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.266716:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173c00/0x2aac941e5f4a8f84 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x7c489b2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.266724:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x7c489b2d (ffff9a6803869c00) 00010000:00010000:1.0:1788541307.266725:0:17198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541307.266728:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173c00/0x2aac941e5f4a8f84 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x7c489b2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.266733:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173c00/0x2aac941e5f4a8f84 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x7c489b2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541307.266830:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16a226c0-f2f2-449b-91c5-316ce9e9c327+30:15668:x1875420955940864:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 456us (728us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788541307.266838:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 54 00000100:00100000:2.0:1788541307.269674:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541307.270075:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955940992 00000100:00100000:1.0:1788541307.270086:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955940992 00000100:00100000:1.0:1788541307.270147:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 55 00000100:00100000:1.0:1788541307.270175:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+30:15668:x1875420955940992:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788541307.270196:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541307.270218:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172600/0x2aac941e5f4a8f8b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a33173f expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.270378:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172400/0x2aac941e5f4a8f92 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.270395:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172400/0x2aac941e5f4a8f92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.270409:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172400/0x2aac941e5f4a8f92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.270520:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172600/0x2aac941e5f4a8f8b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33173f expref: 32 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.270540:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172400/0x2aac941e5f4a8f92 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33173f expref: 31 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.270550:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a6803869400) 00010000:00010000:1.0:1788541307.270552:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788541307.270556:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6842172400, rc 0) 00000100:00100000:1.0:1788541307.270611:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+31:15668:x1875420955940992:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 439us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541307.270618:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 55 00000100:00100000:3.0:1788541307.286185:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541307.286279:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955941248 00000100:00100000:1.0:1788541307.286290:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955941248 00000100:00100000:1.0:1788541307.286351:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 56 00000100:00100000:1.0:1788541307.286378:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16a226c0-f2f2-449b-91c5-316ce9e9c327+31:15668:x1875420955941248:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788541307.286466:0:17198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172a00/0x2aac941e5f4a8f99 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.286488:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172a00/0x2aac941e5f4a8f99 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.286501:0:17198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172a00/0x2aac941e5f4a8f99 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788541307.286673:0:17198:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:1.0:1788541307.286684:0:17198:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 588204812524ns, next at 589204810254ns, rc = 0 00000004:00010000:1.0:1788541307.286736:0:17198:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000712cd00d reply state 0000000027c2affc transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172a00/0x2aac941e5f4a8f99 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.286763:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172a00/0x2aac941e5f4a8f99 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.286771:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a6803869400) 00010000:00010000:1.0:1788541307.286774:0:17198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788541307.286777:0:17198:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788541307.286927:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16a226c0-f2f2-449b-91c5-316ce9e9c327+33:15668:x1875420955941248:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 551us (754us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1788541307.288382:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 56 00000100:00100000:2.0:1788541307.291635:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541307.293275:0:19663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955941376 00000100:00100000:0.0:1788541307.293347:0:19663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955941376 00000100:00100000:0.0:1788541307.293426:0:19663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 57 00000100:00100000:0.0:1788541307.293437:0:19663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16a226c0-f2f2-449b-91c5-316ce9e9c327+33:15668:x1875420955941376:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788541307.293459:0:19663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541307.293478:0:19663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a8fa0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331746 expref: -99 pid: 19663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.293534:0:19663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a8fa0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331746 expref: 34 pid: 19663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.293551:0:19663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a8fa0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331746 expref: 34 pid: 19663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.293568:0:19663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a6803869400) 00010000:00010000:0.0:1788541307.293688:0:19663:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788541307.293706:0:19663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75ee00, rc 0) 00000100:00100000:0.0:1788541307.293862:0:19663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16a226c0-f2f2-449b-91c5-316ce9e9c327+34:15668:x1875420955941376:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 426us (2236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541307.293905:0:19663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 57 00000100:00100000:2.0:1788541307.300461:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541307.300802:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955941504 00000100:00100000:1.0:1788541307.300816:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955941504 00000100:00100000:2.0:1788541307.301246:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 20 00000100:00100000:2.0:1788541307.301257:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+5:2396:x1875420955941504:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788541307.301618:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+6:2396:x1875420955941504:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 Request processed in 362us (1169us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788541307.301627:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 20 00000100:00100000:2.0:1788541307.305289:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541307.308410:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955941760 00000100:00100000:1.0:1788541307.308426:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955941760 00000100:00100000:1.0:1788541307.308501:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 9 00000100:00100000:1.0:1788541307.308512:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+34:15668:x1875420955941760:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788541307.309158:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+35:15668:x1875420955941760:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 645us (3876us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1788541307.309167:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 9 00000100:00100000:0.0:1788541307.312118:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541307.312214:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955942016 00000100:00100000:3.0:1788541307.312224:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955942016 00000100:00100000:3.0:1788541307.312373:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 58 00000100:00100000:3.0:1788541307.312384:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6705aa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16a226c0-f2f2-449b-91c5-316ce9e9c327+35:15668:x1875420955942016:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788541307.312495:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6705aa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16a226c0-f2f2-449b-91c5-316ce9e9c327+35:15668:x1875420955942016:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 113us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541307.312503:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 58 00000100:00100000:2.0:1788541307.315154:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541307.315229:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955942144 00000100:00100000:1.0:1788541307.315239:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955942144 00000100:00100000:1.0:1788541307.315352:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 59 00000100:00100000:1.0:1788541307.315363:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+35:15668:x1875420955942144:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788541307.315383:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541307.315404:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172600/0x2aac941e5f4a8fa7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a33174d expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.315497:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173c00/0x2aac941e5f4a8fae lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.315508:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173c00/0x2aac941e5f4a8fae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.315517:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173c00/0x2aac941e5f4a8fae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788541307.315551:0:17199:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788541307.315566:0:17199:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173c00/0x2aac941e5f4a8fae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.315596:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172600/0x2aac941e5f4a8fa7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33174d expref: 37 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.315611:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173c00/0x2aac941e5f4a8fae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33174d expref: 36 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.315626:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a6803869400) 00010000:00010000:1.0:1788541307.315628:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788541307.315631:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6842173c00, rc 0) 00000100:00100000:1.0:1788541307.315683:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+36:15668:x1875420955942144:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 323us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541307.315687:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 59 00000100:00100000:2.0:1788541307.318699:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541307.318779:0:19664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955942272 00000100:00100000:1.0:1788541307.318788:0:19664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955942272 00000100:00100000:1.0:1788541307.318849:0:19664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 21 00000100:00100000:1.0:1788541307.318859:0:19664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16a226c0-f2f2-449b-91c5-316ce9e9c327+6:2396:x1875420955942272:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788541307.318904:0:19664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788541307.318925:0:19664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6f0627c/0x2aac941e5f4a8fb5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331754 expref: -99 pid: 19664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788541307.318964:0:19664:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9af97b, blocks: 0x0 00010000:00010000:1.0:1788541307.318992:0:19664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=588s v=(0 0) 00010000:00010000:1.0:1788541307.318997:0:19664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788541307.319008:0:19664:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6f0627c/0x2aac941e5f4a8fb5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331754 expref: 7 pid: 19664 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.319026:0:19664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e6f0627c/0x2aac941e5f4a8fb5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331754 expref: 7 pid: 19664 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.319040:0:19664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a6842173400, rc 0) 00000100:00100000:1.0:1788541307.319116:0:19664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:16a226c0-f2f2-449b-91c5-316ce9e9c327+7:2396:x1875420955942272:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 258us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541307.319123:0:19664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 21 00000100:00100000:2.0:1788541307.321979:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541307.322121:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955942528 00000100:00100000:1.0:1788541307.322131:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955942528 00000100:00100000:1.0:1788541307.322189:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 60 00000100:00100000:1.0:1788541307.322201:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16a226c0-f2f2-449b-91c5-316ce9e9c327+36:15668:x1875420955942528:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788541307.322324:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16a226c0-f2f2-449b-91c5-316ce9e9c327+36:15668:x1875420955942528:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 124us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541307.322332:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 60 00000100:00100000:2.0:1788541307.324943:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541307.325080:0:19663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955942656 00000100:00100000:0.0:1788541307.325090:0:19663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955942656 00000100:00100000:0.0:1788541307.325148:0:19663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 61 00000100:00100000:0.0:1788541307.325157:0:19663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16a226c0-f2f2-449b-91c5-316ce9e9c327+36:15668:x1875420955942656:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788541307.327927:0:17178:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00010000:00010000:3.0:1788541307.328045:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a8dee lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541307.328061:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a8dee lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541307.328069:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a8dee lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541307.328076:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75fc00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541307.328081:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a8dee lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541307.328099:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a8dee lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541307.328116:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a6835327600) 00010000:00010000:3.0:1788541307.328119:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541307.328124:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a8dee lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541307.328131:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fc00/0x2aac941e5f4a8dee lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541307.328152:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f600/0x2aac941e5f4a8df5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541307.328158:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f600/0x2aac941e5f4a8df5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541307.328165:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f600/0x2aac941e5f4a8df5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541307.328170:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75f600 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541307.328172:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f600/0x2aac941e5f4a8df5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541307.328178:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f600/0x2aac941e5f4a8df5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541307.328185:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a6835327100) 00010000:00010000:3.0:1788541307.328188:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541307.328190:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f600/0x2aac941e5f4a8df5 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541307.328201:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f600/0x2aac941e5f4a8df5 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541307.328216:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e200/0x2aac941e5f4a8e9d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541307.328222:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e200/0x2aac941e5f4a8e9d lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541307.328228:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e200/0x2aac941e5f4a8e9d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541307.328233:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75e200 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541307.328235:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e200/0x2aac941e5f4a8e9d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541307.328242:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e200/0x2aac941e5f4a8e9d lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541307.328249:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a6835327500) 00010000:00010000:3.0:1788541307.328252:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541307.328254:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e200/0x2aac941e5f4a8e9d lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541307.328260:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e200/0x2aac941e5f4a8e9d lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541307.328274:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e400/0x2aac941e5f4a8f22 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541307.328280:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e400/0x2aac941e5f4a8f22 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541307.328442:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e400/0x2aac941e5f4a8f22 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541307.328448:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75e400 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541307.328450:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e400/0x2aac941e5f4a8f22 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541307.328456:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e400/0x2aac941e5f4a8f22 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541307.328465:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6835327200) 00010000:00010000:3.0:1788541307.328468:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788541307.328471:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e400/0x2aac941e5f4a8f22 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541307.328476:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e400/0x2aac941e5f4a8f22 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541307.328489:0:3628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172a00/0x2aac941e5f4a8f99 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541307.328495:0:3628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172a00/0x2aac941e5f4a8f99 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541307.328501:0:3628:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172a00/0x2aac941e5f4a8f99 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541307.328506:0:3628:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842172a00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:3.0:1788541307.328509:0:3628:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172a00/0x2aac941e5f4a8f99 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541307.328526:0:3628:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172a00/0x2aac941e5f4a8f99 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541307.328535:0:3628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a6803869400) 00010000:00010000:3.0:1788541307.328537:0:3628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788541307.328541:0:3628:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172a00/0x2aac941e5f4a8f99 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541307.328546:0:3628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172a00/0x2aac941e5f4a8f99 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788541307.328662:0:17178:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1788541307.328776:0:17178:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:2.0:1788541307.329101:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67088a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981183744:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788541307.329169:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788541307.329262:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981183744 00000100:00100000:1.0:1788541307.329269:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981183744 00000100:00100000:1.0:1788541307.329447:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788541307.329457:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875420981183744:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788541307.329596:0:18716:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788541307.329600:0:18716:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788541307.329602:0:18716:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788541307.329604:0:18716:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788541307 -> 1788541307 00002000:00010000:1.0:1788541307.329607:0:18716:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1788541307.329648:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3644:x1875420981183744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 192us (478us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788541307.329655:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000004:00080000:2.0:1788541307.329794:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a67088a0a80/2, rc 0, transno 8589934596 00000100:00100000:2.0:1788541307.329801:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67088a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3644:1875420981183744:0@lo:2:osp-syn-1-0.0 00000100:00080000:2.0:1788541307.329816:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788541307.330041:0:19663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:16a226c0-f2f2-449b-91c5-316ce9e9c327+15:15668:x1875420955942656:12345-192.168.202.56@tcp:44:lhsmtool_posix.0 Request processed in 4882us (5114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541307.330050:0:19663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 61 00010000:00010000:0.0:1788541307.332804:0:3627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a8e42 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.332824:0:3627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a8e42 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.332832:0:3627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a8e42 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.332838:0:3627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6706957e00 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541307.332843:0:3627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a8e42 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.332851:0:3627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a8e42 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.333096:0:3627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a6835327100) 00010000:00010000:0.0:1788541307.333101:0:3627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1788541307.333107:0:3627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a8e42 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.333115:0:3627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957e00/0x2aac941e5f4a8e42 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541307.334652:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541307.334798:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955942784 00000100:00100000:1.0:1788541307.334810:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955942784 00000100:00100000:1.0:1788541307.335124:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 23 00000100:00100000:1.0:1788541307.335136:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+7:2394:x1875420955942784:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788541307.335254:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+7:2394:x1875420955942784:12345-192.168.202.56@tcp:16:lhsmtool_posix.0 Request processed in 121us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541307.335262:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 23 00000100:00100000:3.0:1788541307.337765:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541307.338169:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955943040 00000100:00100000:2.0:1788541307.338179:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955943040 00000100:00100000:2.0:1788541307.338269:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 62 00000100:00100000:2.0:1788541307.338323:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16a226c0-f2f2-449b-91c5-316ce9e9c327+15:15668:x1875420955943040:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788541307.338380:0:17198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541307.338408:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842173c00/0x2aac941e5f4a8fae lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33174d expref: 15 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541307.338426:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a6803869400) 00010000:00010000:2.0:1788541307.338432:0:17198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788541307.338465:0:17198:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048e00/0x2aac941e5f4a8fbc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541307.338479:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048e00/0x2aac941e5f4a8fbc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541307.338488:0:17198:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048e00/0x2aac941e5f4a8fbc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788541307.338650:0:17198:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dcbe6ce7 reply state 0000000021dd30fe transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048e00/0x2aac941e5f4a8fbc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541307.338682:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048e00/0x2aac941e5f4a8fbc lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17198 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541307.338688:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a6803869400) 00010000:00010000:2.0:1788541307.338691:0:17198:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788541307.338694:0:17198:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788541307.338805:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16a226c0-f2f2-449b-91c5-316ce9e9c327+16:15668:x1875420955943040:12345-192.168.202.56@tcp:36:lhsmtool_posix.0 Request processed in 484us (1058us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1788541307.338813:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 62 00000100:00100000:3.0:1788541307.341825:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541307.341922:0:19250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955943168 00000100:00100000:0.0:1788541307.342278:0:19250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955943168 00000100:00100000:0.0:1788541307.342437:0:19250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 24 00000100:00100000:0.0:1788541307.342448:0:19250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:16a226c0-f2f2-449b-91c5-316ce9e9c327+7:15668:x1875420955943168:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788541307.342468:0:19250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788541307.342485:0:19250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d436e380/0x2aac941e5f4a8fc3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a33175b expref: -99 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.342516:0:19250:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e6f0627c/0x2aac941e5f4a8fb5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331754 expref: 8 pid: 19664 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.342525:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541307.342528:0:19250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541307.342533:0:19250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d436e380/0x2aac941e5f4a8fc3 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33175b expref: 8 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.342567:0:19250:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e6f0627c/0x2aac941e5f4a8fb5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331754 expref: 8 pid: 19664 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.342648:0:19250:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e6f0627c/0x2aac941e5f4a8fb5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331754 expref: 8 pid: 19664 timeout: 688 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541307.342663:0:19250:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706832d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:19250:1875420981183872:192.168.202.56@tcp:104: 00000100:00100000:0.0:1788541307.342757:0:19250:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a680431c480 going to sleep for 11 seconds 00000100:00100000:3.0:1788541307.346215:0:19250:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706832d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:19250:1875420981183872:192.168.202.56@tcp:104: 00010000:00010000:3.0:1788541307.346254:0:19250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d436e380/0x2aac941e5f4a8fc3 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xa16473202a33175b expref: 8 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541307.346274:0:19250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a682e75e200, rc 0) 00000100:00100000:3.0:1788541307.346353:0:19250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:16a226c0-f2f2-449b-91c5-316ce9e9c327+8:15668:x1875420955943168:12345-192.168.202.56@tcp:101:lhsmtool_posix.0 Request processed in 3906us (4536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541307.346363:0:19250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 24 00000100:00100000:3.0:1788541307.346465:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541307.346856:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955943296 00000100:00100000:0.0:1788541307.346864:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955943296 00010000:00010000:0.0:1788541307.346927:0:17184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e6f0627c/0x2aac941e5f4a8fb5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331754 expref: 8 pid: 19664 timeout: 688 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541307.347060:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 19 00000100:00100000:0.0:1788541307.347070:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+8:2396:x1875420955943296:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788541307.347084:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541307.347107:0:17184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e6f0627c/0x2aac941e5f4a8fb5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331754 expref: 8 pid: 19664 timeout: 688 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.347120:0:17184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e6f0627c/0x2aac941e5f4a8fb5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331754 expref: 8 pid: 19664 timeout: 688 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.347142:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6f0627c/0x2aac941e5f4a8fb5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331754 expref: 8 pid: 19664 timeout: 688 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.347158:0:17184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541307.347162:0:17184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541307.347168:0:17184:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d436e380/0x2aac941e5f4a8fc3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xa16473202a33175b expref: 7 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.347178:0:17184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d436e380/0x2aac941e5f4a8fc3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.56@tcp remote: 0xa16473202a33175b expref: 7 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.347213:0:17184:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d436e380/0x2aac941e5f4a8fc3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xa16473202a33175b expref: 7 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541307.347241:0:17184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706832d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:17184:1875420981184000:192.168.202.56@tcp:105: 00000100:00100000:0.0:1788541307.347403:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a680431c600 going to sleep for 11 seconds 00000100:00100000:0.0:1788541307.350066:0:17184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706832d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:17184:1875420981184000:192.168.202.56@tcp:105: 00010000:00010000:0.0:1788541307.350092:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541307.350138:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+7:2396:x1875420955943296:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 3070us (3672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541307.350149:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 19 00000100:00100000:2.0:1788541307.352834:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541307.353110:0:18718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955943424 00000100:00100000:1.0:1788541307.353120:0:18718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955943424 00000100:00100000:1.0:1788541307.353175:0:18718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 25 00000100:00100000:1.0:1788541307.353185:0:18718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16a226c0-f2f2-449b-91c5-316ce9e9c327+7:2397:x1875420955943424:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788541307.353332:0:18718:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788541307.353336:0:18718:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1788541306 00002000:00010000:1.0:1788541307.353339:0:18718:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1788541305 00002000:00010000:1.0:1788541307.353341:0:18718:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788541307 -> 1788541306 00002000:00010000:1.0:1788541307.353343:0:18718:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1788541307.353390:0:18718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16a226c0-f2f2-449b-91c5-316ce9e9c327+8:2397:x1875420955943424:12345-192.168.202.56@tcp:2:lhsmtool_posix.0 Request processed in 206us (565us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788541307.353397:0:18718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 25 00000100:00100000:1.0:1788541307.356321:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541307.356417:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955943552 00000100:00100000:2.0:1788541307.356427:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955943552 00000100:00100000:2.0:1788541307.356473:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 26 00000100:00100000:2.0:1788541307.356482:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68397f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+8:2394:x1875420955943552:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788541307.356526:0:18717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003d188245/0x2aac941e5f4a8fca lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541307.356544:0:18717:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d436e380/0x2aac941e5f4a8fc3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.56@tcp remote: 0xa16473202a33175b expref: 8 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541307.356552:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541307.356555:0:18717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788541307.356560:0:18717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d188245/0x2aac941e5f4a8fca lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541307.356605:0:18717:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d436e380/0x2aac941e5f4a8fc3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.56@tcp remote: 0xa16473202a33175b expref: 8 pid: 19250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541307.356631:0:18717:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d436e380/0x2aac941e5f4a8fc3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a33175b expref: 8 pid: 19250 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541307.356645:0:18717:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:18717:1875420981184128:192.168.202.56@tcp:104: 00000100:00100000:2.0:1788541307.356812:0:18717:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6807619000 going to sleep for 11 seconds 00000100:00100000:3.0:1788541307.360093:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541307.360261:0:18717:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:18717:1875420981184128:192.168.202.56@tcp:104: 00010000:00010000:2.0:1788541307.360288:0:18717:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003d188245/0x2aac941e5f4a8fca lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541307.360376:0:20350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955943680 00000100:00100000:0.0:1788541307.360383:0:20350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955943680 00010000:00010000:0.0:1788541307.360419:0:20350:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d436e380/0x2aac941e5f4a8fc3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a33175b expref: 9 pid: 19250 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541307.360459:0:20350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 20 00000100:00100000:0.0:1788541307.360468:0:20350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16a226c0-f2f2-449b-91c5-316ce9e9c327+9:2397:x1875420955943680:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788541307.360483:0:20350:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541307.360504:0:20350:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d436e380/0x2aac941e5f4a8fc3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a33175b expref: 9 pid: 19250 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.360517:0:20350:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d436e380/0x2aac941e5f4a8fc3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a33175b expref: 9 pid: 19250 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.360540:0:20350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d436e380/0x2aac941e5f4a8fc3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.56@tcp remote: 0xa16473202a33175b expref: 9 pid: 19250 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.360590:0:20350:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788541307.360595:0:20350:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788541307.360600:0:20350:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003d188245/0x2aac941e5f4a8fca lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.360609:0:20350:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d188245/0x2aac941e5f4a8fca lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.360642:0:20350:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541307.360701:0:20350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16a226c0-f2f2-449b-91c5-316ce9e9c327+8:2397:x1875420955943680:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 234us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541307.360709:0:20350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 20 00010000:00010000:1.0:1788541307.360904:0:18717:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003d188245/0x2aac941e5f4a8fca lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.360914:0:18717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d188245/0x2aac941e5f4a8fca lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.360945:0:18717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003d188245/0x2aac941e5f4a8fca lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.360966:0:18717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d188245/0x2aac941e5f4a8fca lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.360974:0:18717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d188245/0x2aac941e5f4a8fca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.360981:0:18717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842049600 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:1.0:1788541307.360985:0:18717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d188245/0x2aac941e5f4a8fca lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.360994:0:18717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d188245/0x2aac941e5f4a8fca lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.361007:0:18717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d188245/0x2aac941e5f4a8fca lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.361014:0:18717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d188245/0x2aac941e5f4a8fca lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541307.361063:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68397f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+7:2394:x1875420955943552:12345-192.168.202.56@tcp:1:lhsmtool_posix.0 Request processed in 4580us (4750us total) trans 0 rc 0/0 00000100:00100000:1.0:1788541307.361071:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 26 00000100:00100000:0.0:1788541307.368718:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541307.368840:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955943936 00000100:00100000:1.0:1788541307.368850:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955943936 00000100:00100000:2.0:1788541307.369096:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 63 00000100:00100000:2.0:1788541307.369109:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+16:15668:x1875420955943936:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788541307.369193:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048400/0x2aac941e5f4a8fd1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541307.369210:0:17199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957600/0x2aac941e5f4a8f1b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33171c expref: 16 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541307.369218:0:17199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048400/0x2aac941e5f4a8fd1 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541307.369250:0:17199:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957600/0x2aac941e5f4a8f1b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33171c expref: 16 pid: 17198 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541307.369263:0:17199:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957600/0x2aac941e5f4a8f1b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33171c expref: 16 pid: 17198 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541307.369309:0:17199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17199:1875420981184256:192.168.202.56@tcp:104: 00000100:00100000:2.0:1788541307.369396:0:17199:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a6807619000 going to sleep for 11 seconds 00000100:00100000:1.0:1788541307.372903:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541307.373056:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955944064 00000100:00100000:0.0:1788541307.373067:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955944064 00010000:00010000:0.0:1788541307.373108:0:17183:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957600/0x2aac941e5f4a8f1b lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33171c expref: 17 pid: 17198 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541307.373151:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 21 00000100:00100000:0.0:1788541307.373160:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16a226c0-f2f2-449b-91c5-316ce9e9c327+17:2396:x1875420955944064:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788541307.373173:0:17183:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788541307.373180:0:17183:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957600/0x2aac941e5f4a8f1b lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33171c expref: 17 pid: 17198 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.373194:0:17183:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957600/0x2aac941e5f4a8f1b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33171c expref: 17 pid: 17198 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.373226:0:17183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6835327200) 00010000:00010000:0.0:1788541307.373232:0:17183:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fa00/0x2aac941e5f4a8f37 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33172a expref: 17 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.373243:0:17183:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048400/0x2aac941e5f4a8fd1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.373251:0:17183:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048400/0x2aac941e5f4a8fd1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.373258:0:17183:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048400/0x2aac941e5f4a8fd1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.373278:0:17183:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788541307.373342:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16a226c0-f2f2-449b-91c5-316ce9e9c327+17:2396:x1875420955944064:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 183us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541307.373350:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 21 00010000:00010000:2.0:1788541307.374026:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6706957600/0x2aac941e5f4a8f1b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a33171c expref: 16 pid: 17198 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541307.374045:0:17199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17199:1875420981184256:192.168.202.56@tcp:104: 00010000:00010000:2.0:1788541307.374065:0:17199:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048400/0x2aac941e5f4a8fd1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541307.374074:0:17199:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048400/0x2aac941e5f4a8fd1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541307.374080:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048400/0x2aac941e5f4a8fd1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541307.374275:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a8fd8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541307.374288:0:17199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a8fa0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331746 expref: 16 pid: 19663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541307.375531:0:17199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a8fd8 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541307.375586:0:17199:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a8fa0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331746 expref: 16 pid: 19663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541307.375600:0:17199:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a8fa0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331746 expref: 16 pid: 19663 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541307.375627:0:17199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17199:1875420981184384:192.168.202.56@tcp:104: 00000100:00100000:2.0:1788541307.375726:0:17199:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a68076199c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788541307.384110:0:17199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17199:1875420981184384:192.168.202.56@tcp:104: 00000100:00100000:1.0:1788541307.384130:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00010000:00010000:2.0:1788541307.384144:0:17199:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a8fd8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541307.389386:0:20350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955944192 00000100:00100000:0.0:1788541307.389406:0:20350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955944192 00010000:00010000:2.0:1788541307.389512:0:20350:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a8fa0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331746 expref: 17 pid: 19663 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541307.389566:0:20350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 22 00000100:00100000:2.0:1788541307.389586:0:20350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16a226c0-f2f2-449b-91c5-316ce9e9c327+17:2397:x1875420955944192:12345-192.168.202.56@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788541307.389602:0:20350:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788541307.389609:0:20350:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a8fa0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331746 expref: 17 pid: 19663 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541307.389623:0:20350:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a8fa0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331746 expref: 17 pid: 19663 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541307.389646:0:20350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75ee00/0x2aac941e5f4a8fa0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.56@tcp remote: 0xa16473202a331746 expref: 17 pid: 19663 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541307.389662:0:20350:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a6803869400) 00010000:00010000:2.0:1788541307.389667:0:20350:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a8fd8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541307.389695:0:20350:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a8fd8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541307.389702:0:20350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a8fd8 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541307.389736:0:20350:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788541307.389813:0:20350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:16a226c0-f2f2-449b-91c5-316ce9e9c327+16:2397:x1875420955944192:12345-192.168.202.56@tcp:103:ldlm_bl.0 Request processed in 229us (5682us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541307.389820:0:20350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 22 00010000:00010000:0.0:1788541307.390093:0:17199:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a8fd8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.390102:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a8fd8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788541307.390218:0:17199:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1788541307.390344:0:17199:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1788541307.390397:0:17199:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1788541307.390475:0:17199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706831500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17199:1875420981184512:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788541307.390822:0:17199:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541307.390953:0:17199:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a683543ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788541307.393632:0:18270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981184512 00000100:00100000:3.0:1788541307.393664:0:18270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981184512 00000100:00100000:2.0:1788541307.393803:0:18270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788541307.393816:0:18270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6706830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17199:x1875420981184512:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788541307.393988:0:18270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17199:x1875420981184512:12345-0@lo:1000:mdt00_001.0 Request processed in 174us (3165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541307.393996:0:18270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788541307.394021:0:17199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706831500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17199:1875420981184512:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1788541307.394252:0:17199:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1788541307.394326:0:17199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6706831500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17199:1875420981184640:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788541307.394389:0:17199:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788541307.394420:0:17199:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a680431c480 going to sleep for 11 seconds 00000100:00100000:3.0:1788541307.394613:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981184640 00000100:00100000:3.0:1788541307.394618:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981184640 00000100:00100000:3.0:1788541307.394655:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788541307.394664:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17199:x1875420981184640:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788541307.394801:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707887480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17199:x1875420981184640:12345-0@lo:1000:mdt00_001.0 Request processed in 137us (411us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1788541307.394808:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788541307.394978:0:17199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6706831500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17199:1875420981184640:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788541307.395018:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a8fd8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.395028:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a8fd8 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.395037:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a8fd8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.395043:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842049000 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541307.395048:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a8fd8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.395057:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a8fd8 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.395073:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a6803869400) 00010000:00010000:0.0:1788541307.395075:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788541307.395080:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a8fd8 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.395087:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842049000/0x2aac941e5f4a8fd8 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.395125:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f400/0x2aac941e5f4a8f30 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.395132:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f400/0x2aac941e5f4a8f30 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.395137:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f400/0x2aac941e5f4a8f30 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.395142:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75f400 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:0.0:1788541307.395145:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f400/0x2aac941e5f4a8f30 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.395150:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f400/0x2aac941e5f4a8f30 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.395157:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6835327200) 00010000:00010000:0.0:1788541307.395159:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788541307.395166:0:17199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fa00/0x2aac941e5f4a8f37 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33172a expref: 19 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.395176:0:17199:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fa00/0x2aac941e5f4a8f37 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33172a expref: 19 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.395186:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fa00/0x2aac941e5f4a8f37 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33172a expref: 19 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.395249:0:17199:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75fa00/0x2aac941e5f4a8f37 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a33172a expref: 19 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541307.395282:0:17199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707886a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17199:1875420981184768:192.168.202.56@tcp:105: 00000100:00100000:0.0:1788541307.395352:0:17199:0:(client.c:2716:ptlrpc_set_wait()) set ffff9a680431c480 going to sleep for 11 seconds 00000100:00100000:1.0:1788541307.399843:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541307.399894:0:17199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707886a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17199:1875420981184768:192.168.202.56@tcp:105: 00010000:00010000:0.0:1788541307.399924:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f400/0x2aac941e5f4a8f30 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.399935:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75f400/0x2aac941e5f4a8f30 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 19663 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788541307.399964:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955944320 00000100:00100000:3.0:1788541307.399970:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955944320 00000100:00100000:3.0:1788541307.400027:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 10 00000100:00100000:3.0:1788541307.400036:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68420d8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:16a226c0-f2f2-449b-91c5-316ce9e9c327+20:15666:x1875420955944320:12345-192.168.202.56@tcp:49:dd.0 00000100:00100000:3.0:1788541307.400171:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68420d8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:16a226c0-f2f2-449b-91c5-316ce9e9c327+20:15666:x1875420955944320:12345-192.168.202.56@tcp:49:dd.0 Request processed in 135us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541307.400179:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 10 00010000:00010000:1.0:1788541307.400263:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a8fdf lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.400279:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a8fdf lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.400290:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a8fdf lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.400311:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a8fdf lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.400318:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a8fdf lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.400324:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a8fdf lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.400330:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842172000 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541307.400333:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a8fdf lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.400339:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a8fdf lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.400351:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6835327200) 00010000:00010000:1.0:1788541307.400353:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788541307.400357:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a8fdf lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.400363:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842172000/0x2aac941e5f4a8fdf lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.400389:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048400/0x2aac941e5f4a8fd1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.400395:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048400/0x2aac941e5f4a8fd1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.400401:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048400/0x2aac941e5f4a8fd1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.400405:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842048400 already unused, calling callback (ffffffffc1b204f0) 00010000:00010000:1.0:1788541307.400408:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048400/0x2aac941e5f4a8fd1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.400414:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048400/0x2aac941e5f4a8fd1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.400422:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6835327200) 00010000:00010000:1.0:1788541307.400424:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788541307.400426:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048400/0x2aac941e5f4a8fd1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788541307.400431:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a6842048400/0x2aac941e5f4a8fd1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788541307.400565:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6706832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+19:15668:x1875420955943936:12345-192.168.202.56@tcp:57:lhsmtool_posix.0 Request processed in 31458us (31857us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1788541307.400692:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 63 00000020:00080000:1.0:1788541307.400696:0:17199:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788541307.401287:0:17231:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788541307.401302:0:17231:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788541307.401322:0:17231:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788541307.401327:0:17231:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000040:00080000:0.0:1788541307.402574:0:17950:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788541307.407652:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:0.0:1788541307.407770:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955944576 00000100:00100000:0.0:1788541307.407782:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955944576 00000100:00100000:0.0:1788541307.407847:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 11 00000100:00100000:0.0:1788541307.407857:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+19:15668:x1875420955944576:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788541307.408164:0:17202:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788541307.408194:0:17202:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1788541307.408225:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a8fe6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.408255:0:17202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a8fe6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.408267:0:17202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a8fe6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.408276:0:17202:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a8fe6 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.408303:0:17202:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a8fe6 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.408310:0:17202:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a8fe6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.408331:0:17202:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788541307.408387:0:19546:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788541307.408394:0:19546:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a8fe6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541307.408401:0:19546:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75e600 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:3.0:1788541307.408405:0:19546:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a8fe6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541307.408412:0:19546:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a8fe6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541307.408425:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+21:15668:x1875420955944576:12345-192.168.202.56@tcp:35:lhsmtool_posix.0 Request processed in 569us (785us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1788541307.408433:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 11 00010000:00010000:3.0:1788541307.408434:0:19546:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a6803869400) 00010000:00010000:3.0:1788541307.408437:0:19546:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000020:00080000:0.0:1788541307.408437:0:17202:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788541307.408442:0:19546:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a8fe6 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541307.408447:0:19546:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a682e75e600/0x2aac941e5f4a8fe6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17202 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541307.408461:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541307.408464:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541307.408465:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541307.415834:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:3.0:1788541307.415969:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955944704 00000100:00100000:3.0:1788541307.415978:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955944704 00000100:00100000:3.0:1788541307.416035:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 64 00000100:00100000:3.0:1788541307.416043:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16a226c0-f2f2-449b-91c5-316ce9e9c327+21:15666:x1875420955944704:12345-192.168.202.56@tcp:101:dd.0 00010000:00010000:3.0:1788541307.416068:0:17200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788541307.416088:0:17200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68043cc800/0x2aac941e5f4a8fed lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa16473202a331762 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541307.416121:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68043cdc00/0x2aac941e5f4a8ff4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541307.416135:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a68043cdc00/0x2aac941e5f4a8ff4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541307.416146:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a68043cdc00/0x2aac941e5f4a8ff4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541307.416254:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a68043cc800/0x2aac941e5f4a8fed lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331762 expref: 23 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541307.416282:0:17200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a68043cdc00/0x2aac941e5f4a8ff4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.56@tcp remote: 0xa16473202a331762 expref: 22 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541307.416310:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a6835327200) 00010000:00010000:3.0:1788541307.416313:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788541307.416316:0:17200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a68043cdc00, rc 0) 00000100:00100000:3.0:1788541307.416373:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16a226c0-f2f2-449b-91c5-316ce9e9c327+22:15666:x1875420955944704:12345-192.168.202.56@tcp:101:dd.0 Request processed in 330us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541307.416380:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 64 00000100:00100000:1.0:1788541307.608263:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:1.0:1788541307.608487:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.56@tcp (source: 12345-192.168.202.56@tcp) 00000100:00100000:2.0:1788541307.608657:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955944960 00000100:00100000:2.0:1788541307.608677:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955944960 00000100:00100000:2.0:1788541307.608787:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420955944832 00000100:00100000:2.0:1788541307.608792:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420955944832 00000100:00100000:0.0:1788541307.608913:0:18723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 0 00000100:00100000:0.0:1788541307.608926:0:18723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+8:2394:x1875420955944960:12345-192.168.202.56@tcp:4:dd.0 00002000:00010000:0.0:1788541307.608981:0:18723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a9af97a, atime: 0x6a9af979, ctime: 0x6a9af97a, blocks: 0x0 00010000:00010000:0.0:1788541307.608990:0:18723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011719250/0x2aac941e5f4a8ffb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.609007:0:18723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=588s v=(0 0) 00010000:00010000:0.0:1788541307.609011:0:18723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788541307.609018:0:18723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011719250/0x2aac941e5f4a8ffb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788541307.609033:0:18723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011719250/0x2aac941e5f4a8ffb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788541307.685761:0:19530:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:0.0:1788541307.685799:0:19530:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:2.0:1788541307.688678:0:18723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:2.0:1788541307.688688:0:18723:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1788541306 -> 1788541307 00002000:00010000:2.0:1788541307.688690:0:18723:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788541306 -> 1788541307 00002000:00010000:2.0:1788541307.688692:0:18723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:2.0:1788541307.688710:0:18723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011719250/0x2aac941e5f4a8ffb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541307.688786:0:18723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011719250/0x2aac941e5f4a8ffb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541307.688796:0:18723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011719250/0x2aac941e5f4a8ffb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541307.688803:0:18723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a682e75ec00 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:2.0:1788541307.688809:0:18723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011719250/0x2aac941e5f4a8ffb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541307.688818:0:18723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011719250/0x2aac941e5f4a8ffb lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541307.688837:0:18723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011719250/0x2aac941e5f4a8ffb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541307.688845:0:18723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011719250/0x2aac941e5f4a8ffb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788541307.689191:0:18723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+6:2394:x1875420955944960:12345-192.168.202.56@tcp:4:dd.0 Request processed in 80262us (80935us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788541307.689202:0:18723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 0 00000100:00100000:2.0:1788541307.689406:0:18723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.56@tcp, seq: 1 00000100:00100000:2.0:1788541307.689420:0:18723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67088a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+5:2394:x1875420955944832:12345-192.168.202.56@tcp:4:dd.0 00002000:00010000:2.0:1788541307.689470:0:18723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 7654321, mtime: 0x6a9af97b, atime: 0x6a9af979, ctime: 0x6a9af97b, blocks: 0x1a68 00010000:00010000:2.0:1788541307.689484:0:18723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d1fd243/0x2aac941e5f4a9002 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541307.689496:0:18723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=588s v=(0 0) 00010000:00010000:2.0:1788541307.689500:0:18723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788541307.689506:0:18723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d1fd243/0x2aac941e5f4a9002 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541307.689518:0:18723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d1fd243/0x2aac941e5f4a9002 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788541307.722007:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788541307.760131:0:19530:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:2.0:1788541307.762023:0:18723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:2.0:1788541307.762045:0:18723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d1fd243/0x2aac941e5f4a9002 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541307.762058:0:18723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d1fd243/0x2aac941e5f4a9002 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541307.762067:0:18723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d1fd243/0x2aac941e5f4a9002 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541307.762073:0:18723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a6842048400 already unused, calling callback (ffffffffc0f124f0) 00010000:00010000:2.0:1788541307.762078:0:18723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d1fd243/0x2aac941e5f4a9002 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541307.762087:0:18723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d1fd243/0x2aac941e5f4a9002 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541307.762124:0:18723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d1fd243/0x2aac941e5f4a9002 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788541307.762132:0:18723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d1fd243/0x2aac941e5f4a9002 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788541307.762404:0:18723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67088a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:16a226c0-f2f2-449b-91c5-316ce9e9c327+5:2394:x1875420955944832:12345-192.168.202.56@tcp:4:dd.0 Request processed in 72982us (153910us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788541307.762415:0:18723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.56@tcp, seq: 1 00000100:00100000:3.0:1788541307.850313:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4746c063-6c88-4476-b99b-02bb8e8d54f7:3641:1875420981184896:0@lo:400:kworker.0 00000100:00100000:3.0:1788541307.850380:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541307.850415:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707887100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981185408:0@lo:400:kworker.0 00000100:00100000:3.0:1788541307.850433:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541307.850453:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707886680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875420981185920:0@lo:400:kworker.0 00000100:00100000:3.0:1788541307.850477:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541307.850500:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788541307.850504:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707886300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981185024:0@lo:400:kworker.0 00000100:00100000:3.0:1788541307.850520:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541307.850530:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981185536:0@lo:400:kworker.0 00000100:00100000:3.0:1788541307.850543:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541307.850552:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707884380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875420981186048:0@lo:400:kworker.0 00000100:00100000:3.0:1788541307.850562:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541307.850594:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981185408 00000100:00100000:3.0:1788541307.850612:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981185408 00000100:00100000:3.0:1788541307.850645:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981185024 00000100:00100000:3.0:1788541307.850646:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981185024 00000100:00100000:3.0:1788541307.850656:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788541307.850661:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981185408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541307.850700:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981185408:12345-0@lo:400:kworker.0 Request processed in 40us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541307.850705:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788541307.850716:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788541307.850719:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981185024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541307.850734:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1875420981185024:12345-0@lo:400:kworker.0 Request processed in 15us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541307.850738:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788541307.850815:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707886300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3641:1875420981185024:0@lo:400:kworker.0 00000100:00100000:3.0:1788541307.850822:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707887100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981185408:0@lo:400:kworker.0 00000100:00100000:3.0:1788541307.850846:0:19250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981185536 00000100:00100000:3.0:1788541307.850849:0:19250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981185536 00000100:00100000:3.0:1788541307.850909:0:19250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788541307.850916:0:19250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981185536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541307.850950:0:19250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1875420981185536:12345-0@lo:400:kworker.0 Request processed in 36us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541307.850955:0:19250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1788541307.850967:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788541307.850981:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707885c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3641:1875420981185536:0@lo:400:kworker.0 00000100:00100000:3.0:1788541307.850993:0:19663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981185920 00000100:00100000:3.0:1788541307.850995:0:19663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981185920 00000100:00080000:3.0:1788541307.851016:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788541307.851037:0:19663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981186048 00000100:00100000:3.0:1788541307.851041:0:19663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981186048 00000100:00080000:3.0:1788541307.851051:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788541307.851060:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788541307.851066:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875420981185920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541307.851091:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1875420981185920:12345-0@lo:400:kworker.0 Request processed in 26us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541307.851094:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788541307.851112:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707886680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3641:1875420981185920:0@lo:400:kworker.0 00000100:00100000:3.0:1788541307.851130:0:19663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788541307.851134:0:19663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875420981186048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788541307.851153:0:19663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1875420981186048:12345-0@lo:400:kworker.0 Request processed in 20us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541307.851157:0:19663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:3.0:1788541307.851171:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707884380 x1875420981186048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788541307.851178:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707884380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3641:1875420981186048:0@lo:400:kworker.0 00000100:00100000:2.0:1788541307.851383:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707885500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981185152:0@lo:400:kworker.0 00000100:00100000:2.0:1788541307.851408:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541307.851431:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707885180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981185664:0@lo:400:kworker.0 00000100:00100000:2.0:1788541307.851449:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541307.851466:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707884000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875420981186176:0@lo:400:kworker.0 00000100:00100000:2.0:1788541307.851490:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541307.851508:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788541307.851512:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875420981185280:0@lo:400:kworker.0 00000100:00100000:2.0:1788541307.851528:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541307.851537:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707884a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875420981185792:0@lo:400:kworker.0 00000100:00100000:2.0:1788541307.851548:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541307.851553:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707885880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875420981186304:0@lo:400:kworker.0 00000100:00100000:2.0:1788541307.851574:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541307.851600:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981185152 00000100:00100000:2.0:1788541307.851602:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981185152 00000100:00100000:2.0:1788541307.851623:0:18716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981185664 00000100:00100000:2.0:1788541307.851625:0:18716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981185664 00000100:00100000:2.0:1788541307.851636:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788541307.851640:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981185152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541307.851670:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3643:x1875420981185152:12345-0@lo:400:kworker.0 Request processed in 30us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541307.851675:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788541307.851683:0:18716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788541307.851686:0:18716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981185664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541307.851701:0:18716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981185664:12345-0@lo:400:kworker.0 Request processed in 15us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541307.851705:0:18716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1788541307.851712:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788541307.851714:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788541307.851727:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707885500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3643:1875420981185152:0@lo:400:kworker.0 00000100:00100000:2.0:1788541307.851733:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707885180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981185664:0@lo:400:kworker.0 00000100:00100000:2.0:1788541307.851763:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981186176 00000100:00100000:2.0:1788541307.851766:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981186176 00000100:00100000:2.0:1788541307.851787:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981185280 00000100:00100000:2.0:1788541307.851790:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981185280 00000100:00100000:2.0:1788541307.851799:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981185792 00000100:00100000:2.0:1788541307.851801:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981185792 00000100:00100000:2.0:1788541307.851810:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981186304 00000100:00100000:2.0:1788541307.851812:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981186304 00000100:00100000:2.0:1788541307.851821:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788541307.851824:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875420981186176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541307.851854:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1875420981186176:12345-0@lo:400:kworker.0 Request processed in 29us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541307.851861:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788541307.851902:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788541307.851909:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875420981185280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541307.851943:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1875420981185280:12345-0@lo:400:kworker.0 Request processed in 35us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541307.851947:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788541307.851957:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788541307.851960:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875420981185792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541307.851977:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1875420981185792:12345-0@lo:400:kworker.0 Request processed in 17us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541307.851980:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788541307.851986:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788541307.851989:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875420981186304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788541307.852005:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1875420981186304:12345-0@lo:400:kworker.0 Request processed in 15us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541307.852010:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1788541307.852022:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788541307.852025:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788541307.852039:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3643:1875420981185280:0@lo:400:kworker.0 00000100:00100000:2.0:1788541307.852048:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707884a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3643:1875420981185792:0@lo:400:kworker.0 00010000:00080000:2.0:1788541307.852058:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9a6707885880 x1875420981186304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788541323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788541307.852066:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707885880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3643:1875420981186304:0@lo:400:kworker.0 00000100:00100000:2.0:1788541307.852073:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707884000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3643:1875420981186176:0@lo:400:kworker.0 00000100:00100000:0.0:1788541307.852215:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981184896 00000100:00100000:0.0:1788541307.852219:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981184896 00000100:00100000:0.0:1788541307.852250:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788541307.852255:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a6707bb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+24:3641:x1875420981184896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788541307.852316:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a6707bb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4746c063-6c88-4476-b99b-02bb8e8d54f7+24:3641:x1875420981184896:12345-0@lo:400:kworker.0 Request processed in 60us (1935us total) trans 0 rc 0/0 00000100:00100000:0.0:1788541307.852323:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788541307.852518:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4746c063-6c88-4476-b99b-02bb8e8d54f7:3641:1875420981184896:0@lo:400:kworker.0 00000100:00100000:3.0:1788541307.852722:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788541307.852730:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a67078edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981186432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788541307.852770:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541307.852805:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981186432 00000100:00100000:3.0:1788541307.852810:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981186432 00000100:00100000:3.0:1788541307.852837:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788541307.852843:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981186432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788541307.852866:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788541307.852931:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981186432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541307.852938:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788541307.852967:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a67078edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981186432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788541307.853083:0:3642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981186560:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788541307.853100:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788541307.853151:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981186560 00000100:00100000:2.0:1788541307.853159:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981186560 00000100:00100000:2.0:1788541307.853182:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788541307.853186:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a67078edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981186560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788541307.853196:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3923505152 avail 3684278272 00000100:00100000:2.0:1788541307.853219:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a67078edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1875420981186560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 33us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788541307.853222:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788541307.853276:0:3642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:3.0:1788541307.853281:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a67088a0a80, transno 8589934596 00000004:00080000:3.0:1788541307.853312:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:3.0:1788541307.853333:0:3642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3642:1875420981186560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788541307.853712:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a6707884e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981186688:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788541307.853735:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541307.853856:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981186688 00000100:00100000:3.0:1788541307.853861:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981186688 00000100:00100000:3.0:1788541307.853922:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788541307.853929:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981186688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788541307.853941:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3923505152 avail 3684278272 00000100:00100000:3.0:1788541307.853982:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981186688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541307.853988:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788541307.854063:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a6707884e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981186688:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788541308.747066:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788541309.445467:0:20387:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1788541309.771733:0:19546:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788541310.794187:0:17186:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788541310.923588:0:3643:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788541310.923610:0:3643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9a68355b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981186816:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788541310.923679:0:3643:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788541310.923961:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875420981186816 00000100:00100000:3.0:1788541310.923969:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875420981186816 00000100:00100000:3.0:1788541310.924024:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788541310.924035:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a68355b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981186816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788541310.924065:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788541310.924115:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a68355b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3643:x1875420981186816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788541310.924137:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1788541310.924158:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788541310.924197:0:3643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9a68355b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3643:1875420981186816:0@lo:13:osp-pre-0-1.0 Debug log: 42704 lines, 42704 kept, 0 dropped, 0 bad.